2024-04-25T12:07:37.144 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T12:07:37.144 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}} --verbose --name leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi --archive /home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673355 --owner scheduled_leonidus@teuthology -- /home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673355/orig.config.yaml 2024-04-25T12:07:37.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T12:07:37.287 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673355 branch: wip-lusov-quiescer description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}} email: null first_in_suite: false job_id: '7673355' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-lusov-quiescer ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiescer sha1: df40303764f976ac2e973c1ef2b40d1ebbda473b owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 2866 sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f sleep_before_teardown: 0 subset: 200/111111 suite: fs suite_branch: wip-lusov-quiescer suite_path: /home/teuthworker/src/github.com_ceph_ceph_df40303764f976ac2e973c1ef2b40d1ebbda473b/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph suite_sha1: df40303764f976ac2e973c1ef2b40d1ebbda473b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi094.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJfTSv7vMzHvjQXYZUaACokviymJH9s74MyO3qsaugg1TGjlYs3nxEsrIQdStWPCYKUur12JmThsUYMd+n2RGoA= smithi111.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLHwSyuUZgTTzFyWt6IuQv0TtKrF/6cj/pFgbB9JWdq+kIXngUeQPqUL31ZMTODhfqMLpYt7noj5lvtH6/PRnAQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - quiescer: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_11:13:36 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T12:07:37.287 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_df40303764f976ac2e973c1ef2b40d1ebbda473b/qa; will attempt to use it 2024-04-25T12:07:37.288 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_df40303764f976ac2e973c1ef2b40d1ebbda473b/qa/tasks 2024-04-25T12:07:37.288 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T12:07:37.290 INFO:teuthology.task.internal:Checking packages... 2024-04-25T12:07:37.313 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd69f13d827952bb07bb9b7973bca14f97d764d6f' 2024-04-25T12:07:37.313 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T12:07:37.313 INFO:teuthology.packaging:ref: None 2024-04-25T12:07:37.313 INFO:teuthology.packaging:tag: None 2024-04-25T12:07:37.313 INFO:teuthology.packaging:branch: wip-lusov-quiescer 2024-04-25T12:07:37.313 INFO:teuthology.packaging:sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T12:07:37.313 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-lusov-quiescer 2024-04-25T12:07:37.473 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3156-gd69f13d8-1jammy 2024-04-25T12:07:37.475 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T12:07:37.481 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T12:07:37.481 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T12:07:37.519 INFO:teuthology.task.internal:Saving configuration 2024-04-25T12:07:37.538 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T12:07:37.543 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T12:07:37.571 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673355', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 12:01:37.009793', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGlOvzdwXkLd6q48fntvodQvaIVHw12KPcpv/mocMgge'} 2024-04-25T12:07:37.593 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673355', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 12:01:37.008310', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICb1U04Dicd/CxxYdWBcbUvKoOl/tpQPAp9Xv2ofqZ35'} 2024-04-25T12:07:37.593 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T12:07:37.599 INFO:teuthology.task.internal:roles: ubuntu@smithi094.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-25T12:07:37.599 INFO:teuthology.task.internal:roles: ubuntu@smithi111.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-25T12:07:37.599 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T12:07:37.684 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb3307550d0>, signals=[15]) 2024-04-25T12:07:37.685 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T12:07:37.691 INFO:teuthology.task.internal:Opening connections... 2024-04-25T12:07:37.691 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi094.front.sepia.ceph.com 2024-04-25T12:07:37.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:07:37.774 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi111.front.sepia.ceph.com 2024-04-25T12:07:37.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:07:37.851 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T12:07:37.857 DEBUG:teuthology.orchestra.run.smithi094:> uname -m 2024-04-25T12:07:37.862 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2024-04-25T12:07:37.862 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2024-04-25T12:07:37.908 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T12:07:37.908 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="Ubuntu" 2024-04-25T12:07:37.908 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="22.04" 2024-04-25T12:07:37.908 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T12:07:37.908 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_CODENAME=jammy 2024-04-25T12:07:37.909 INFO:teuthology.orchestra.run.smithi094.stdout:ID=ubuntu 2024-04-25T12:07:37.909 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE=debian 2024-04-25T12:07:37.909 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T12:07:37.909 INFO:teuthology.orchestra.run.smithi094.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T12:07:37.909 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T12:07:37.909 INFO:teuthology.orchestra.run.smithi094.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T12:07:37.909 INFO:teuthology.orchestra.run.smithi094.stdout:UBUNTU_CODENAME=jammy 2024-04-25T12:07:37.909 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2024-04-25T12:07:37.941 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2024-04-25T12:07:37.946 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2024-04-25T12:07:37.946 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2024-04-25T12:07:37.992 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T12:07:37.992 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu" 2024-04-25T12:07:37.992 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="22.04" 2024-04-25T12:07:37.992 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T12:07:37.992 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=jammy 2024-04-25T12:07:37.993 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu 2024-04-25T12:07:37.993 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian 2024-04-25T12:07:37.993 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T12:07:37.993 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T12:07:37.993 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T12:07:37.993 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T12:07:37.993 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=jammy 2024-04-25T12:07:37.993 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2024-04-25T12:07:38.023 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T12:07:38.033 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T12:07:38.085 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T12:07:38.085 DEBUG:teuthology.orchestra.run.smithi094:> test '!' -e /home/ubuntu/cephtest 2024-04-25T12:07:38.088 DEBUG:teuthology.orchestra.run.smithi111:> test '!' -e /home/ubuntu/cephtest 2024-04-25T12:07:38.093 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T12:07:38.102 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T12:07:38.102 DEBUG:teuthology.orchestra.run.smithi094:> test -z $(ls -A /var/lib/ceph) 2024-04-25T12:07:38.133 DEBUG:teuthology.orchestra.run.smithi111:> test -z $(ls -A /var/lib/ceph) 2024-04-25T12:07:38.146 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T12:07:38.200 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T12:07:38.214 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-25T12:07:38.214 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-25T12:07:38.215 DEBUG:teuthology.orchestra.run.smithi094:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T12:07:38.215 DEBUG:teuthology.orchestra.run.smithi111:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T12:07:38.220 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:07:38.220 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:07:38.220 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2024-04-25T12:07:38.221 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2024-04-25T12:07:38.268 INFO:teuthology.orchestra.run.smithi094.stdout:5.15.0-56-generic 2024-04-25T12:07:38.268 INFO:teuthology.task.kernel:Running kernel on smithi094: 5.15.0-56-generic 2024-04-25T12:07:38.269 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get clean 2024-04-25T12:07:38.269 INFO:teuthology.orchestra.run.smithi111.stdout:5.15.0-56-generic 2024-04-25T12:07:38.270 INFO:teuthology.task.kernel:Running kernel on smithi111: 5.15.0-56-generic 2024-04-25T12:07:38.270 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get clean 2024-04-25T12:07:38.393 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get update 2024-04-25T12:07:38.430 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get update 2024-04-25T12:07:38.573 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T12:07:38.574 INFO:teuthology.orchestra.run.smithi094.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T12:07:38.574 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T12:07:38.660 INFO:teuthology.orchestra.run.smithi094.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T12:07:38.697 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T12:07:38.820 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T12:07:38.895 INFO:teuthology.orchestra.run.smithi094.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [619 kB] 2024-04-25T12:07:38.942 INFO:teuthology.orchestra.run.smithi094.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T12:07:38.973 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T12:07:39.002 INFO:teuthology.orchestra.run.smithi094.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T12:07:39.010 INFO:teuthology.orchestra.run.smithi094.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T12:07:39.010 INFO:teuthology.orchestra.run.smithi094.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T12:07:39.010 INFO:teuthology.orchestra.run.smithi094.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T12:07:39.050 INFO:teuthology.orchestra.run.smithi094.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T12:07:39.052 INFO:teuthology.orchestra.run.smithi094.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T12:07:39.057 INFO:teuthology.orchestra.run.smithi094.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T12:07:39.057 INFO:teuthology.orchestra.run.smithi094.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T12:07:39.097 INFO:teuthology.orchestra.run.smithi094.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T12:07:39.097 INFO:teuthology.orchestra.run.smithi094.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T12:07:39.098 INFO:teuthology.orchestra.run.smithi094.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T12:07:39.099 INFO:teuthology.orchestra.run.smithi094.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T12:07:39.105 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T12:07:39.107 INFO:teuthology.orchestra.run.smithi094.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T12:07:39.110 INFO:teuthology.orchestra.run.smithi094.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T12:07:39.110 INFO:teuthology.orchestra.run.smithi094.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T12:07:39.111 INFO:teuthology.orchestra.run.smithi094.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T12:07:39.111 INFO:teuthology.orchestra.run.smithi094.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T12:07:39.122 INFO:teuthology.orchestra.run.smithi094.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T12:07:39.122 INFO:teuthology.orchestra.run.smithi094.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T12:07:39.126 INFO:teuthology.orchestra.run.smithi094.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T12:07:39.126 INFO:teuthology.orchestra.run.smithi094.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-25T12:07:39.134 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T12:07:39.145 INFO:teuthology.orchestra.run.smithi094.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T12:07:39.157 INFO:teuthology.orchestra.run.smithi094.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T12:07:39.162 INFO:teuthology.orchestra.run.smithi094.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T12:07:39.169 INFO:teuthology.orchestra.run.smithi094.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T12:07:39.170 INFO:teuthology.orchestra.run.smithi094.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T12:07:39.170 INFO:teuthology.orchestra.run.smithi094.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T12:07:39.171 INFO:teuthology.orchestra.run.smithi094.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T12:07:39.171 INFO:teuthology.orchestra.run.smithi094.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [82.9 kB] 2024-04-25T12:07:39.172 INFO:teuthology.orchestra.run.smithi094.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [90.8 kB] 2024-04-25T12:07:39.187 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T12:07:39.196 INFO:teuthology.orchestra.run.smithi094.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T12:07:39.196 INFO:teuthology.orchestra.run.smithi094.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T12:07:39.196 INFO:teuthology.orchestra.run.smithi094.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [18.5 kB] 2024-04-25T12:07:39.197 INFO:teuthology.orchestra.run.smithi094.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [29.8 kB] 2024-04-25T12:07:39.223 INFO:teuthology.orchestra.run.smithi094.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T12:07:39.223 INFO:teuthology.orchestra.run.smithi094.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T12:07:39.266 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T12:07:39.353 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [619 kB] 2024-04-25T12:07:39.442 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T12:07:39.482 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T12:07:39.499 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T12:07:39.505 INFO:teuthology.orchestra.run.smithi111.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T12:07:39.506 INFO:teuthology.orchestra.run.smithi111.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T12:07:39.540 INFO:teuthology.orchestra.run.smithi111.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T12:07:39.546 INFO:teuthology.orchestra.run.smithi111.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T12:07:39.552 INFO:teuthology.orchestra.run.smithi111.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T12:07:39.552 INFO:teuthology.orchestra.run.smithi111.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T12:07:39.563 INFO:teuthology.orchestra.run.smithi111.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-25T12:07:39.613 INFO:teuthology.orchestra.run.smithi111.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T12:07:39.616 INFO:teuthology.orchestra.run.smithi111.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T12:07:39.617 INFO:teuthology.orchestra.run.smithi111.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T12:07:39.617 INFO:teuthology.orchestra.run.smithi111.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T12:07:39.618 INFO:teuthology.orchestra.run.smithi111.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T12:07:39.618 INFO:teuthology.orchestra.run.smithi111.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T12:07:39.618 INFO:teuthology.orchestra.run.smithi111.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [90.8 kB] 2024-04-25T12:07:39.619 INFO:teuthology.orchestra.run.smithi111.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [82.9 kB] 2024-04-25T12:07:39.620 INFO:teuthology.orchestra.run.smithi111.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T12:07:39.637 INFO:teuthology.orchestra.run.smithi111.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T12:07:39.649 INFO:teuthology.orchestra.run.smithi111.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T12:07:39.656 INFO:teuthology.orchestra.run.smithi111.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [18.5 kB] 2024-04-25T12:07:39.657 INFO:teuthology.orchestra.run.smithi111.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [29.8 kB] 2024-04-25T12:07:39.657 INFO:teuthology.orchestra.run.smithi111.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T12:07:39.658 INFO:teuthology.orchestra.run.smithi111.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T12:07:39.679 INFO:teuthology.orchestra.run.smithi111.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T12:07:39.680 INFO:teuthology.orchestra.run.smithi111.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T12:07:39.681 INFO:teuthology.orchestra.run.smithi111.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T12:07:39.746 INFO:teuthology.orchestra.run.smithi111.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T12:07:39.763 INFO:teuthology.orchestra.run.smithi111.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T12:07:39.763 INFO:teuthology.orchestra.run.smithi111.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T12:07:39.777 INFO:teuthology.orchestra.run.smithi111.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T12:07:39.959 INFO:teuthology.orchestra.run.smithi111.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T12:07:40.365 INFO:teuthology.orchestra.run.smithi111.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T12:07:40.370 INFO:teuthology.orchestra.run.smithi111.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T12:07:40.371 INFO:teuthology.orchestra.run.smithi111.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T12:07:40.384 INFO:teuthology.orchestra.run.smithi111.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T12:07:40.387 INFO:teuthology.orchestra.run.smithi111.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T12:07:44.656 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 13.3 MB in 2s (7,077 kB/s) 2024-04-25T12:07:45.209 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 13.3 MB in 2s (5,640 kB/s) 2024-04-25T12:07:46.143 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-04-25T12:07:46.162 DEBUG:teuthology.orchestra.run.smithi094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T12:07:46.225 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-04-25T12:07:46.424 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree... 2024-04-25T12:07:46.425 INFO:teuthology.orchestra.run.smithi094.stdout:Reading state information... 2024-04-25T12:07:46.585 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-04-25T12:07:46.599 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T12:07:46.599 INFO:teuthology.orchestra.run.smithi094.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T12:07:46.600 INFO:teuthology.orchestra.run.smithi094.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T12:07:46.600 INFO:teuthology.orchestra.run.smithi094.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T12:07:46.600 INFO:teuthology.orchestra.run.smithi094.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T12:07:46.600 INFO:teuthology.orchestra.run.smithi094.stdout: python2.7-minimal 2024-04-25T12:07:46.600 INFO:teuthology.orchestra.run.smithi094.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T12:07:46.601 INFO:teuthology.orchestra.run.smithi094.stdout:The following additional packages will be installed: 2024-04-25T12:07:46.602 INFO:teuthology.orchestra.run.smithi094.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T12:07:46.602 INFO:teuthology.orchestra.run.smithi094.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T12:07:46.602 INFO:teuthology.orchestra.run.smithi094.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T12:07:46.603 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T12:07:46.603 INFO:teuthology.orchestra.run.smithi094.stdout:Suggested packages: 2024-04-25T12:07:46.604 INFO:teuthology.orchestra.run.smithi094.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T12:07:46.604 INFO:teuthology.orchestra.run.smithi094.stdout:Recommended packages: 2024-04-25T12:07:46.604 INFO:teuthology.orchestra.run.smithi094.stdout: thermald 2024-04-25T12:07:46.645 INFO:teuthology.orchestra.run.smithi094.stdout:The following NEW packages will be installed: 2024-04-25T12:07:46.646 INFO:teuthology.orchestra.run.smithi094.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T12:07:46.646 INFO:teuthology.orchestra.run.smithi094.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T12:07:46.646 INFO:teuthology.orchestra.run.smithi094.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T12:07:46.648 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages will be upgraded: 2024-04-25T12:07:46.648 INFO:teuthology.orchestra.run.smithi094.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T12:07:46.654 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-04-25T12:07:46.832 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-04-25T12:07:46.832 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-04-25T12:07:46.986 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T12:07:46.986 INFO:teuthology.orchestra.run.smithi111.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T12:07:46.986 INFO:teuthology.orchestra.run.smithi111.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T12:07:46.987 INFO:teuthology.orchestra.run.smithi111.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T12:07:46.987 INFO:teuthology.orchestra.run.smithi111.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T12:07:46.987 INFO:teuthology.orchestra.run.smithi111.stdout: python2.7-minimal 2024-04-25T12:07:46.987 INFO:teuthology.orchestra.run.smithi111.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T12:07:46.988 INFO:teuthology.orchestra.run.smithi111.stdout:The following additional packages will be installed: 2024-04-25T12:07:46.988 INFO:teuthology.orchestra.run.smithi111.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T12:07:46.988 INFO:teuthology.orchestra.run.smithi111.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T12:07:46.989 INFO:teuthology.orchestra.run.smithi111.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T12:07:46.990 INFO:teuthology.orchestra.run.smithi111.stdout:Suggested packages: 2024-04-25T12:07:46.990 INFO:teuthology.orchestra.run.smithi111.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T12:07:46.990 INFO:teuthology.orchestra.run.smithi111.stdout:Recommended packages: 2024-04-25T12:07:46.990 INFO:teuthology.orchestra.run.smithi111.stdout: thermald 2024-04-25T12:07:47.035 INFO:teuthology.orchestra.run.smithi111.stdout:The following NEW packages will be installed: 2024-04-25T12:07:47.035 INFO:teuthology.orchestra.run.smithi111.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T12:07:47.036 INFO:teuthology.orchestra.run.smithi111.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T12:07:47.036 INFO:teuthology.orchestra.run.smithi111.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T12:07:47.037 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages will be upgraded: 2024-04-25T12:07:47.037 INFO:teuthology.orchestra.run.smithi111.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T12:07:47.095 INFO:teuthology.orchestra.run.smithi111.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T12:07:47.095 INFO:teuthology.orchestra.run.smithi111.stdout:Need to get 113 MB of archives. 2024-04-25T12:07:47.095 INFO:teuthology.orchestra.run.smithi111.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T12:07:47.095 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T12:07:47.328 INFO:teuthology.orchestra.run.smithi094.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T12:07:47.328 INFO:teuthology.orchestra.run.smithi094.stdout:Need to get 113 MB of archives. 2024-04-25T12:07:47.329 INFO:teuthology.orchestra.run.smithi094.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T12:07:47.329 INFO:teuthology.orchestra.run.smithi094.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T12:07:47.678 INFO:teuthology.orchestra.run.smithi111.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T12:07:47.859 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T12:07:48.728 INFO:teuthology.orchestra.run.smithi094.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T12:07:48.807 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T12:07:48.807 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T12:07:48.807 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T12:07:49.009 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T12:07:49.035 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T12:07:49.080 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T12:07:49.419 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 113 MB in 2s (56.9 MB/s) 2024-04-25T12:07:49.596 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T12:07:51.261 INFO:teuthology.orchestra.run.smithi094.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T12:07:51.261 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T12:07:51.261 INFO:teuthology.orchestra.run.smithi094.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T12:07:51.646 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T12:07:51.650 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T12:07:51.736 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:07:53.115 INFO:teuthology.orchestra.run.smithi094.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T12:07:53.274 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T12:07:53.693 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 113 MB in 7s (17.1 MB/s) 2024-04-25T12:07:53.844 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T12:07:53.946 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T12:07:53.967 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T12:07:54.054 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:07:54.524 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T12:07:54.544 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T12:07:54.582 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:07:55.863 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T12:07:55.867 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T12:07:56.090 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:07:58.185 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T12:07:58.206 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T12:07:58.285 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:07:58.856 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T12:07:58.877 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T12:07:58.922 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:08:02.077 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T12:08:02.203 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T12:08:02.561 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T12:08:02.690 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T12:08:02.976 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T12:08:02.999 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T12:08:03.067 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T12:08:06.017 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T12:08:06.170 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T12:08:06.504 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T12:08:06.632 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T12:08:06.944 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T12:08:06.967 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T12:08:07.010 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T12:08:08.475 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T12:08:08.512 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T12:08:08.550 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:08:11.711 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T12:08:11.837 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T12:08:12.187 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T12:08:12.326 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:08:12.451 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T12:08:12.580 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:08:12.999 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T12:08:13.035 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T12:08:13.065 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:08:13.871 INFO:teuthology.orchestra.run.smithi111.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T12:08:13.871 INFO:teuthology.orchestra.run.smithi111.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T12:08:13.871 INFO:teuthology.orchestra.run.smithi111.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T12:08:13.871 INFO:teuthology.orchestra.run.smithi111.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T12:08:14.016 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:08:16.068 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:08:16.691 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T12:08:16.817 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T12:08:17.176 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T12:08:17.348 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:08:17.452 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T12:08:17.474 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T12:08:17.579 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T12:08:17.653 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:08:17.688 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:08:17.750 INFO:teuthology.orchestra.run.smithi111.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T12:08:17.750 INFO:teuthology.orchestra.run.smithi111.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T12:08:19.003 INFO:teuthology.orchestra.run.smithi094.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T12:08:19.003 INFO:teuthology.orchestra.run.smithi094.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T12:08:19.003 INFO:teuthology.orchestra.run.smithi094.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T12:08:19.003 INFO:teuthology.orchestra.run.smithi094.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T12:08:19.157 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:08:20.927 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:08:22.319 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T12:08:22.454 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T12:08:22.588 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T12:08:22.647 INFO:teuthology.orchestra.run.smithi094.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T12:08:22.647 INFO:teuthology.orchestra.run.smithi094.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T12:08:31.649 INFO:teuthology.orchestra.run.smithi111.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T12:08:31.650 INFO:teuthology.orchestra.run.smithi111.stdout:Sourcing file `/etc/default/grub' 2024-04-25T12:08:31.676 INFO:teuthology.orchestra.run.smithi111.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T12:08:31.684 INFO:teuthology.orchestra.run.smithi111.stdout:Generating grub configuration file ... 2024-04-25T12:08:32.002 INFO:teuthology.orchestra.run.smithi111.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T12:08:32.016 INFO:teuthology.orchestra.run.smithi111.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T12:08:32.299 INFO:teuthology.orchestra.run.smithi111.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T12:08:32.304 INFO:teuthology.orchestra.run.smithi111.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T12:08:32.377 INFO:teuthology.orchestra.run.smithi111.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T12:08:32.382 INFO:teuthology.orchestra.run.smithi111.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T12:08:32.560 INFO:teuthology.orchestra.run.smithi111.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T12:08:32.560 INFO:teuthology.orchestra.run.smithi111.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T12:08:32.560 INFO:teuthology.orchestra.run.smithi111.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T12:08:32.606 INFO:teuthology.orchestra.run.smithi111.stdout:done 2024-04-25T12:08:33.090 DEBUG:teuthology.orchestra.run.smithi111:> dpkg -s linux-image-generic 2024-04-25T12:08:33.110 INFO:teuthology.orchestra.run.smithi111.stdout:Package: linux-image-generic 2024-04-25T12:08:33.110 INFO:teuthology.orchestra.run.smithi111.stdout:Status: install ok installed 2024-04-25T12:08:33.110 INFO:teuthology.orchestra.run.smithi111.stdout:Priority: optional 2024-04-25T12:08:33.110 INFO:teuthology.orchestra.run.smithi111.stdout:Section: kernel 2024-04-25T12:08:33.111 INFO:teuthology.orchestra.run.smithi111.stdout:Installed-Size: 21 2024-04-25T12:08:33.111 INFO:teuthology.orchestra.run.smithi111.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T12:08:33.111 INFO:teuthology.orchestra.run.smithi111.stdout:Architecture: amd64 2024-04-25T12:08:33.111 INFO:teuthology.orchestra.run.smithi111.stdout:Source: linux-meta 2024-04-25T12:08:33.111 INFO:teuthology.orchestra.run.smithi111.stdout:Version: 5.15.0.105.102 2024-04-25T12:08:33.111 INFO:teuthology.orchestra.run.smithi111.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T12:08:33.111 INFO:teuthology.orchestra.run.smithi111.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T12:08:33.111 INFO:teuthology.orchestra.run.smithi111.stdout:Recommends: thermald 2024-04-25T12:08:33.111 INFO:teuthology.orchestra.run.smithi111.stdout:Description: Generic Linux kernel image 2024-04-25T12:08:33.111 INFO:teuthology.orchestra.run.smithi111.stdout: This package will always depend on the latest generic kernel image 2024-04-25T12:08:33.111 INFO:teuthology.orchestra.run.smithi111.stdout: available. 2024-04-25T12:08:33.112 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T12:08:33.112 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T12:08:33.112 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T12:08:33.112 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-25T12:08:33.112 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi111.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T12:08:33.113 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get clean 2024-04-25T12:08:33.313 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get update 2024-04-25T12:08:33.575 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T12:08:33.575 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T12:08:33.641 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T12:08:33.723 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T12:08:34.950 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-04-25T12:08:34.967 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T12:08:35.018 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-04-25T12:08:35.195 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-04-25T12:08:35.196 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-04-25T12:08:35.355 INFO:teuthology.orchestra.run.smithi111.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T12:08:35.356 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T12:08:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T12:08:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T12:08:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T12:08:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T12:08:35.356 INFO:teuthology.orchestra.run.smithi111.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T12:08:35.357 INFO:teuthology.orchestra.run.smithi111.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T12:08:35.394 INFO:teuthology.orchestra.run.smithi111.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T12:08:35.396 DEBUG:teuthology.orchestra.run.smithi111:> dpkg -s linux-image-generic 2024-04-25T12:08:35.455 INFO:teuthology.orchestra.run.smithi111.stdout:Package: linux-image-generic 2024-04-25T12:08:35.455 INFO:teuthology.orchestra.run.smithi111.stdout:Status: install ok installed 2024-04-25T12:08:35.455 INFO:teuthology.orchestra.run.smithi111.stdout:Priority: optional 2024-04-25T12:08:35.456 INFO:teuthology.orchestra.run.smithi111.stdout:Section: kernel 2024-04-25T12:08:35.456 INFO:teuthology.orchestra.run.smithi111.stdout:Installed-Size: 21 2024-04-25T12:08:35.456 INFO:teuthology.orchestra.run.smithi111.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T12:08:35.456 INFO:teuthology.orchestra.run.smithi111.stdout:Architecture: amd64 2024-04-25T12:08:35.456 INFO:teuthology.orchestra.run.smithi111.stdout:Source: linux-meta 2024-04-25T12:08:35.456 INFO:teuthology.orchestra.run.smithi111.stdout:Version: 5.15.0.105.102 2024-04-25T12:08:35.456 INFO:teuthology.orchestra.run.smithi111.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T12:08:35.456 INFO:teuthology.orchestra.run.smithi111.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T12:08:35.456 INFO:teuthology.orchestra.run.smithi111.stdout:Recommends: thermald 2024-04-25T12:08:35.456 INFO:teuthology.orchestra.run.smithi111.stdout:Description: Generic Linux kernel image 2024-04-25T12:08:35.456 INFO:teuthology.orchestra.run.smithi111.stdout: This package will always depend on the latest generic kernel image 2024-04-25T12:08:35.456 INFO:teuthology.orchestra.run.smithi111.stdout: available. 2024-04-25T12:08:35.457 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2024-04-25T12:08:35.500 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.Ai1tBs9Gry 2024-04-25T12:08:35.500 DEBUG:teuthology.orchestra.run.smithi111:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Ai1tBs9Gry 2024-04-25T12:08:35.555 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.Ai1tBs9Gry 2024-04-25T12:08:35.665 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.Ai1tBs9Gry is 10KB 2024-04-25T12:08:35.678 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.Ai1tBs9Gry 2024-04-25T12:08:35.683 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T12:08:35.736 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T12:08:35.736 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T12:08:35.736 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T12:08:35.805 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T12:08:35.805 DEBUG:teuthology.orchestra.run.smithi111:> sudo update-grub 2024-04-25T12:08:37.020 INFO:teuthology.orchestra.run.smithi094.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T12:08:37.020 INFO:teuthology.orchestra.run.smithi094.stdout:Sourcing file `/etc/default/grub' 2024-04-25T12:08:37.044 INFO:teuthology.orchestra.run.smithi094.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T12:08:37.056 INFO:teuthology.orchestra.run.smithi111.stderr:Sourcing file `/etc/default/grub' 2024-04-25T12:08:37.057 INFO:teuthology.orchestra.run.smithi111.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T12:08:37.059 INFO:teuthology.orchestra.run.smithi111.stderr:Generating grub configuration file ... 2024-04-25T12:08:37.060 INFO:teuthology.orchestra.run.smithi094.stdout:Generating grub configuration file ... 2024-04-25T12:08:37.244 INFO:teuthology.orchestra.run.smithi111.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T12:08:37.251 INFO:teuthology.orchestra.run.smithi111.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T12:08:37.341 INFO:teuthology.orchestra.run.smithi094.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T12:08:37.356 INFO:teuthology.orchestra.run.smithi094.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T12:08:37.487 INFO:teuthology.orchestra.run.smithi111.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T12:08:37.493 INFO:teuthology.orchestra.run.smithi111.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T12:08:37.536 INFO:teuthology.orchestra.run.smithi111.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T12:08:37.542 INFO:teuthology.orchestra.run.smithi111.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T12:08:37.652 INFO:teuthology.orchestra.run.smithi094.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T12:08:37.657 INFO:teuthology.orchestra.run.smithi094.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T12:08:37.667 INFO:teuthology.orchestra.run.smithi111.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T12:08:37.668 INFO:teuthology.orchestra.run.smithi111.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T12:08:37.668 INFO:teuthology.orchestra.run.smithi111.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T12:08:37.695 INFO:teuthology.orchestra.run.smithi111.stderr:done 2024-04-25T12:08:37.706 DEBUG:teuthology.orchestra.run.smithi111:> sudo shutdown -r now 2024-04-25T12:08:37.723 INFO:teuthology.orchestra.run.smithi094.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T12:08:37.729 INFO:teuthology.orchestra.run.smithi094.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T12:08:37.913 INFO:teuthology.orchestra.run.smithi094.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T12:08:37.913 INFO:teuthology.orchestra.run.smithi094.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T12:08:37.913 INFO:teuthology.orchestra.run.smithi094.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T12:08:37.957 INFO:teuthology.orchestra.run.smithi094.stdout:done 2024-04-25T12:08:38.404 DEBUG:teuthology.orchestra.run.smithi094:> dpkg -s linux-image-generic 2024-04-25T12:08:38.426 INFO:teuthology.orchestra.run.smithi094.stdout:Package: linux-image-generic 2024-04-25T12:08:38.426 INFO:teuthology.orchestra.run.smithi094.stdout:Status: install ok installed 2024-04-25T12:08:38.427 INFO:teuthology.orchestra.run.smithi094.stdout:Priority: optional 2024-04-25T12:08:38.427 INFO:teuthology.orchestra.run.smithi094.stdout:Section: kernel 2024-04-25T12:08:38.427 INFO:teuthology.orchestra.run.smithi094.stdout:Installed-Size: 21 2024-04-25T12:08:38.427 INFO:teuthology.orchestra.run.smithi094.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T12:08:38.427 INFO:teuthology.orchestra.run.smithi094.stdout:Architecture: amd64 2024-04-25T12:08:38.427 INFO:teuthology.orchestra.run.smithi094.stdout:Source: linux-meta 2024-04-25T12:08:38.427 INFO:teuthology.orchestra.run.smithi094.stdout:Version: 5.15.0.105.102 2024-04-25T12:08:38.427 INFO:teuthology.orchestra.run.smithi094.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T12:08:38.427 INFO:teuthology.orchestra.run.smithi094.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T12:08:38.427 INFO:teuthology.orchestra.run.smithi094.stdout:Recommends: thermald 2024-04-25T12:08:38.427 INFO:teuthology.orchestra.run.smithi094.stdout:Description: Generic Linux kernel image 2024-04-25T12:08:38.427 INFO:teuthology.orchestra.run.smithi094.stdout: This package will always depend on the latest generic kernel image 2024-04-25T12:08:38.427 INFO:teuthology.orchestra.run.smithi094.stdout: available. 2024-04-25T12:08:38.428 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T12:08:38.428 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T12:08:38.428 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T12:08:38.428 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-25T12:08:38.428 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi094.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T12:08:38.428 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get clean 2024-04-25T12:08:38.593 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get update 2024-04-25T12:08:39.223 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T12:08:39.330 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T12:08:39.412 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T12:08:39.493 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T12:08:40.576 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-04-25T12:08:40.594 DEBUG:teuthology.orchestra.run.smithi094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T12:08:40.652 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-04-25T12:08:40.853 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree... 2024-04-25T12:08:40.854 INFO:teuthology.orchestra.run.smithi094.stdout:Reading state information... 2024-04-25T12:08:41.029 INFO:teuthology.orchestra.run.smithi094.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T12:08:41.029 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T12:08:41.029 INFO:teuthology.orchestra.run.smithi094.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T12:08:41.029 INFO:teuthology.orchestra.run.smithi094.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T12:08:41.029 INFO:teuthology.orchestra.run.smithi094.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T12:08:41.029 INFO:teuthology.orchestra.run.smithi094.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T12:08:41.030 INFO:teuthology.orchestra.run.smithi094.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T12:08:41.030 INFO:teuthology.orchestra.run.smithi094.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T12:08:41.067 INFO:teuthology.orchestra.run.smithi094.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T12:08:41.069 DEBUG:teuthology.orchestra.run.smithi094:> dpkg -s linux-image-generic 2024-04-25T12:08:41.086 INFO:teuthology.orchestra.run.smithi094.stdout:Package: linux-image-generic 2024-04-25T12:08:41.086 INFO:teuthology.orchestra.run.smithi094.stdout:Status: install ok installed 2024-04-25T12:08:41.086 INFO:teuthology.orchestra.run.smithi094.stdout:Priority: optional 2024-04-25T12:08:41.087 INFO:teuthology.orchestra.run.smithi094.stdout:Section: kernel 2024-04-25T12:08:41.087 INFO:teuthology.orchestra.run.smithi094.stdout:Installed-Size: 21 2024-04-25T12:08:41.087 INFO:teuthology.orchestra.run.smithi094.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T12:08:41.087 INFO:teuthology.orchestra.run.smithi094.stdout:Architecture: amd64 2024-04-25T12:08:41.087 INFO:teuthology.orchestra.run.smithi094.stdout:Source: linux-meta 2024-04-25T12:08:41.087 INFO:teuthology.orchestra.run.smithi094.stdout:Version: 5.15.0.105.102 2024-04-25T12:08:41.087 INFO:teuthology.orchestra.run.smithi094.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T12:08:41.087 INFO:teuthology.orchestra.run.smithi094.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T12:08:41.087 INFO:teuthology.orchestra.run.smithi094.stdout:Recommends: thermald 2024-04-25T12:08:41.087 INFO:teuthology.orchestra.run.smithi094.stdout:Description: Generic Linux kernel image 2024-04-25T12:08:41.087 INFO:teuthology.orchestra.run.smithi094.stdout: This package will always depend on the latest generic kernel image 2024-04-25T12:08:41.087 INFO:teuthology.orchestra.run.smithi094.stdout: available. 2024-04-25T12:08:41.088 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2024-04-25T12:08:41.132 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.jzQkH9raX7 2024-04-25T12:08:41.132 DEBUG:teuthology.orchestra.run.smithi094:> sudo cp /boot/grub/grub.cfg /tmp/tmp.jzQkH9raX7 2024-04-25T12:08:41.190 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.jzQkH9raX7 2024-04-25T12:08:41.307 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.jzQkH9raX7 is 10KB 2024-04-25T12:08:41.319 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.jzQkH9raX7 2024-04-25T12:08:41.324 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T12:08:41.380 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:08:41.380 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T12:08:41.380 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T12:08:41.459 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T12:08:41.459 DEBUG:teuthology.orchestra.run.smithi094:> sudo update-grub 2024-04-25T12:08:42.842 INFO:teuthology.orchestra.run.smithi094.stderr:Sourcing file `/etc/default/grub' 2024-04-25T12:08:42.843 INFO:teuthology.orchestra.run.smithi094.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T12:08:42.847 INFO:teuthology.orchestra.run.smithi094.stderr:Generating grub configuration file ... 2024-04-25T12:08:43.016 INFO:teuthology.orchestra.run.smithi094.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T12:08:43.022 INFO:teuthology.orchestra.run.smithi094.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T12:08:43.271 INFO:teuthology.orchestra.run.smithi094.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T12:08:43.276 INFO:teuthology.orchestra.run.smithi094.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T12:08:43.318 INFO:teuthology.orchestra.run.smithi094.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T12:08:43.323 INFO:teuthology.orchestra.run.smithi094.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T12:08:43.440 INFO:teuthology.orchestra.run.smithi094.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T12:08:43.440 INFO:teuthology.orchestra.run.smithi094.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T12:08:43.440 INFO:teuthology.orchestra.run.smithi094.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T12:08:43.457 INFO:teuthology.orchestra.run.smithi094.stderr:done 2024-04-25T12:08:43.459 DEBUG:teuthology.orchestra.run.smithi094:> sudo shutdown -r now 2024-04-25T12:09:07.730 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-25T12:09:07.731 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-25T12:09:07.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:09:13.468 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-25T12:09:13.468 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-04-25T12:09:13.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:09:26.302 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-25T12:09:31.938 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.94 2024-04-25T12:09:35.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-25T12:09:35.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:09:38.370 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-25T12:09:40.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-04-25T12:09:40.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:09:50.380 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-25T12:09:50.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:09:53.438 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-25T12:10:08.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-25T12:10:08.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:10:26.975 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-25T12:10:40.959 DEBUG:teuthology.orchestra.remote:timed out 2024-04-25T12:10:44.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-25T12:10:44.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:10:45.358 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-04-25T12:10:45.973 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-25T12:10:45.973 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-105-generic"... 2024-04-25T12:10:45.973 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2024-04-25T12:10:46.021 INFO:teuthology.orchestra.run.smithi111.stdout:5.15.0-105-generic 2024-04-25T12:10:46.021 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T12:10:46.021 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T12:10:46.021 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T12:10:47.023 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-25T12:10:47.023 DEBUG:teuthology.orchestra.run.smithi111:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T12:10:47.383 INFO:teuthology.orchestra.run.smithi111.stdout:ttyS1 2024-04-25T12:10:47.403 DEBUG:teuthology.parallel:result is None 2024-04-25T12:10:52.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-04-25T12:10:52.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:10:53.385 DEBUG:teuthology.orchestra.run.smithi094:> true 2024-04-25T12:10:54.001 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-04-25T12:10:54.002 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-04-25T12:10:54.002 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2024-04-25T12:10:54.049 INFO:teuthology.orchestra.run.smithi094.stdout:5.15.0-105-generic 2024-04-25T12:10:54.049 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T12:10:54.049 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T12:10:54.049 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T12:10:55.050 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-25T12:10:55.050 DEBUG:teuthology.orchestra.run.smithi094:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T12:10:55.132 INFO:teuthology.orchestra.run.smithi094.stdout:ttyS1 2024-04-25T12:10:55.158 DEBUG:teuthology.parallel:result is None 2024-04-25T12:10:55.158 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T12:10:55.166 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T12:10:55.166 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T12:10:55.168 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T12:10:55.175 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T12:10:55.203 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T12:10:55.220 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T12:10:55.220 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T12:10:55.223 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T12:10:55.246 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T12:10:55.253 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T12:10:55.253 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T12:10:55.286 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T12:10:55.299 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T12:10:55.307 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T12:10:55.310 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T12:10:55.318 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T12:10:55.320 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T12:10:55.327 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T12:10:55.327 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T12:10:55.353 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T12:10:55.372 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T12:10:55.380 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T12:10:55.380 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T12:10:55.410 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T12:10:55.421 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T12:10:55.461 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T12:10:55.509 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:10:55.510 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T12:10:55.578 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T12:10:55.584 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T12:10:55.633 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T12:10:55.633 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T12:10:55.702 DEBUG:teuthology.orchestra.run.smithi094:> sudo service rsyslog restart 2024-04-25T12:10:55.704 DEBUG:teuthology.orchestra.run.smithi111:> sudo service rsyslog restart 2024-04-25T12:10:55.778 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T12:10:55.785 INFO:teuthology.task.internal:Starting timer... 2024-04-25T12:10:55.785 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T12:10:55.817 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T12:10:55.839 DEBUG:teuthology.task.selinux:Excluding smithi094: OS 'ubuntu' does not support SELinux 2024-04-25T12:10:55.839 DEBUG:teuthology.task.selinux:Excluding smithi111: OS 'ubuntu' does not support SELinux 2024-04-25T12:10:55.840 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T12:10:55.840 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-25T12:10:55.840 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T12:10:55.840 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T12:10:55.856 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T12:10:55.874 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T12:10:55.876 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi094.front.sepia.ceph.com,smithi111.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T12:17:57.411 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi094.front.sepia.ceph.com'), Remote(name='ubuntu@smithi111.front.sepia.ceph.com')] 2024-04-25T12:17:57.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-04-25T12:17:57.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:17:57.499 DEBUG:teuthology.orchestra.run.smithi094:> true 2024-04-25T12:17:57.574 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-04-25T12:17:57.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-25T12:17:57.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:17:57.653 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-04-25T12:17:57.733 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-25T12:17:57.733 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T12:17:57.743 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T12:17:57.744 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T12:17:57.744 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T12:17:57.747 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T12:17:57.747 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T12:17:57.773 INFO:teuthology.orchestra.run.smithi094.stdout:25 Apr 12:17:57 ntpd[17207]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T12:17:57.773 INFO:teuthology.orchestra.run.smithi094.stdout:25 Apr 12:17:57 ntpd[17207]: Command line: ntpd -gq 2024-04-25T12:17:57.773 INFO:teuthology.orchestra.run.smithi094.stdout:25 Apr 12:17:57 ntpd[17207]: ---------------------------------------------------- 2024-04-25T12:17:57.773 INFO:teuthology.orchestra.run.smithi094.stdout:25 Apr 12:17:57 ntpd[17207]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T12:17:57.773 INFO:teuthology.orchestra.run.smithi094.stdout:25 Apr 12:17:57 ntpd[17207]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T12:17:57.773 INFO:teuthology.orchestra.run.smithi094.stdout:25 Apr 12:17:57 ntpd[17207]: corporation. Support and training for ntp-4 are 2024-04-25T12:17:57.773 INFO:teuthology.orchestra.run.smithi094.stdout:25 Apr 12:17:57 ntpd[17207]: available at https://www.nwtime.org/support 2024-04-25T12:17:57.773 INFO:teuthology.orchestra.run.smithi094.stdout:25 Apr 12:17:57 ntpd[17207]: ---------------------------------------------------- 2024-04-25T12:17:57.774 INFO:teuthology.orchestra.run.smithi094.stdout:25 Apr 12:17:57 ntpd[17207]: proto: precision = 0.064 usec (-24) 2024-04-25T12:17:57.774 INFO:teuthology.orchestra.run.smithi094.stdout:25 Apr 12:17:57 ntpd[17207]: basedate set to 2022-02-04 2024-04-25T12:17:57.774 INFO:teuthology.orchestra.run.smithi094.stdout:25 Apr 12:17:57 ntpd[17207]: gps base set to 2022-02-06 (week 2196) 2024-04-25T12:17:57.774 INFO:teuthology.orchestra.run.smithi094.stdout:25 Apr 12:17:57 ntpd[17207]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T12:17:57.775 INFO:teuthology.orchestra.run.smithi094.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T12:17:57.775 INFO:teuthology.orchestra.run.smithi094.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T12:17:57.776 INFO:teuthology.orchestra.run.smithi094.stdout:25 Apr 12:17:57 ntpd[17207]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T12:17:57.776 INFO:teuthology.orchestra.run.smithi094.stdout:25 Apr 12:17:57 ntpd[17207]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T12:17:57.776 INFO:teuthology.orchestra.run.smithi094.stdout:25 Apr 12:17:57 ntpd[17207]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T12:17:57.776 INFO:teuthology.orchestra.run.smithi094.stdout:25 Apr 12:17:57 ntpd[17207]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T12:17:57.776 INFO:teuthology.orchestra.run.smithi094.stdout:25 Apr 12:17:57 ntpd[17207]: Listen normally on 3 enp3s0f1 172.21.15.94:123 2024-04-25T12:17:57.776 INFO:teuthology.orchestra.run.smithi094.stdout:25 Apr 12:17:57 ntpd[17207]: Listen normally on 4 lo [::1]:123 2024-04-25T12:17:57.776 INFO:teuthology.orchestra.run.smithi094.stdout:25 Apr 12:17:57 ntpd[17207]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d763%5]:123 2024-04-25T12:17:57.776 INFO:teuthology.orchestra.run.smithi094.stdout:25 Apr 12:17:57 ntpd[17207]: Listening on routing socket on fd #22 for interface updates 2024-04-25T12:17:57.804 INFO:teuthology.orchestra.run.smithi111.stdout:25 Apr 12:17:57 ntpd[17211]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T12:17:57.805 INFO:teuthology.orchestra.run.smithi111.stdout:25 Apr 12:17:57 ntpd[17211]: Command line: ntpd -gq 2024-04-25T12:17:57.805 INFO:teuthology.orchestra.run.smithi111.stdout:25 Apr 12:17:57 ntpd[17211]: ---------------------------------------------------- 2024-04-25T12:17:57.805 INFO:teuthology.orchestra.run.smithi111.stdout:25 Apr 12:17:57 ntpd[17211]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T12:17:57.805 INFO:teuthology.orchestra.run.smithi111.stdout:25 Apr 12:17:57 ntpd[17211]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T12:17:57.805 INFO:teuthology.orchestra.run.smithi111.stdout:25 Apr 12:17:57 ntpd[17211]: corporation. Support and training for ntp-4 are 2024-04-25T12:17:57.805 INFO:teuthology.orchestra.run.smithi111.stdout:25 Apr 12:17:57 ntpd[17211]: available at https://www.nwtime.org/support 2024-04-25T12:17:57.805 INFO:teuthology.orchestra.run.smithi111.stdout:25 Apr 12:17:57 ntpd[17211]: ---------------------------------------------------- 2024-04-25T12:17:57.806 INFO:teuthology.orchestra.run.smithi111.stdout:25 Apr 12:17:57 ntpd[17211]: proto: precision = 0.058 usec (-24) 2024-04-25T12:17:57.806 INFO:teuthology.orchestra.run.smithi111.stdout:25 Apr 12:17:57 ntpd[17211]: basedate set to 2022-02-04 2024-04-25T12:17:57.806 INFO:teuthology.orchestra.run.smithi111.stdout:25 Apr 12:17:57 ntpd[17211]: gps base set to 2022-02-06 (week 2196) 2024-04-25T12:17:57.806 INFO:teuthology.orchestra.run.smithi111.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T12:17:57.806 INFO:teuthology.orchestra.run.smithi111.stdout:25 Apr 12:17:57 ntpd[17211]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T12:17:57.807 INFO:teuthology.orchestra.run.smithi111.stdout:25 Apr 12:17:57 ntpd[17211]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T12:17:57.807 INFO:teuthology.orchestra.run.smithi111.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T12:17:57.808 INFO:teuthology.orchestra.run.smithi111.stdout:25 Apr 12:17:57 ntpd[17211]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T12:17:57.808 INFO:teuthology.orchestra.run.smithi111.stdout:25 Apr 12:17:57 ntpd[17211]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T12:17:57.808 INFO:teuthology.orchestra.run.smithi111.stdout:25 Apr 12:17:57 ntpd[17211]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T12:17:57.808 INFO:teuthology.orchestra.run.smithi111.stdout:25 Apr 12:17:57 ntpd[17211]: Listen normally on 3 enp3s0f1 172.21.15.111:123 2024-04-25T12:17:57.808 INFO:teuthology.orchestra.run.smithi111.stdout:25 Apr 12:17:57 ntpd[17211]: Listen normally on 4 lo [::1]:123 2024-04-25T12:17:57.808 INFO:teuthology.orchestra.run.smithi111.stdout:25 Apr 12:17:57 ntpd[17211]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc2f%5]:123 2024-04-25T12:17:57.808 INFO:teuthology.orchestra.run.smithi111.stdout:25 Apr 12:17:57 ntpd[17211]: Listening on routing socket on fd #22 for interface updates 2024-04-25T12:17:58.774 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:17:58 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:58.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:17:58 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:58.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:17:58 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:58.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:17:58 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:58.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:17:58 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:58.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:17:58 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:58.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:17:58 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:17:58.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:17:58 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:17:58.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:17:58 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:58.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:17:58 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:58.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:17:58 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:17:58.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:17:58 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:17:58.805 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:17:58 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:58.805 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:17:58 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:58.805 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:17:58 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:58.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:17:58 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:58.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:17:58 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:17:58.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:17:58 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:17:58.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:17:58 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:17:58.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:17:58 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:18:00.774 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:00 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:00.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:00 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:00.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:00 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:00.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:00 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:00.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:00 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:00.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:00 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:00.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:00 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:18:00.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:00 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:18:00.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:00 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:00.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:00 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:00.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:00 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:18:00.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:00 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:18:00.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:00 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:00.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:00 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:00.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:00 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:00.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:00 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:00.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:00 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:00.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:00 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:00.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:00 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:18:00.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:00 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:18:00.807 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:00 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:00.807 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:00 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:00.807 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:00 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:18:00.807 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:00 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:18:01.774 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:01 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:01.774 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:01 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:01.774 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:01 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:01.774 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:01 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:01.774 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:01 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:18:01.774 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:01 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:18:01.805 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:01 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:01.805 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:01 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:01.805 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:01 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:01.805 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:01 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:01.805 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:01 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:18:01.805 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:01 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:18:02.774 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:02 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:02.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:02 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:02.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:02 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:02.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:02 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:02.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:02 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:02.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:02 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:02.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:02 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:02.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:02 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:02.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:02 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:18:02.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:02 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:18:02.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:02 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:02.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:02 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:02.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:02 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:18:02.776 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:02 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:18:02.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:02 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:02.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:02 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:02.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:02 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:02.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:02 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:02.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:02 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:02.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:02 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:02.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:02 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:18:02.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:02 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:18:02.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:02 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:02.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:02 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:02.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:02 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:18:02.807 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:02 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:18:03.774 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:03 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:03.774 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:03 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:03.774 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:03 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:03.774 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:03 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:03.774 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:03 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:18:03.774 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:03 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:18:03.805 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:03 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:03.805 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:03 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:03.805 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:03 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:03.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:03 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:03.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:03 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:18:03.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:03 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:18:04.774 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:04 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:04.774 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:04 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:04.774 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:04 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:04.774 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:04 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:04.774 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:04 ntpd[17207]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:04.774 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:04 ntpd[17207]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:04.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:04 ntpd[17207]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:18:04.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:04 ntpd[17207]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:18:04.775 INFO:teuthology.orchestra.run.smithi094.stdout:25 Apr 12:18:04 ntpd[17207]: ntpd: time slew -0.000141 s 2024-04-25T12:18:04.775 INFO:teuthology.orchestra.run.smithi094.stdout:ntpd: time slew -0.000141s 2024-04-25T12:18:04.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:04 ntpd[17207]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T12:18:04.775 INFO:teuthology.orchestra.run.smithi094.stderr:25 Apr 12:18:04 ntpd[17207]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T12:18:04.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:04 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:04.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:04 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:04.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:04 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:04.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:04 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:04.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:04 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:04.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:04 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:04.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:04 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:18:04.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:04 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:18:04.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:04 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T12:18:04.806 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:04 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T12:18:04.807 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:04 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T12:18:04.807 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:04 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T12:18:04.807 INFO:teuthology.orchestra.run.smithi111.stdout:25 Apr 12:18:04 ntpd[17211]: ntpd: time slew -0.000234 s 2024-04-25T12:18:04.807 INFO:teuthology.orchestra.run.smithi111.stdout:ntpd: time slew -0.000234s 2024-04-25T12:18:04.807 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:04 ntpd[17211]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T12:18:04.807 INFO:teuthology.orchestra.run.smithi111.stderr:25 Apr 12:18:04 ntpd[17211]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T12:18:04.830 INFO:teuthology.orchestra.run.smithi094.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T12:18:04.830 INFO:teuthology.orchestra.run.smithi094.stdout:============================================================================== 2024-04-25T12:18:04.831 INFO:teuthology.orchestra.run.smithi094.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T12:18:04.831 INFO:teuthology.orchestra.run.smithi094.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T12:18:04.831 INFO:teuthology.orchestra.run.smithi094.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T12:18:04.831 INFO:teuthology.orchestra.run.smithi094.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T12:18:04.856 INFO:teuthology.orchestra.run.smithi111.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T12:18:04.857 INFO:teuthology.orchestra.run.smithi111.stdout:============================================================================== 2024-04-25T12:18:04.857 INFO:teuthology.orchestra.run.smithi111.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T12:18:04.857 INFO:teuthology.orchestra.run.smithi111.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T12:18:04.857 INFO:teuthology.orchestra.run.smithi111.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T12:18:04.857 INFO:teuthology.orchestra.run.smithi111.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T12:18:04.857 INFO:teuthology.run_tasks:Running task install... 2024-04-25T12:18:04.867 DEBUG:teuthology.task.install:project ceph 2024-04-25T12:18:04.867 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}} 2024-04-25T12:18:04.867 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'} 2024-04-25T12:18:04.867 INFO:teuthology.task.install:Using flavor: default 2024-04-25T12:18:04.873 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T12:18:04.873 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T12:18:04.874 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-key list | grep Ceph 2024-04-25T12:18:04.874 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-key list | grep Ceph 2024-04-25T12:18:04.930 INFO:teuthology.orchestra.run.smithi094.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T12:18:04.955 INFO:teuthology.orchestra.run.smithi111.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T12:18:04.958 INFO:teuthology.orchestra.run.smithi094.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T12:18:04.959 INFO:teuthology.orchestra.run.smithi094.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T12:18:04.960 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-25T12:18:04.960 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-25T12:18:04.960 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T12:18:04.982 INFO:teuthology.orchestra.run.smithi111.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T12:18:04.982 INFO:teuthology.orchestra.run.smithi111.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T12:18:04.982 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-25T12:18:04.982 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-25T12:18:04.983 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T12:18:05.126 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default/ 2024-04-25T12:18:05.127 INFO:teuthology.task.install.deb:Package version is 19.0.0-3156-gd69f13d8-1jammy 2024-04-25T12:18:05.172 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default/ 2024-04-25T12:18:05.173 INFO:teuthology.task.install.deb:Package version is 19.0.0-3156-gd69f13d8-1jammy 2024-04-25T12:18:05.234 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T12:18:05.235 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T12:18:05.247 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get update 2024-04-25T12:18:05.340 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:18:05.341 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T12:18:05.354 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get update 2024-04-25T12:18:05.413 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T12:18:05.530 INFO:teuthology.orchestra.run.smithi111.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T12:18:05.534 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T12:18:05.536 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T12:18:05.536 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T12:18:05.547 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T12:18:05.566 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T12:18:05.573 INFO:teuthology.orchestra.run.smithi094.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T12:18:05.594 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T12:18:05.604 INFO:teuthology.orchestra.run.smithi111.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T12:18:05.615 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T12:18:05.616 INFO:teuthology.orchestra.run.smithi094.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T12:18:05.637 INFO:teuthology.orchestra.run.smithi094.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2024-04-25T12:18:05.640 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2024-04-25T12:18:05.643 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T12:18:05.664 INFO:teuthology.orchestra.run.smithi094.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-04-25T12:18:05.684 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-04-25T12:18:05.697 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T12:18:05.845 INFO:teuthology.orchestra.run.smithi094.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-25T12:18:05.867 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 140 kB in 0s (316 kB/s) 2024-04-25T12:18:05.874 INFO:teuthology.orchestra.run.smithi094.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-25T12:18:05.881 INFO:teuthology.orchestra.run.smithi094.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-25T12:18:05.884 INFO:teuthology.orchestra.run.smithi094.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-25T12:18:05.971 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 426 kB in 0s (976 kB/s) 2024-04-25T12:18:06.821 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-04-25T12:18:06.838 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3156-gd69f13d8-1jammy cephadm=19.0.0-3156-gd69f13d8-1jammy ceph-mds=19.0.0-3156-gd69f13d8-1jammy ceph-mgr=19.0.0-3156-gd69f13d8-1jammy ceph-common=19.0.0-3156-gd69f13d8-1jammy ceph-fuse=19.0.0-3156-gd69f13d8-1jammy ceph-test=19.0.0-3156-gd69f13d8-1jammy ceph-volume=19.0.0-3156-gd69f13d8-1jammy radosgw=19.0.0-3156-gd69f13d8-1jammy python3-rados=19.0.0-3156-gd69f13d8-1jammy python3-rgw=19.0.0-3156-gd69f13d8-1jammy python3-cephfs=19.0.0-3156-gd69f13d8-1jammy python3-rbd=19.0.0-3156-gd69f13d8-1jammy libcephfs2=19.0.0-3156-gd69f13d8-1jammy libcephfs-dev=19.0.0-3156-gd69f13d8-1jammy librados2=19.0.0-3156-gd69f13d8-1jammy librbd1=19.0.0-3156-gd69f13d8-1jammy rbd-fuse=19.0.0-3156-gd69f13d8-1jammy python3-cephfs=19.0.0-3156-gd69f13d8-1jammy cephfs-shell=19.0.0-3156-gd69f13d8-1jammy cephfs-top=19.0.0-3156-gd69f13d8-1jammy cephfs-mirror=19.0.0-3156-gd69f13d8-1jammy 2024-04-25T12:18:06.890 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-04-25T12:18:06.967 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-04-25T12:18:06.983 DEBUG:teuthology.orchestra.run.smithi094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3156-gd69f13d8-1jammy cephadm=19.0.0-3156-gd69f13d8-1jammy ceph-mds=19.0.0-3156-gd69f13d8-1jammy ceph-mgr=19.0.0-3156-gd69f13d8-1jammy ceph-common=19.0.0-3156-gd69f13d8-1jammy ceph-fuse=19.0.0-3156-gd69f13d8-1jammy ceph-test=19.0.0-3156-gd69f13d8-1jammy ceph-volume=19.0.0-3156-gd69f13d8-1jammy radosgw=19.0.0-3156-gd69f13d8-1jammy python3-rados=19.0.0-3156-gd69f13d8-1jammy python3-rgw=19.0.0-3156-gd69f13d8-1jammy python3-cephfs=19.0.0-3156-gd69f13d8-1jammy python3-rbd=19.0.0-3156-gd69f13d8-1jammy libcephfs2=19.0.0-3156-gd69f13d8-1jammy libcephfs-dev=19.0.0-3156-gd69f13d8-1jammy librados2=19.0.0-3156-gd69f13d8-1jammy librbd1=19.0.0-3156-gd69f13d8-1jammy rbd-fuse=19.0.0-3156-gd69f13d8-1jammy python3-cephfs=19.0.0-3156-gd69f13d8-1jammy cephfs-shell=19.0.0-3156-gd69f13d8-1jammy cephfs-top=19.0.0-3156-gd69f13d8-1jammy cephfs-mirror=19.0.0-3156-gd69f13d8-1jammy 2024-04-25T12:18:07.035 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-04-25T12:18:07.066 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-04-25T12:18:07.067 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-04-25T12:18:07.211 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree... 2024-04-25T12:18:07.212 INFO:teuthology.orchestra.run.smithi094.stdout:Reading state information... 2024-04-25T12:18:07.239 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T12:18:07.239 INFO:teuthology.orchestra.run.smithi111.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T12:18:07.240 INFO:teuthology.orchestra.run.smithi111.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T12:18:07.240 INFO:teuthology.orchestra.run.smithi111.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T12:18:07.240 INFO:teuthology.orchestra.run.smithi111.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T12:18:07.241 INFO:teuthology.orchestra.run.smithi111.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T12:18:07.241 INFO:teuthology.orchestra.run.smithi111.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T12:18:07.241 INFO:teuthology.orchestra.run.smithi111.stdout:The following additional packages will be installed: 2024-04-25T12:18:07.241 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T12:18:07.241 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T12:18:07.241 INFO:teuthology.orchestra.run.smithi111.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T12:18:07.241 INFO:teuthology.orchestra.run.smithi111.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T12:18:07.242 INFO:teuthology.orchestra.run.smithi111.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T12:18:07.242 INFO:teuthology.orchestra.run.smithi111.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T12:18:07.242 INFO:teuthology.orchestra.run.smithi111.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T12:18:07.242 INFO:teuthology.orchestra.run.smithi111.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T12:18:07.242 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T12:18:07.242 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-25T12:18:07.243 INFO:teuthology.orchestra.run.smithi111.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-25T12:18:07.243 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-25T12:18:07.243 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-25T12:18:07.243 INFO:teuthology.orchestra.run.smithi111.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-25T12:18:07.243 INFO:teuthology.orchestra.run.smithi111.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-25T12:18:07.243 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-25T12:18:07.243 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-25T12:18:07.243 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-25T12:18:07.243 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-25T12:18:07.243 INFO:teuthology.orchestra.run.smithi111.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-25T12:18:07.243 INFO:teuthology.orchestra.run.smithi111.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-25T12:18:07.243 INFO:teuthology.orchestra.run.smithi111.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-25T12:18:07.243 INFO:teuthology.orchestra.run.smithi111.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-25T12:18:07.243 INFO:teuthology.orchestra.run.smithi111.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-25T12:18:07.244 INFO:teuthology.orchestra.run.smithi111.stdout:Suggested packages: 2024-04-25T12:18:07.244 INFO:teuthology.orchestra.run.smithi111.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T12:18:07.244 INFO:teuthology.orchestra.run.smithi111.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T12:18:07.244 INFO:teuthology.orchestra.run.smithi111.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T12:18:07.244 INFO:teuthology.orchestra.run.smithi111.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T12:18:07.244 INFO:teuthology.orchestra.run.smithi111.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T12:18:07.244 INFO:teuthology.orchestra.run.smithi111.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T12:18:07.244 INFO:teuthology.orchestra.run.smithi111.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T12:18:07.244 INFO:teuthology.orchestra.run.smithi111.stdout:Recommended packages: 2024-04-25T12:18:07.244 INFO:teuthology.orchestra.run.smithi111.stdout: btrfs-tools 2024-04-25T12:18:07.347 INFO:teuthology.orchestra.run.smithi111.stdout:The following NEW packages will be installed: 2024-04-25T12:18:07.347 INFO:teuthology.orchestra.run.smithi111.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T12:18:07.347 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T12:18:07.347 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-25T12:18:07.349 INFO:teuthology.orchestra.run.smithi111.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-25T12:18:07.349 INFO:teuthology.orchestra.run.smithi111.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T12:18:07.349 INFO:teuthology.orchestra.run.smithi111.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-25T12:18:07.349 INFO:teuthology.orchestra.run.smithi111.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-25T12:18:07.349 INFO:teuthology.orchestra.run.smithi111.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-25T12:18:07.349 INFO:teuthology.orchestra.run.smithi111.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-25T12:18:07.349 INFO:teuthology.orchestra.run.smithi111.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-25T12:18:07.349 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-25T12:18:07.349 INFO:teuthology.orchestra.run.smithi111.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-25T12:18:07.349 INFO:teuthology.orchestra.run.smithi111.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-25T12:18:07.349 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T12:18:07.349 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T12:18:07.350 INFO:teuthology.orchestra.run.smithi111.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T12:18:07.350 INFO:teuthology.orchestra.run.smithi111.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T12:18:07.350 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T12:18:07.350 INFO:teuthology.orchestra.run.smithi111.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T12:18:07.350 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-25T12:18:07.350 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-25T12:18:07.350 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-25T12:18:07.350 INFO:teuthology.orchestra.run.smithi111.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T12:18:07.350 INFO:teuthology.orchestra.run.smithi111.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T12:18:07.350 INFO:teuthology.orchestra.run.smithi111.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T12:18:07.350 INFO:teuthology.orchestra.run.smithi111.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T12:18:07.350 INFO:teuthology.orchestra.run.smithi111.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-25T12:18:07.350 INFO:teuthology.orchestra.run.smithi111.stdout: socat unzip xmlstarlet zip 2024-04-25T12:18:07.381 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T12:18:07.381 INFO:teuthology.orchestra.run.smithi094.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T12:18:07.381 INFO:teuthology.orchestra.run.smithi094.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T12:18:07.381 INFO:teuthology.orchestra.run.smithi094.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T12:18:07.382 INFO:teuthology.orchestra.run.smithi094.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T12:18:07.382 INFO:teuthology.orchestra.run.smithi094.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T12:18:07.382 INFO:teuthology.orchestra.run.smithi094.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T12:18:07.383 INFO:teuthology.orchestra.run.smithi094.stdout:The following additional packages will be installed: 2024-04-25T12:18:07.384 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T12:18:07.384 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T12:18:07.384 INFO:teuthology.orchestra.run.smithi094.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T12:18:07.384 INFO:teuthology.orchestra.run.smithi094.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T12:18:07.384 INFO:teuthology.orchestra.run.smithi094.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T12:18:07.384 INFO:teuthology.orchestra.run.smithi094.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T12:18:07.384 INFO:teuthology.orchestra.run.smithi094.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T12:18:07.384 INFO:teuthology.orchestra.run.smithi094.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T12:18:07.384 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T12:18:07.384 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-25T12:18:07.384 INFO:teuthology.orchestra.run.smithi094.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-25T12:18:07.384 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-25T12:18:07.384 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-25T12:18:07.385 INFO:teuthology.orchestra.run.smithi094.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-25T12:18:07.385 INFO:teuthology.orchestra.run.smithi094.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-25T12:18:07.385 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-25T12:18:07.385 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-25T12:18:07.385 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-25T12:18:07.385 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-25T12:18:07.385 INFO:teuthology.orchestra.run.smithi094.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-25T12:18:07.385 INFO:teuthology.orchestra.run.smithi094.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-25T12:18:07.385 INFO:teuthology.orchestra.run.smithi094.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-25T12:18:07.385 INFO:teuthology.orchestra.run.smithi094.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-25T12:18:07.385 INFO:teuthology.orchestra.run.smithi094.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-25T12:18:07.386 INFO:teuthology.orchestra.run.smithi094.stdout:Suggested packages: 2024-04-25T12:18:07.386 INFO:teuthology.orchestra.run.smithi094.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T12:18:07.386 INFO:teuthology.orchestra.run.smithi094.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T12:18:07.386 INFO:teuthology.orchestra.run.smithi094.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T12:18:07.386 INFO:teuthology.orchestra.run.smithi094.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T12:18:07.386 INFO:teuthology.orchestra.run.smithi094.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T12:18:07.386 INFO:teuthology.orchestra.run.smithi094.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T12:18:07.386 INFO:teuthology.orchestra.run.smithi094.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T12:18:07.386 INFO:teuthology.orchestra.run.smithi094.stdout:Recommended packages: 2024-04-25T12:18:07.386 INFO:teuthology.orchestra.run.smithi094.stdout: btrfs-tools 2024-04-25T12:18:07.490 INFO:teuthology.orchestra.run.smithi094.stdout:The following NEW packages will be installed: 2024-04-25T12:18:07.490 INFO:teuthology.orchestra.run.smithi094.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T12:18:07.490 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T12:18:07.490 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-25T12:18:07.490 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-25T12:18:07.490 INFO:teuthology.orchestra.run.smithi094.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T12:18:07.490 INFO:teuthology.orchestra.run.smithi094.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-25T12:18:07.490 INFO:teuthology.orchestra.run.smithi094.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-25T12:18:07.491 INFO:teuthology.orchestra.run.smithi094.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-25T12:18:07.491 INFO:teuthology.orchestra.run.smithi094.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-25T12:18:07.492 INFO:teuthology.orchestra.run.smithi094.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-25T12:18:07.492 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-25T12:18:07.492 INFO:teuthology.orchestra.run.smithi094.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-25T12:18:07.492 INFO:teuthology.orchestra.run.smithi094.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-25T12:18:07.492 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T12:18:07.492 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T12:18:07.492 INFO:teuthology.orchestra.run.smithi094.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T12:18:07.492 INFO:teuthology.orchestra.run.smithi094.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T12:18:07.492 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T12:18:07.492 INFO:teuthology.orchestra.run.smithi094.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T12:18:07.492 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-25T12:18:07.492 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-25T12:18:07.492 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-25T12:18:07.493 INFO:teuthology.orchestra.run.smithi094.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T12:18:07.493 INFO:teuthology.orchestra.run.smithi094.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T12:18:07.493 INFO:teuthology.orchestra.run.smithi094.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T12:18:07.493 INFO:teuthology.orchestra.run.smithi094.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T12:18:07.493 INFO:teuthology.orchestra.run.smithi094.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-25T12:18:07.493 INFO:teuthology.orchestra.run.smithi094.stdout: socat unzip xmlstarlet zip 2024-04-25T12:18:07.493 INFO:teuthology.orchestra.run.smithi111.stdout:0 upgraded, 124 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T12:18:07.493 INFO:teuthology.orchestra.run.smithi111.stdout:Need to get 182 MB of archives. 2024-04-25T12:18:07.493 INFO:teuthology.orchestra.run.smithi111.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-25T12:18:07.493 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3156-gd69f13d8-1jammy [3,555 kB] 2024-04-25T12:18:07.539 INFO:teuthology.orchestra.run.smithi111.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-25T12:18:07.558 INFO:teuthology.orchestra.run.smithi094.stdout:0 upgraded, 124 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T12:18:07.558 INFO:teuthology.orchestra.run.smithi094.stdout:Need to get 182 MB of archives. 2024-04-25T12:18:07.558 INFO:teuthology.orchestra.run.smithi094.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-25T12:18:07.558 INFO:teuthology.orchestra.run.smithi094.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-25T12:18:07.579 INFO:teuthology.orchestra.run.smithi094.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T12:18:07.591 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-25T12:18:07.622 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T12:18:07.634 INFO:teuthology.orchestra.run.smithi094.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3156-gd69f13d8-1jammy [3,555 kB] 2024-04-25T12:18:07.640 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T12:18:07.666 INFO:teuthology.orchestra.run.smithi094.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T12:18:07.667 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-25T12:18:07.669 INFO:teuthology.orchestra.run.smithi094.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T12:18:07.683 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T12:18:07.738 INFO:teuthology.orchestra.run.smithi094.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T12:18:07.746 INFO:teuthology.orchestra.run.smithi094.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T12:18:07.750 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3156-gd69f13d8-1jammy [3,224 kB] 2024-04-25T12:18:07.755 INFO:teuthology.orchestra.run.smithi094.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T12:18:07.760 INFO:teuthology.orchestra.run.smithi094.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T12:18:07.760 INFO:teuthology.orchestra.run.smithi094.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T12:18:07.769 INFO:teuthology.orchestra.run.smithi094.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T12:18:07.771 INFO:teuthology.orchestra.run.smithi094.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T12:18:07.773 INFO:teuthology.orchestra.run.smithi094.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T12:18:07.775 INFO:teuthology.orchestra.run.smithi094.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T12:18:07.775 INFO:teuthology.orchestra.run.smithi094.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T12:18:07.785 INFO:teuthology.orchestra.run.smithi094.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T12:18:07.913 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T12:18:07.916 INFO:teuthology.orchestra.run.smithi094.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T12:18:07.916 INFO:teuthology.orchestra.run.smithi094.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T12:18:07.916 INFO:teuthology.orchestra.run.smithi094.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T12:18:07.916 INFO:teuthology.orchestra.run.smithi094.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T12:18:07.916 INFO:teuthology.orchestra.run.smithi094.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T12:18:07.916 INFO:teuthology.orchestra.run.smithi094.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T12:18:07.916 INFO:teuthology.orchestra.run.smithi094.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T12:18:07.917 INFO:teuthology.orchestra.run.smithi094.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T12:18:07.917 INFO:teuthology.orchestra.run.smithi094.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T12:18:07.917 INFO:teuthology.orchestra.run.smithi094.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T12:18:07.917 INFO:teuthology.orchestra.run.smithi094.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T12:18:07.917 INFO:teuthology.orchestra.run.smithi094.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T12:18:07.917 INFO:teuthology.orchestra.run.smithi094.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T12:18:07.917 INFO:teuthology.orchestra.run.smithi094.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T12:18:07.917 INFO:teuthology.orchestra.run.smithi094.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T12:18:07.917 INFO:teuthology.orchestra.run.smithi094.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T12:18:07.917 INFO:teuthology.orchestra.run.smithi094.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T12:18:07.917 INFO:teuthology.orchestra.run.smithi094.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T12:18:07.917 INFO:teuthology.orchestra.run.smithi094.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T12:18:07.917 INFO:teuthology.orchestra.run.smithi094.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T12:18:07.917 INFO:teuthology.orchestra.run.smithi094.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T12:18:07.918 INFO:teuthology.orchestra.run.smithi094.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T12:18:07.918 INFO:teuthology.orchestra.run.smithi094.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T12:18:07.918 INFO:teuthology.orchestra.run.smithi094.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T12:18:07.918 INFO:teuthology.orchestra.run.smithi094.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T12:18:07.918 INFO:teuthology.orchestra.run.smithi094.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T12:18:07.918 INFO:teuthology.orchestra.run.smithi094.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T12:18:07.918 INFO:teuthology.orchestra.run.smithi094.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T12:18:07.918 INFO:teuthology.orchestra.run.smithi094.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T12:18:07.918 INFO:teuthology.orchestra.run.smithi094.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T12:18:07.918 INFO:teuthology.orchestra.run.smithi094.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T12:18:07.918 INFO:teuthology.orchestra.run.smithi094.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T12:18:07.918 INFO:teuthology.orchestra.run.smithi094.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T12:18:07.926 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3156-gd69f13d8-1jammy [712 kB] 2024-04-25T12:18:07.930 INFO:teuthology.orchestra.run.smithi094.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T12:18:07.938 INFO:teuthology.orchestra.run.smithi094.stdout:Get:54 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3156-gd69f13d8-1jammy [3,224 kB] 2024-04-25T12:18:07.964 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T12:18:07.966 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3156-gd69f13d8-1jammy [356 kB] 2024-04-25T12:18:07.978 INFO:teuthology.orchestra.run.smithi111.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T12:18:07.978 INFO:teuthology.orchestra.run.smithi111.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3156-gd69f13d8-1jammy [32.8 kB] 2024-04-25T12:18:07.979 INFO:teuthology.orchestra.run.smithi111.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3156-gd69f13d8-1jammy [180 kB] 2024-04-25T12:18:07.995 INFO:teuthology.orchestra.run.smithi094.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T12:18:07.996 INFO:teuthology.orchestra.run.smithi094.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T12:18:07.997 INFO:teuthology.orchestra.run.smithi094.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T12:18:07.998 INFO:teuthology.orchestra.run.smithi094.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T12:18:07.999 INFO:teuthology.orchestra.run.smithi094.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T12:18:08.004 INFO:teuthology.orchestra.run.smithi111.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3156-gd69f13d8-1jammy [66.9 kB] 2024-04-25T12:18:08.006 INFO:teuthology.orchestra.run.smithi111.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3156-gd69f13d8-1jammy [330 kB] 2024-04-25T12:18:08.017 INFO:teuthology.orchestra.run.smithi111.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3156-gd69f13d8-1jammy [6,894 kB] 2024-04-25T12:18:08.020 INFO:teuthology.orchestra.run.smithi094.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T12:18:08.022 INFO:teuthology.orchestra.run.smithi094.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T12:18:08.022 INFO:teuthology.orchestra.run.smithi094.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T12:18:08.030 INFO:teuthology.orchestra.run.smithi111.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T12:18:08.048 INFO:teuthology.orchestra.run.smithi094.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T12:18:08.048 INFO:teuthology.orchestra.run.smithi094.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T12:18:08.057 INFO:teuthology.orchestra.run.smithi094.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T12:18:08.057 INFO:teuthology.orchestra.run.smithi094.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T12:18:08.058 INFO:teuthology.orchestra.run.smithi094.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T12:18:08.058 INFO:teuthology.orchestra.run.smithi094.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T12:18:08.059 INFO:teuthology.orchestra.run.smithi094.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T12:18:08.059 INFO:teuthology.orchestra.run.smithi094.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T12:18:08.062 INFO:teuthology.orchestra.run.smithi094.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T12:18:08.078 INFO:teuthology.orchestra.run.smithi094.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T12:18:08.080 INFO:teuthology.orchestra.run.smithi094.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T12:18:08.080 INFO:teuthology.orchestra.run.smithi094.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T12:18:08.101 INFO:teuthology.orchestra.run.smithi094.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T12:18:08.104 INFO:teuthology.orchestra.run.smithi094.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-25T12:18:08.104 INFO:teuthology.orchestra.run.smithi094.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T12:18:08.105 INFO:teuthology.orchestra.run.smithi094.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T12:18:08.105 INFO:teuthology.orchestra.run.smithi094.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T12:18:08.110 INFO:teuthology.orchestra.run.smithi094.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T12:18:08.110 INFO:teuthology.orchestra.run.smithi094.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T12:18:08.122 INFO:teuthology.orchestra.run.smithi094.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T12:18:08.122 INFO:teuthology.orchestra.run.smithi094.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T12:18:08.123 INFO:teuthology.orchestra.run.smithi094.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T12:18:08.143 INFO:teuthology.orchestra.run.smithi094.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T12:18:08.145 INFO:teuthology.orchestra.run.smithi094.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T12:18:08.146 INFO:teuthology.orchestra.run.smithi094.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T12:18:08.155 INFO:teuthology.orchestra.run.smithi094.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T12:18:08.155 INFO:teuthology.orchestra.run.smithi094.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T12:18:08.156 INFO:teuthology.orchestra.run.smithi094.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T12:18:08.159 INFO:teuthology.orchestra.run.smithi094.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T12:18:08.169 INFO:teuthology.orchestra.run.smithi094.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T12:18:08.173 INFO:teuthology.orchestra.run.smithi094.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3156-gd69f13d8-1jammy [712 kB] 2024-04-25T12:18:08.206 INFO:teuthology.orchestra.run.smithi111.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T12:18:08.214 INFO:teuthology.orchestra.run.smithi111.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T12:18:08.225 INFO:teuthology.orchestra.run.smithi094.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3156-gd69f13d8-1jammy [356 kB] 2024-04-25T12:18:08.236 INFO:teuthology.orchestra.run.smithi094.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3156-gd69f13d8-1jammy [32.8 kB] 2024-04-25T12:18:08.238 INFO:teuthology.orchestra.run.smithi094.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3156-gd69f13d8-1jammy [180 kB] 2024-04-25T12:18:08.240 INFO:teuthology.orchestra.run.smithi111.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T12:18:08.250 INFO:teuthology.orchestra.run.smithi111.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T12:18:08.274 INFO:teuthology.orchestra.run.smithi094.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3156-gd69f13d8-1jammy [66.9 kB] 2024-04-25T12:18:08.276 INFO:teuthology.orchestra.run.smithi094.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3156-gd69f13d8-1jammy [330 kB] 2024-04-25T12:18:08.287 INFO:teuthology.orchestra.run.smithi094.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3156-gd69f13d8-1jammy [6,894 kB] 2024-04-25T12:18:08.416 INFO:teuthology.orchestra.run.smithi111.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T12:18:08.437 INFO:teuthology.orchestra.run.smithi111.stdout:Get:22 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3156-gd69f13d8-1jammy [112 kB] 2024-04-25T12:18:08.440 INFO:teuthology.orchestra.run.smithi111.stdout:Get:23 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3156-gd69f13d8-1jammy [466 kB] 2024-04-25T12:18:08.454 INFO:teuthology.orchestra.run.smithi111.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3156-gd69f13d8-1jammy [25.8 MB] 2024-04-25T12:18:08.791 INFO:teuthology.orchestra.run.smithi094.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3156-gd69f13d8-1jammy [112 kB] 2024-04-25T12:18:08.793 INFO:teuthology.orchestra.run.smithi094.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3156-gd69f13d8-1jammy [466 kB] 2024-04-25T12:18:08.840 INFO:teuthology.orchestra.run.smithi094.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3156-gd69f13d8-1jammy [25.8 MB] 2024-04-25T12:18:08.989 INFO:teuthology.orchestra.run.smithi111.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T12:18:09.003 INFO:teuthology.orchestra.run.smithi111.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T12:18:09.019 INFO:teuthology.orchestra.run.smithi111.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T12:18:09.028 INFO:teuthology.orchestra.run.smithi111.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T12:18:09.028 INFO:teuthology.orchestra.run.smithi111.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T12:18:09.044 INFO:teuthology.orchestra.run.smithi111.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T12:18:09.083 INFO:teuthology.orchestra.run.smithi111.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T12:18:09.096 INFO:teuthology.orchestra.run.smithi111.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T12:18:09.100 INFO:teuthology.orchestra.run.smithi111.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T12:18:09.100 INFO:teuthology.orchestra.run.smithi111.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T12:18:09.271 INFO:teuthology.orchestra.run.smithi111.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T12:18:09.354 INFO:teuthology.orchestra.run.smithi111.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T12:18:09.376 INFO:teuthology.orchestra.run.smithi111.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T12:18:09.436 INFO:teuthology.orchestra.run.smithi111.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T12:18:09.476 INFO:teuthology.orchestra.run.smithi111.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T12:18:09.498 INFO:teuthology.orchestra.run.smithi111.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T12:18:09.525 INFO:teuthology.orchestra.run.smithi111.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T12:18:09.706 INFO:teuthology.orchestra.run.smithi111.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T12:18:09.721 INFO:teuthology.orchestra.run.smithi111.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T12:18:09.729 INFO:teuthology.orchestra.run.smithi111.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T12:18:09.734 INFO:teuthology.orchestra.run.smithi111.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T12:18:09.918 INFO:teuthology.orchestra.run.smithi111.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T12:18:10.000 INFO:teuthology.orchestra.run.smithi111.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T12:18:10.015 INFO:teuthology.orchestra.run.smithi111.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T12:18:10.161 INFO:teuthology.orchestra.run.smithi111.stdout:Get:49 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3156-gd69f13d8-1jammy [5,094 kB] 2024-04-25T12:18:10.193 INFO:teuthology.orchestra.run.smithi111.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T12:18:10.238 INFO:teuthology.orchestra.run.smithi111.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T12:18:10.251 INFO:teuthology.orchestra.run.smithi111.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T12:18:10.352 INFO:teuthology.orchestra.run.smithi111.stdout:Get:53 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3156-gd69f13d8-1jammy [244 kB] 2024-04-25T12:18:10.359 INFO:teuthology.orchestra.run.smithi111.stdout:Get:54 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3156-gd69f13d8-1jammy [124 kB] 2024-04-25T12:18:10.363 INFO:teuthology.orchestra.run.smithi111.stdout:Get:55 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3156-gd69f13d8-1jammy [1,527 kB] 2024-04-25T12:18:10.413 INFO:teuthology.orchestra.run.smithi111.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T12:18:10.414 INFO:teuthology.orchestra.run.smithi111.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T12:18:10.419 INFO:teuthology.orchestra.run.smithi111.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T12:18:10.424 INFO:teuthology.orchestra.run.smithi111.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T12:18:10.438 INFO:teuthology.orchestra.run.smithi111.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T12:18:10.468 INFO:teuthology.orchestra.run.smithi111.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3156-gd69f13d8-1jammy [6,260 kB] 2024-04-25T12:18:10.622 INFO:teuthology.orchestra.run.smithi111.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T12:18:10.816 INFO:teuthology.orchestra.run.smithi094.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3156-gd69f13d8-1jammy [5,094 kB] 2024-04-25T12:18:10.835 INFO:teuthology.orchestra.run.smithi111.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3156-gd69f13d8-1jammy [22.8 MB] 2024-04-25T12:18:10.886 INFO:teuthology.orchestra.run.smithi111.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T12:18:11.002 INFO:teuthology.orchestra.run.smithi111.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T12:18:11.039 INFO:teuthology.orchestra.run.smithi094.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3156-gd69f13d8-1jammy [244 kB] 2024-04-25T12:18:11.044 INFO:teuthology.orchestra.run.smithi111.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T12:18:11.077 INFO:teuthology.orchestra.run.smithi094.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3156-gd69f13d8-1jammy [124 kB] 2024-04-25T12:18:11.081 INFO:teuthology.orchestra.run.smithi094.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3156-gd69f13d8-1jammy [1,527 kB] 2024-04-25T12:18:11.128 INFO:teuthology.orchestra.run.smithi111.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T12:18:11.140 INFO:teuthology.orchestra.run.smithi111.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T12:18:11.153 INFO:teuthology.orchestra.run.smithi111.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T12:18:11.180 INFO:teuthology.orchestra.run.smithi094.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3156-gd69f13d8-1jammy [6,260 kB] 2024-04-25T12:18:11.193 INFO:teuthology.orchestra.run.smithi111.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T12:18:11.459 INFO:teuthology.orchestra.run.smithi111.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T12:18:11.461 INFO:teuthology.orchestra.run.smithi111.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T12:18:11.464 INFO:teuthology.orchestra.run.smithi111.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T12:18:11.628 INFO:teuthology.orchestra.run.smithi111.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T12:18:11.630 INFO:teuthology.orchestra.run.smithi094.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3156-gd69f13d8-1jammy [22.8 MB] 2024-04-25T12:18:11.965 INFO:teuthology.orchestra.run.smithi111.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T12:18:12.293 INFO:teuthology.orchestra.run.smithi111.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3156-gd69f13d8-1jammy [14.0 kB] 2024-04-25T12:18:12.293 INFO:teuthology.orchestra.run.smithi111.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3156-gd69f13d8-1jammy [870 kB] 2024-04-25T12:18:12.311 INFO:teuthology.orchestra.run.smithi111.stdout:Get:78 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3156-gd69f13d8-1jammy [2,435 kB] 2024-04-25T12:18:12.360 INFO:teuthology.orchestra.run.smithi111.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T12:18:12.371 INFO:teuthology.orchestra.run.smithi111.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T12:18:12.372 INFO:teuthology.orchestra.run.smithi111.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T12:18:12.421 INFO:teuthology.orchestra.run.smithi111.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3156-gd69f13d8-1jammy [791 kB] 2024-04-25T12:18:12.440 INFO:teuthology.orchestra.run.smithi111.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T12:18:12.441 INFO:teuthology.orchestra.run.smithi111.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T12:18:12.443 INFO:teuthology.orchestra.run.smithi111.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T12:18:12.444 INFO:teuthology.orchestra.run.smithi111.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T12:18:12.445 INFO:teuthology.orchestra.run.smithi111.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T12:18:12.460 INFO:teuthology.orchestra.run.smithi111.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3156-gd69f13d8-1jammy [148 kB] 2024-04-25T12:18:12.465 INFO:teuthology.orchestra.run.smithi111.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3156-gd69f13d8-1jammy [2,324 kB] 2024-04-25T12:18:12.611 INFO:teuthology.orchestra.run.smithi111.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T12:18:12.619 INFO:teuthology.orchestra.run.smithi111.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3156-gd69f13d8-1jammy [8,625 kB] 2024-04-25T12:18:12.712 INFO:teuthology.orchestra.run.smithi111.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T12:18:12.803 INFO:teuthology.orchestra.run.smithi111.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T12:18:13.045 INFO:teuthology.orchestra.run.smithi111.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T12:18:13.088 INFO:teuthology.orchestra.run.smithi111.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T12:18:13.112 INFO:teuthology.orchestra.run.smithi111.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T12:18:13.121 INFO:teuthology.orchestra.run.smithi111.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T12:18:13.164 INFO:teuthology.orchestra.run.smithi111.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T12:18:13.189 INFO:teuthology.orchestra.run.smithi111.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-25T12:18:13.192 INFO:teuthology.orchestra.run.smithi111.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T12:18:13.199 INFO:teuthology.orchestra.run.smithi111.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T12:18:13.230 INFO:teuthology.orchestra.run.smithi111.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3156-gd69f13d8-1jammy [14.2 kB] 2024-04-25T12:18:13.231 INFO:teuthology.orchestra.run.smithi111.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3156-gd69f13d8-1jammy [51.6 MB] 2024-04-25T12:18:13.234 INFO:teuthology.orchestra.run.smithi094.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3156-gd69f13d8-1jammy [14.0 kB] 2024-04-25T12:18:13.235 INFO:teuthology.orchestra.run.smithi094.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3156-gd69f13d8-1jammy [870 kB] 2024-04-25T12:18:13.251 INFO:teuthology.orchestra.run.smithi094.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3156-gd69f13d8-1jammy [2,435 kB] 2024-04-25T12:18:13.360 INFO:teuthology.orchestra.run.smithi094.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3156-gd69f13d8-1jammy [791 kB] 2024-04-25T12:18:13.365 INFO:teuthology.orchestra.run.smithi111.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T12:18:13.392 INFO:teuthology.orchestra.run.smithi094.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3156-gd69f13d8-1jammy [148 kB] 2024-04-25T12:18:13.396 INFO:teuthology.orchestra.run.smithi094.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3156-gd69f13d8-1jammy [2,324 kB] 2024-04-25T12:18:13.537 INFO:teuthology.orchestra.run.smithi094.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3156-gd69f13d8-1jammy [8,625 kB] 2024-04-25T12:18:13.900 INFO:teuthology.orchestra.run.smithi111.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T12:18:13.906 INFO:teuthology.orchestra.run.smithi111.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T12:18:13.945 INFO:teuthology.orchestra.run.smithi111.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T12:18:13.946 INFO:teuthology.orchestra.run.smithi111.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T12:18:13.952 INFO:teuthology.orchestra.run.smithi111.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T12:18:13.954 INFO:teuthology.orchestra.run.smithi111.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T12:18:13.995 INFO:teuthology.orchestra.run.smithi111.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T12:18:14.004 INFO:teuthology.orchestra.run.smithi111.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T12:18:14.076 INFO:teuthology.orchestra.run.smithi111.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T12:18:14.077 INFO:teuthology.orchestra.run.smithi111.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T12:18:14.083 INFO:teuthology.orchestra.run.smithi094.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3156-gd69f13d8-1jammy [14.2 kB] 2024-04-25T12:18:14.083 INFO:teuthology.orchestra.run.smithi094.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3156-gd69f13d8-1jammy [51.6 MB] 2024-04-25T12:18:14.242 INFO:teuthology.orchestra.run.smithi111.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T12:18:14.674 INFO:teuthology.orchestra.run.smithi111.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T12:18:14.689 INFO:teuthology.orchestra.run.smithi111.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T12:18:17.091 INFO:teuthology.orchestra.run.smithi111.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3156-gd69f13d8-1jammy [124 kB] 2024-04-25T12:18:17.093 INFO:teuthology.orchestra.run.smithi111.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3156-gd69f13d8-1jammy [232 kB] 2024-04-25T12:18:17.098 INFO:teuthology.orchestra.run.smithi111.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3156-gd69f13d8-1jammy [33.9 kB] 2024-04-25T12:18:17.099 INFO:teuthology.orchestra.run.smithi111.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3156-gd69f13d8-1jammy [23.4 kB] 2024-04-25T12:18:17.100 INFO:teuthology.orchestra.run.smithi111.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3156-gd69f13d8-1jammy [38.9 kB] 2024-04-25T12:18:17.101 INFO:teuthology.orchestra.run.smithi111.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3156-gd69f13d8-1jammy [13.6 MB] 2024-04-25T12:18:17.562 INFO:teuthology.orchestra.run.smithi094.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3156-gd69f13d8-1jammy [124 kB] 2024-04-25T12:18:17.566 INFO:teuthology.orchestra.run.smithi094.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3156-gd69f13d8-1jammy [232 kB] 2024-04-25T12:18:17.570 INFO:teuthology.orchestra.run.smithi094.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3156-gd69f13d8-1jammy [33.9 kB] 2024-04-25T12:18:17.571 INFO:teuthology.orchestra.run.smithi094.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3156-gd69f13d8-1jammy [23.4 kB] 2024-04-25T12:18:17.572 INFO:teuthology.orchestra.run.smithi094.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3156-gd69f13d8-1jammy [38.9 kB] 2024-04-25T12:18:17.573 INFO:teuthology.orchestra.run.smithi094.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3156-gd69f13d8-1jammy [13.6 MB] 2024-04-25T12:18:17.747 INFO:teuthology.orchestra.run.smithi111.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3156-gd69f13d8-1jammy [91.6 kB] 2024-04-25T12:18:18.005 INFO:teuthology.orchestra.run.smithi094.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3156-gd69f13d8-1jammy [91.6 kB] 2024-04-25T12:18:18.437 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 182 MB in 10s (17.4 MB/s) 2024-04-25T12:18:18.547 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-25T12:18:18.637 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T12:18:18.642 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-25T12:18:18.671 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-25T12:18:18.695 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 182 MB in 11s (17.1 MB/s) 2024-04-25T12:18:18.835 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-25T12:18:18.932 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T12:18:18.937 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-25T12:18:18.940 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T12:18:18.967 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T12:18:18.984 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-25T12:18:19.007 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T12:18:19.220 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T12:18:19.246 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T12:18:19.303 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T12:18:19.334 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cmd2. 2024-04-25T12:18:19.361 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-25T12:18:19.401 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-25T12:18:19.605 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cmd2. 2024-04-25T12:18:19.631 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-25T12:18:19.672 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-25T12:18:19.787 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T12:18:19.814 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T12:18:19.888 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T12:18:20.025 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T12:18:20.051 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T12:18:20.133 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T12:18:20.191 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T12:18:20.217 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T12:18:20.249 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T12:18:20.478 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T12:18:20.504 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T12:18:20.545 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T12:18:20.560 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T12:18:20.586 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T12:18:20.627 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T12:18:20.864 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T12:18:20.890 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T12:18:20.931 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T12:18:21.289 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T12:18:21.315 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T12:18:21.364 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T12:18:21.585 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T12:18:21.611 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T12:18:21.651 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T12:18:21.750 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T12:18:21.777 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T12:18:21.817 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T12:18:22.071 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T12:18:22.097 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T12:18:22.137 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T12:18:22.145 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T12:18:22.172 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T12:18:22.212 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T12:18:22.499 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T12:18:22.525 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T12:18:22.539 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T12:18:22.559 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T12:18:22.565 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T12:18:22.606 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T12:18:22.884 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librados2. 2024-04-25T12:18:22.887 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T12:18:22.899 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../010-librados2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:22.913 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T12:18:22.934 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librados2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:22.954 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T12:18:23.290 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package librados2. 2024-04-25T12:18:23.316 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../010-librados2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:23.357 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librados2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:23.387 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librbd1. 2024-04-25T12:18:23.413 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../011-librbd1_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:23.453 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librbd1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:23.793 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package librbd1. 2024-04-25T12:18:23.819 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../011-librbd1_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:23.860 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librbd1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:23.889 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T12:18:23.915 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:23.956 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libcephfs2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:24.242 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rados. 2024-04-25T12:18:24.268 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:24.271 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T12:18:24.297 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:24.308 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rados (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:24.338 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libcephfs2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:24.569 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T12:18:24.582 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:24.611 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-ceph-argparse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:24.624 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-rados. 2024-04-25T12:18:24.650 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:24.690 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-rados (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:24.880 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T12:18:24.906 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:24.947 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cephfs (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:25.010 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T12:18:25.036 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:25.077 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-ceph-argparse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:25.258 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T12:18:25.284 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:25.324 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:25.337 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T12:18:25.353 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:25.388 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cephfs (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:25.636 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T12:18:25.662 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T12:18:25.699 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T12:18:25.702 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T12:18:25.725 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:25.765 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:25.947 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T12:18:25.962 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:25.997 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rbd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:26.077 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T12:18:26.103 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T12:18:26.160 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T12:18:26.483 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T12:18:26.509 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T12:18:26.549 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T12:18:26.564 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T12:18:26.590 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:26.630 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-rbd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:26.835 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T12:18:26.862 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T12:18:26.902 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T12:18:26.983 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T12:18:27.009 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T12:18:27.050 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T12:18:27.197 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T12:18:27.223 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T12:18:27.263 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T12:18:27.303 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T12:18:27.329 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T12:18:27.370 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T12:18:27.583 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua5.1. 2024-04-25T12:18:27.609 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T12:18:27.649 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T12:18:27.672 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T12:18:27.699 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T12:18:27.739 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T12:18:27.961 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua-any. 2024-04-25T12:18:27.987 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-25T12:18:28.027 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T12:18:28.059 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package lua5.1. 2024-04-25T12:18:28.085 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T12:18:28.125 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T12:18:28.263 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package zip. 2024-04-25T12:18:28.290 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-25T12:18:28.330 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T12:18:28.404 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package lua-any. 2024-04-25T12:18:28.419 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-25T12:18:28.454 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T12:18:28.625 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package unzip. 2024-04-25T12:18:28.651 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T12:18:28.714 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package zip. 2024-04-25T12:18:28.724 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T12:18:28.741 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-25T12:18:28.782 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T12:18:29.111 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package luarocks. 2024-04-25T12:18:29.119 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package unzip. 2024-04-25T12:18:29.138 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T12:18:29.145 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T12:18:29.185 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T12:18:29.186 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T12:18:29.536 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librgw2. 2024-04-25T12:18:29.547 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package luarocks. 2024-04-25T12:18:29.551 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../027-librgw2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:29.574 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T12:18:29.585 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librgw2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:29.606 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T12:18:29.997 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package librgw2. 2024-04-25T12:18:30.024 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../027-librgw2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:30.064 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librgw2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:30.088 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T12:18:30.115 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:30.155 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:30.499 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T12:18:30.525 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T12:18:30.566 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T12:18:30.608 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T12:18:30.623 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:30.666 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-rgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:30.860 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T12:18:30.887 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:30.918 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libradosstriper1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:31.061 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T12:18:31.088 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T12:18:31.136 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T12:18:31.472 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-common. 2024-04-25T12:18:31.498 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:31.506 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T12:18:31.534 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:31.538 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:31.681 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libradosstriper1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:32.101 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-common. 2024-04-25T12:18:32.128 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:32.168 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:32.944 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-base. 2024-04-25T12:18:32.970 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:33.019 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-base (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:33.589 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T12:18:33.616 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T12:18:33.632 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-base. 2024-04-25T12:18:33.656 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T12:18:33.658 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:33.716 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-base (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:33.925 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T12:18:33.951 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T12:18:33.983 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T12:18:34.270 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T12:18:34.296 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T12:18:34.336 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T12:18:34.337 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T12:18:34.363 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T12:18:34.411 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T12:18:34.639 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T12:18:34.665 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T12:18:34.705 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T12:18:34.723 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T12:18:34.749 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T12:18:34.789 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T12:18:34.991 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T12:18:35.018 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T12:18:35.058 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T12:18:35.118 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T12:18:35.144 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T12:18:35.184 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T12:18:35.319 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T12:18:35.345 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T12:18:35.377 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T12:18:35.563 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T12:18:35.589 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T12:18:35.646 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T12:18:35.680 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-portend. 2024-04-25T12:18:35.707 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-25T12:18:35.747 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T12:18:35.991 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T12:18:36.017 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T12:18:36.050 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T12:18:36.057 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T12:18:36.065 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T12:18:36.108 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T12:18:36.335 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T12:18:36.362 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T12:18:36.394 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T12:18:36.436 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T12:18:36.462 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T12:18:36.502 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T12:18:36.697 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-portend. 2024-04-25T12:18:36.724 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-25T12:18:36.763 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T12:18:36.839 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T12:18:36.865 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T12:18:36.905 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T12:18:37.066 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T12:18:37.093 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T12:18:37.133 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T12:18:37.217 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T12:18:37.243 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T12:18:37.283 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T12:18:37.428 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T12:18:37.454 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T12:18:37.494 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T12:18:37.586 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T12:18:37.613 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T12:18:37.653 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T12:18:37.823 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T12:18:37.850 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T12:18:37.890 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T12:18:37.931 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-mako. 2024-04-25T12:18:37.957 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T12:18:37.989 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T12:18:38.201 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T12:18:38.227 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T12:18:38.268 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T12:18:38.301 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T12:18:38.327 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T12:18:38.367 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T12:18:38.579 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T12:18:38.606 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T12:18:38.645 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T12:18:38.646 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T12:18:38.671 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T12:18:38.711 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T12:18:38.916 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-mako. 2024-04-25T12:18:38.942 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T12:18:38.974 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T12:18:39.006 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-webob. 2024-04-25T12:18:39.032 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T12:18:39.072 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T12:18:39.261 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T12:18:39.288 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T12:18:39.319 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T12:18:39.417 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T12:18:39.443 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T12:18:39.486 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T12:18:39.622 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T12:18:39.649 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T12:18:39.688 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T12:18:39.795 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T12:18:39.821 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T12:18:39.861 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T12:18:39.992 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-webob. 2024-04-25T12:18:40.018 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T12:18:40.058 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T12:18:40.173 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-paste. 2024-04-25T12:18:40.199 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T12:18:40.256 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T12:18:40.378 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T12:18:40.393 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T12:18:40.442 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T12:18:40.567 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T12:18:40.582 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T12:18:40.625 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T12:18:40.965 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T12:18:40.992 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T12:18:41.398 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T12:18:41.862 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T12:18:41.889 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T12:18:41.928 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T12:18:42.210 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-paste. 2024-04-25T12:18:42.215 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T12:18:42.237 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T12:18:42.242 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T12:18:42.273 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T12:18:42.277 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T12:18:42.543 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T12:18:42.569 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T12:18:42.609 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T12:18:42.614 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T12:18:42.640 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T12:18:42.672 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T12:18:42.917 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T12:18:42.932 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T12:18:42.958 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T12:18:42.975 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T12:18:42.984 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T12:18:43.024 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T12:18:43.327 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-idna. 2024-04-25T12:18:43.328 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T12:18:43.354 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-25T12:18:43.355 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T12:18:43.394 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T12:18:43.395 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T12:18:43.672 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T12:18:43.687 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T12:18:43.706 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T12:18:43.721 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T12:18:43.733 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T12:18:43.773 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T12:18:44.008 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-requests. 2024-04-25T12:18:44.035 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T12:18:44.083 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T12:18:44.119 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T12:18:44.146 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T12:18:44.186 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T12:18:44.386 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T12:18:44.412 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T12:18:44.452 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T12:18:44.531 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-idna. 2024-04-25T12:18:44.557 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-25T12:18:44.597 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T12:18:44.697 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T12:18:44.713 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:44.747 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:44.900 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T12:18:44.916 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T12:18:44.950 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T12:18:45.094 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T12:18:45.121 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:45.160 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:45.279 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-requests. 2024-04-25T12:18:45.305 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T12:18:45.345 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T12:18:45.430 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T12:18:45.457 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T12:18:45.488 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T12:18:45.665 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T12:18:45.691 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T12:18:45.731 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T12:18:45.791 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T12:18:45.818 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T12:18:45.858 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T12:18:46.026 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T12:18:46.042 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:46.085 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:46.186 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T12:18:46.213 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:46.252 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:46.424 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T12:18:46.450 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:46.490 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:46.630 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T12:18:46.658 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:46.697 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mon (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:46.834 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T12:18:46.861 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T12:18:46.901 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T12:18:47.204 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T12:18:47.231 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T12:18:47.271 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T12:18:47.301 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T12:18:47.327 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:47.367 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-osd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:47.574 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T12:18:47.600 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:47.632 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:48.019 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T12:18:48.045 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:48.085 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mon (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:48.396 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph. 2024-04-25T12:18:48.422 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../068-ceph_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:48.462 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:48.698 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T12:18:48.724 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:48.764 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-osd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:48.781 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T12:18:48.808 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:48.848 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:49.218 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T12:18:49.244 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:49.284 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mds (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:49.654 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package cephadm. 2024-04-25T12:18:49.681 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../071-cephadm_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:49.712 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:49.792 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph. 2024-04-25T12:18:49.808 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../068-ceph_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:49.842 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:50.023 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T12:18:50.050 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T12:18:50.098 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T12:18:50.145 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T12:18:50.172 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:50.237 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:50.376 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T12:18:50.403 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T12:18:50.442 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T12:18:50.607 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T12:18:50.633 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:50.673 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mds (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:51.051 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package cephadm. 2024-04-25T12:18:51.078 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../071-cephadm_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:18:51.117 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:51.413 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T12:18:51.431 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-babel. 2024-04-25T12:18:51.439 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T12:18:51.458 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T12:18:51.479 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T12:18:51.497 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T12:18:51.824 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T12:18:51.834 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T12:18:51.850 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T12:18:51.860 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T12:18:51.882 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T12:18:51.900 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T12:18:52.445 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T12:18:52.472 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:52.503 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:52.831 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T12:18:52.858 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T12:18:52.889 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T12:18:53.087 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-babel. 2024-04-25T12:18:53.115 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T12:18:53.162 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T12:18:53.193 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-routes. 2024-04-25T12:18:53.220 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T12:18:53.259 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T12:18:53.499 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T12:18:53.526 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T12:18:53.565 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T12:18:53.570 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T12:18:53.598 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:53.637 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:53.927 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T12:18:53.953 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:53.993 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:54.347 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T12:18:54.374 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T12:18:54.413 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T12:18:54.691 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-routes. 2024-04-25T12:18:54.718 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T12:18:54.749 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T12:18:54.851 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T12:18:54.878 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T12:18:54.917 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T12:18:55.094 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T12:18:55.121 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:55.161 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:55.421 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T12:18:55.448 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T12:18:55.487 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T12:18:55.874 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T12:18:55.902 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T12:18:56.027 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T12:18:56.321 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T12:18:56.348 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T12:18:56.379 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T12:18:56.417 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T12:18:56.444 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T12:18:56.483 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T12:18:56.995 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T12:18:57.022 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T12:18:57.047 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T12:18:57.061 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T12:18:57.075 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:57.105 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:57.416 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T12:18:57.442 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T12:18:57.559 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T12:18:57.871 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T12:18:57.898 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T12:18:57.937 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T12:18:58.067 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T12:18:58.094 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T12:18:58.133 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T12:18:58.420 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T12:18:58.447 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T12:18:58.486 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T12:18:58.639 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T12:18:58.667 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:18:58.697 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:18:58.826 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T12:18:58.850 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T12:18:58.889 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T12:18:59.201 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T12:18:59.228 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-25T12:18:59.267 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T12:18:59.579 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T12:18:59.607 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T12:18:59.646 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T12:18:59.650 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T12:18:59.678 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T12:18:59.716 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T12:18:59.941 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T12:18:59.968 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T12:18:59.999 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T12:19:00.020 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T12:19:00.047 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T12:19:00.086 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T12:19:00.311 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T12:19:00.338 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T12:19:00.377 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T12:19:00.432 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T12:19:00.462 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T12:19:00.498 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T12:19:00.689 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T12:19:00.716 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T12:19:00.755 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T12:19:00.759 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T12:19:00.776 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-25T12:19:00.809 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T12:19:01.132 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T12:19:01.159 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T12:19:01.198 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T12:19:01.411 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T12:19:01.427 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:19:01.469 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:01.519 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T12:19:01.546 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T12:19:01.585 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T12:19:01.780 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T12:19:01.807 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T12:19:01.847 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T12:19:01.897 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T12:19:01.924 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T12:19:01.963 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T12:19:02.133 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T12:19:02.149 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T12:19:02.183 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T12:19:02.442 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T12:19:02.469 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T12:19:02.508 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T12:19:02.853 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package jq. 2024-04-25T12:19:02.880 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T12:19:02.919 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T12:19:03.180 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package socat. 2024-04-25T12:19:03.196 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T12:19:03.263 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T12:19:03.456 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T12:19:03.472 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:19:03.514 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:03.575 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T12:19:03.591 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T12:19:03.633 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T12:19:03.859 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T12:19:03.886 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T12:19:03.925 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T12:19:03.979 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-test. 2024-04-25T12:19:03.995 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:19:04.037 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-test (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:04.270 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T12:19:04.298 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T12:19:04.337 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T12:19:04.623 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package jq. 2024-04-25T12:19:04.651 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T12:19:04.689 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T12:19:04.909 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package socat. 2024-04-25T12:19:04.925 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T12:19:04.959 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T12:19:05.246 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T12:19:05.273 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T12:19:05.312 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T12:19:05.659 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-test. 2024-04-25T12:19:05.686 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:19:05.725 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-test (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:06.277 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T12:19:06.303 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:19:06.342 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-volume (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:06.721 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-25T12:19:06.748 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:19:06.787 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking cephfs-mirror (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:07.057 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-colorama. 2024-04-25T12:19:07.084 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-25T12:19:07.123 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-25T12:19:07.385 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package cephfs-shell. 2024-04-25T12:19:07.412 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:19:07.451 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking cephfs-shell (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:07.712 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package cephfs-top. 2024-04-25T12:19:07.728 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:19:07.770 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking cephfs-top (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:07.996 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T12:19:08.023 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T12:19:08.024 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:19:08.038 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:19:08.063 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-volume (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:08.081 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libcephfs-dev (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:08.392 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T12:19:08.420 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T12:19:08.451 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T12:19:08.517 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-25T12:19:08.545 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:19:08.584 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking cephfs-mirror (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:08.730 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T12:19:08.757 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T12:19:08.796 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T12:19:08.904 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-colorama. 2024-04-25T12:19:08.931 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-25T12:19:08.970 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-25T12:19:09.168 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T12:19:09.195 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T12:19:09.214 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package cephfs-shell. 2024-04-25T12:19:09.230 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:19:09.234 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T12:19:09.264 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking cephfs-shell (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:09.534 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package cephfs-top. 2024-04-25T12:19:09.561 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-25T12:19:09.600 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking cephfs-top (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:09.639 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package pkg-config. 2024-04-25T12:19:09.666 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T12:19:09.705 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T12:19:09.844 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T12:19:09.861 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:19:09.894 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libcephfs-dev (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:09.950 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T12:19:09.978 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T12:19:10.008 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T12:19:10.181 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T12:19:10.208 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T12:19:10.247 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T12:19:10.395 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T12:19:10.411 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T12:19:10.445 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T12:19:10.569 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T12:19:10.596 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T12:19:10.635 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T12:19:10.773 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T12:19:10.800 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T12:19:10.839 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T12:19:11.006 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T12:19:11.033 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T12:19:11.072 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T12:19:11.201 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T12:19:11.228 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T12:19:11.267 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T12:19:11.504 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package pkg-config. 2024-04-25T12:19:11.531 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T12:19:11.570 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T12:19:11.579 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T12:19:11.606 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T12:19:11.645 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T12:19:11.831 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T12:19:11.847 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T12:19:11.881 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T12:19:11.973 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-py. 2024-04-25T12:19:12.001 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-25T12:19:12.039 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T12:19:12.301 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T12:19:12.329 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T12:19:12.352 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T12:19:12.367 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T12:19:12.379 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T12:19:12.418 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T12:19:12.646 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T12:19:12.674 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T12:19:12.712 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T12:19:12.872 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T12:19:12.900 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T12:19:12.938 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T12:19:13.032 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T12:19:13.060 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T12:19:13.099 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T12:19:13.200 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-toml. 2024-04-25T12:19:13.227 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-25T12:19:13.274 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T12:19:13.410 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T12:19:13.438 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T12:19:13.477 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T12:19:13.578 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T12:19:13.605 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T12:19:13.644 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T12:19:13.964 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T12:19:13.992 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T12:19:14.013 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-py. 2024-04-25T12:19:14.022 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T12:19:14.041 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-25T12:19:14.088 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T12:19:14.275 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T12:19:14.302 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T12:19:14.342 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T12:19:14.425 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T12:19:14.453 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T12:19:14.491 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T12:19:14.946 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T12:19:14.973 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T12:19:15.012 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T12:19:15.146 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package radosgw. 2024-04-25T12:19:15.173 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../122-radosgw_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:19:15.212 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking radosgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:15.273 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-toml. 2024-04-25T12:19:15.289 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-25T12:19:15.348 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T12:19:15.660 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T12:19:15.687 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T12:19:15.726 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T12:19:15.965 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T12:19:15.978 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:19:16.023 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking rbd-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:16.047 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T12:19:16.074 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T12:19:16.113 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T12:19:16.327 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T12:19:16.366 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T12:19:16.390 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T12:19:16.432 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T12:19:16.562 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T12:19:16.688 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T12:19:16.948 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T12:19:17.220 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package radosgw. 2024-04-25T12:19:17.248 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../122-radosgw_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:19:17.275 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T12:19:17.286 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking radosgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:17.697 INFO:teuthology.orchestra.run.smithi111.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T12:19:17.773 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:18.090 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T12:19:18.106 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-25T12:19:18.139 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking rbd-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:18.436 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T12:19:18.506 INFO:teuthology.orchestra.run.smithi111.stdout:Adding system user cephadm....done 2024-04-25T12:19:18.646 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T12:19:18.695 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T12:19:18.821 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T12:19:18.923 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T12:19:19.106 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T12:19:19.182 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T12:19:19.292 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T12:19:19.450 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T12:19:19.527 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T12:19:19.761 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T12:19:19.838 INFO:teuthology.orchestra.run.smithi094.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T12:19:19.887 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T12:19:19.957 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:20.189 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T12:19:20.557 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T12:19:20.800 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-25T12:19:20.822 INFO:teuthology.orchestra.run.smithi094.stdout:Adding system user cephadm....done 2024-04-25T12:19:21.043 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T12:19:21.073 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T12:19:21.328 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T12:19:21.407 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T12:19:21.638 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T12:19:21.667 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T12:19:21.794 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T12:19:21.889 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T12:19:22.070 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T12:19:22.140 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T12:19:22.329 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T12:19:22.439 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T12:19:22.516 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-ceph-argparse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:22.757 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T12:19:22.776 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T12:19:22.885 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T12:19:22.994 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-25T12:19:23.134 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T12:19:23.253 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T12:19:23.380 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T12:19:23.386 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-25T12:19:23.645 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T12:19:23.664 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T12:19:23.922 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T12:19:24.111 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T12:19:24.147 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T12:19:24.148 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T12:19:24.211 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T12:19:24.337 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T12:19:24.391 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T12:19:24.668 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T12:19:24.688 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T12:19:24.814 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T12:19:24.919 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-ceph-argparse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:25.074 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T12:19:25.186 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T12:19:25.304 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T12:19:25.333 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T12:19:25.405 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-25T12:19:25.635 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T12:19:25.673 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T12:19:25.769 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T12:19:25.782 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T12:19:26.034 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T12:19:26.450 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T12:19:26.454 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T12:19:26.482 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T12:19:26.546 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T12:19:26.647 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T12:19:26.713 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T12:19:26.840 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T12:19:26.966 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T12:19:26.998 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T12:19:27.116 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T12:19:27.258 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T12:19:27.384 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T12:19:27.618 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T12:19:27.660 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T12:19:27.877 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T12:19:27.961 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T12:19:28.087 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T12:19:28.254 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T12:19:28.547 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-25T12:19:28.790 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T12:19:29.032 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T12:19:29.081 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T12:19:29.184 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T12:19:29.310 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T12:19:29.433 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T12:19:29.611 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T12:19:29.668 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T12:19:29.777 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:29.996 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T12:19:30.078 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T12:19:30.222 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T12:19:30.421 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T12:19:30.574 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T12:19:30.867 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-25T12:19:31.168 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T12:19:31.520 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T12:19:31.627 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T12:19:31.762 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T12:19:31.864 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:31.878 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T12:19:32.013 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T12:19:32.148 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T12:19:32.281 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T12:19:32.407 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T12:19:32.458 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T12:19:32.516 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T12:19:32.809 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T12:19:33.077 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T12:19:33.328 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T12:19:33.454 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T12:19:33.639 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T12:19:33.756 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T12:19:33.891 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T12:19:34.026 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T12:19:34.123 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T12:19:34.302 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T12:19:34.383 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T12:19:34.428 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T12:19:34.554 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T12:19:34.609 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T12:19:34.830 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T12:19:34.860 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T12:19:35.065 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T12:19:35.120 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T12:19:35.246 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T12:19:35.308 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T12:19:35.443 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T12:19:35.521 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T12:19:35.648 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T12:19:35.736 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T12:19:35.957 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T12:19:35.996 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T12:19:36.250 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T12:19:36.263 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T12:19:36.484 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T12:19:36.498 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T12:19:36.627 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T12:19:36.724 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T12:19:36.753 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T12:19:36.843 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T12:19:37.016 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T12:19:37.088 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T12:19:37.151 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T12:19:37.214 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T12:19:37.444 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T12:19:37.570 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T12:19:37.607 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T12:19:37.850 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T12:19:37.855 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T12:19:37.960 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T12:19:38.148 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T12:19:38.210 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T12:19:38.337 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T12:19:38.399 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T12:19:38.525 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T12:19:38.651 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T12:19:38.663 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T12:19:38.741 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T12:19:38.964 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T12:19:38.978 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T12:19:39.104 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T12:19:39.240 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T12:19:39.427 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T12:19:39.472 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T12:19:39.695 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T12:19:39.724 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T12:19:39.850 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T12:19:39.962 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T12:19:40.101 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T12:19:40.222 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T12:19:40.227 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T12:19:40.546 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T12:19:40.591 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T12:19:40.838 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T12:19:40.867 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T12:19:41.081 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T12:19:41.186 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T12:19:41.268 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T12:19:41.312 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librados2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:41.439 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:41.536 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T12:19:41.565 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T12:19:41.812 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T12:19:41.876 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libcephfs2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:41.994 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libradosstriper1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:42.105 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T12:19:42.120 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T12:19:42.396 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librbd1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:42.457 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T12:19:42.523 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-modules-core (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:42.649 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:42.750 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T12:19:42.865 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T12:19:42.865 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T12:19:43.137 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T12:19:43.255 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librados2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:43.350 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libcephfs-dev (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:43.363 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:43.459 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rados (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:43.481 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T12:19:43.577 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librgw2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:43.703 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up cephfs-top (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:43.817 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libcephfs2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:43.829 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T12:19:43.944 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libradosstriper1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:44.095 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T12:19:44.371 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librbd1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:44.491 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-modules-core (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:45.016 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:45.041 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rbd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:45.142 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up rbd-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:45.228 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T12:19:45.228 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T12:19:45.243 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:45.377 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cephfs (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:45.529 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up cephfs-shell (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:45.654 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:45.700 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libcephfs-dev (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:45.828 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-rados (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:45.954 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librgw2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:46.055 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up cephfs-top (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:46.156 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T12:19:46.189 INFO:teuthology.orchestra.run.smithi111.stdout:Adding group ceph....done 2024-04-25T12:19:46.541 INFO:teuthology.orchestra.run.smithi111.stdout:Adding system user ceph....done 2024-04-25T12:19:46.709 INFO:teuthology.orchestra.run.smithi111.stdout:Setting system user ceph properties....done 2024-04-25T12:19:46.728 INFO:teuthology.orchestra.run.smithi111.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T12:19:46.866 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T12:19:47.216 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T12:19:47.368 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-rbd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:47.494 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up rbd-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:47.637 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-rgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:47.689 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up cephfs-mirror (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:47.754 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cephfs (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:47.864 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up cephfs-shell (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:47.913 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T12:19:47.914 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T12:19:47.981 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:48.500 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-test (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:48.524 INFO:teuthology.orchestra.run.smithi094.stdout:Adding group ceph....done 2024-04-25T12:19:48.601 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up radosgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:48.884 INFO:teuthology.orchestra.run.smithi094.stdout:Adding system user ceph....done 2024-04-25T12:19:49.044 INFO:teuthology.orchestra.run.smithi094.stdout:Setting system user ceph properties....done 2024-04-25T12:19:49.056 INFO:teuthology.orchestra.run.smithi094.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T12:19:49.064 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T12:19:49.065 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T12:19:49.190 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T12:19:49.491 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T12:19:49.627 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-base (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:49.957 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up cephfs-mirror (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:49.969 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T12:19:50.159 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T12:19:50.159 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T12:19:50.425 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mds (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:50.609 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-test (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:50.646 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T12:19:50.646 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T12:19:50.718 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up radosgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:51.069 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:51.136 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T12:19:51.136 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T12:19:51.283 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T12:19:51.283 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T12:19:51.629 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-base (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:51.728 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-osd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:51.973 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T12:19:52.004 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T12:19:52.005 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T12:19:52.405 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mds (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:52.505 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:52.620 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T12:19:52.620 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T12:19:52.631 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:52.782 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mon (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:52.998 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T12:19:52.998 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T12:19:53.073 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:53.287 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T12:19:53.287 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T12:19:53.558 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:53.675 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:53.733 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-osd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:53.810 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-dashboard (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:53.961 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-volume (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:54.012 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T12:19:54.013 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T12:19:54.349 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T12:19:54.466 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T12:19:54.476 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:54.602 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:54.610 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T12:19:54.770 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mon (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:54.982 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T12:19:54.982 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T12:19:55.422 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:55.557 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:55.682 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-dashboard (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:55.711 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T12:19:55.833 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-volume (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-25T12:19:56.186 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T12:19:56.286 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T12:19:56.367 INFO:teuthology.orchestra.run.smithi111.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T12:19:56.370 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-25T12:19:56.431 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T12:19:56.472 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-04-25T12:19:56.650 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-04-25T12:19:56.651 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-04-25T12:19:56.821 INFO:teuthology.orchestra.run.smithi111.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-25T12:19:56.821 INFO:teuthology.orchestra.run.smithi111.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T12:19:56.821 INFO:teuthology.orchestra.run.smithi111.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T12:19:56.821 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T12:19:56.821 INFO:teuthology.orchestra.run.smithi111.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T12:19:56.821 INFO:teuthology.orchestra.run.smithi111.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T12:19:56.821 INFO:teuthology.orchestra.run.smithi111.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T12:19:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T12:19:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T12:19:56.822 INFO:teuthology.orchestra.run.smithi111.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T12:19:56.823 INFO:teuthology.orchestra.run.smithi111.stdout:The following additional packages will be installed: 2024-04-25T12:19:56.823 INFO:teuthology.orchestra.run.smithi111.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-25T12:19:56.823 INFO:teuthology.orchestra.run.smithi111.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-25T12:19:56.823 INFO:teuthology.orchestra.run.smithi111.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-25T12:19:56.824 INFO:teuthology.orchestra.run.smithi111.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-25T12:19:56.824 INFO:teuthology.orchestra.run.smithi111.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T12:19:56.825 INFO:teuthology.orchestra.run.smithi111.stdout:Suggested packages: 2024-04-25T12:19:56.825 INFO:teuthology.orchestra.run.smithi111.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-25T12:19:56.825 INFO:teuthology.orchestra.run.smithi111.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-25T12:19:56.825 INFO:teuthology.orchestra.run.smithi111.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-25T12:19:56.863 INFO:teuthology.orchestra.run.smithi111.stdout:The following NEW packages will be installed: 2024-04-25T12:19:56.864 INFO:teuthology.orchestra.run.smithi111.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-25T12:19:56.864 INFO:teuthology.orchestra.run.smithi111.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-25T12:19:56.864 INFO:teuthology.orchestra.run.smithi111.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-25T12:19:56.864 INFO:teuthology.orchestra.run.smithi111.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-25T12:19:56.864 INFO:teuthology.orchestra.run.smithi111.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-25T12:19:56.865 INFO:teuthology.orchestra.run.smithi111.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-25T12:19:56.865 INFO:teuthology.orchestra.run.smithi111.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T12:19:56.866 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages will be upgraded: 2024-04-25T12:19:56.866 INFO:teuthology.orchestra.run.smithi111.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-25T12:19:57.045 INFO:teuthology.orchestra.run.smithi111.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-25T12:19:57.045 INFO:teuthology.orchestra.run.smithi111.stdout:Need to get 55.7 MB of archives. 2024-04-25T12:19:57.045 INFO:teuthology.orchestra.run.smithi111.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-25T12:19:57.045 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-25T12:19:57.422 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T12:19:57.670 INFO:teuthology.orchestra.run.smithi111.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T12:19:57.686 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T12:19:57.811 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T12:19:57.812 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T12:19:57.814 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T12:19:57.841 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-25T12:19:57.843 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-25T12:19:57.847 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-25T12:19:57.849 INFO:teuthology.orchestra.run.smithi111.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T12:19:57.850 INFO:teuthology.orchestra.run.smithi111.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-25T12:19:58.016 INFO:teuthology.orchestra.run.smithi111.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T12:19:58.056 INFO:teuthology.orchestra.run.smithi094.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T12:19:58.059 DEBUG:teuthology.orchestra.run.smithi094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-25T12:19:58.153 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-04-25T12:19:58.310 INFO:teuthology.orchestra.run.smithi111.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T12:19:58.319 INFO:teuthology.orchestra.run.smithi111.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T12:19:58.324 INFO:teuthology.orchestra.run.smithi111.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-25T12:19:58.353 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree... 2024-04-25T12:19:58.354 INFO:teuthology.orchestra.run.smithi094.stdout:Reading state information... 2024-04-25T12:19:58.408 INFO:teuthology.orchestra.run.smithi111.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-25T12:19:58.535 INFO:teuthology.orchestra.run.smithi094.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-25T12:19:58.535 INFO:teuthology.orchestra.run.smithi094.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T12:19:58.535 INFO:teuthology.orchestra.run.smithi094.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T12:19:58.535 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T12:19:58.535 INFO:teuthology.orchestra.run.smithi094.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T12:19:58.535 INFO:teuthology.orchestra.run.smithi094.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T12:19:58.535 INFO:teuthology.orchestra.run.smithi094.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T12:19:58.536 INFO:teuthology.orchestra.run.smithi094.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T12:19:58.536 INFO:teuthology.orchestra.run.smithi094.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T12:19:58.536 INFO:teuthology.orchestra.run.smithi094.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T12:19:58.536 INFO:teuthology.orchestra.run.smithi094.stdout:The following additional packages will be installed: 2024-04-25T12:19:58.536 INFO:teuthology.orchestra.run.smithi094.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-25T12:19:58.537 INFO:teuthology.orchestra.run.smithi094.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-25T12:19:58.537 INFO:teuthology.orchestra.run.smithi094.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-25T12:19:58.537 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-25T12:19:58.537 INFO:teuthology.orchestra.run.smithi094.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T12:19:58.538 INFO:teuthology.orchestra.run.smithi094.stdout:Suggested packages: 2024-04-25T12:19:58.538 INFO:teuthology.orchestra.run.smithi094.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-25T12:19:58.538 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-25T12:19:58.538 INFO:teuthology.orchestra.run.smithi094.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-25T12:19:58.578 INFO:teuthology.orchestra.run.smithi094.stdout:The following NEW packages will be installed: 2024-04-25T12:19:58.579 INFO:teuthology.orchestra.run.smithi094.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-25T12:19:58.579 INFO:teuthology.orchestra.run.smithi094.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-25T12:19:58.580 INFO:teuthology.orchestra.run.smithi094.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-25T12:19:58.580 INFO:teuthology.orchestra.run.smithi094.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-25T12:19:58.580 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-25T12:19:58.580 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-25T12:19:58.580 INFO:teuthology.orchestra.run.smithi094.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T12:19:58.581 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages will be upgraded: 2024-04-25T12:19:58.582 INFO:teuthology.orchestra.run.smithi094.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-25T12:19:58.764 INFO:teuthology.orchestra.run.smithi094.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-25T12:19:58.764 INFO:teuthology.orchestra.run.smithi094.stdout:Need to get 55.7 MB of archives. 2024-04-25T12:19:58.765 INFO:teuthology.orchestra.run.smithi094.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-25T12:19:58.765 INFO:teuthology.orchestra.run.smithi094.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-25T12:19:59.392 INFO:teuthology.orchestra.run.smithi094.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T12:19:59.409 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T12:19:59.490 INFO:teuthology.orchestra.run.smithi111.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-25T12:19:59.495 INFO:teuthology.orchestra.run.smithi111.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-25T12:19:59.495 INFO:teuthology.orchestra.run.smithi111.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-25T12:19:59.501 INFO:teuthology.orchestra.run.smithi111.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-25T12:19:59.501 INFO:teuthology.orchestra.run.smithi111.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-25T12:19:59.511 INFO:teuthology.orchestra.run.smithi111.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-25T12:19:59.534 INFO:teuthology.orchestra.run.smithi094.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T12:19:59.535 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T12:19:59.536 INFO:teuthology.orchestra.run.smithi094.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T12:19:59.565 INFO:teuthology.orchestra.run.smithi094.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-25T12:19:59.567 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-25T12:19:59.570 INFO:teuthology.orchestra.run.smithi094.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-25T12:19:59.573 INFO:teuthology.orchestra.run.smithi094.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T12:19:59.574 INFO:teuthology.orchestra.run.smithi094.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-25T12:19:59.678 INFO:teuthology.orchestra.run.smithi111.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-25T12:19:59.740 INFO:teuthology.orchestra.run.smithi094.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T12:20:00.033 INFO:teuthology.orchestra.run.smithi094.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T12:20:00.041 INFO:teuthology.orchestra.run.smithi094.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T12:20:00.046 INFO:teuthology.orchestra.run.smithi094.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-25T12:20:00.130 INFO:teuthology.orchestra.run.smithi094.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-25T12:20:00.271 INFO:teuthology.orchestra.run.smithi111.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-25T12:20:00.271 INFO:teuthology.orchestra.run.smithi111.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T12:20:00.450 INFO:teuthology.orchestra.run.smithi111.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-25T12:20:00.494 INFO:teuthology.orchestra.run.smithi111.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-25T12:20:00.494 INFO:teuthology.orchestra.run.smithi111.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-25T12:20:00.551 INFO:teuthology.orchestra.run.smithi111.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-25T12:20:00.558 INFO:teuthology.orchestra.run.smithi111.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-25T12:20:00.559 INFO:teuthology.orchestra.run.smithi111.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-25T12:20:00.560 INFO:teuthology.orchestra.run.smithi111.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-25T12:20:00.561 INFO:teuthology.orchestra.run.smithi111.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-25T12:20:00.767 INFO:teuthology.orchestra.run.smithi111.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-25T12:20:01.177 INFO:teuthology.orchestra.run.smithi111.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-25T12:20:01.206 INFO:teuthology.orchestra.run.smithi094.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-25T12:20:01.210 INFO:teuthology.orchestra.run.smithi094.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-25T12:20:01.211 INFO:teuthology.orchestra.run.smithi094.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-25T12:20:01.218 INFO:teuthology.orchestra.run.smithi094.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-25T12:20:01.218 INFO:teuthology.orchestra.run.smithi094.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-25T12:20:01.229 INFO:teuthology.orchestra.run.smithi094.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-25T12:20:01.396 INFO:teuthology.orchestra.run.smithi094.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-25T12:20:01.964 INFO:teuthology.orchestra.run.smithi111.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-25T12:20:01.964 INFO:teuthology.orchestra.run.smithi111.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-25T12:20:01.985 INFO:teuthology.orchestra.run.smithi094.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-25T12:20:01.986 INFO:teuthology.orchestra.run.smithi094.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T12:20:02.008 INFO:teuthology.orchestra.run.smithi111.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-25T12:20:02.008 INFO:teuthology.orchestra.run.smithi111.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-25T12:20:02.009 INFO:teuthology.orchestra.run.smithi111.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-25T12:20:02.009 INFO:teuthology.orchestra.run.smithi111.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-25T12:20:02.040 INFO:teuthology.orchestra.run.smithi111.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-25T12:20:02.041 INFO:teuthology.orchestra.run.smithi111.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-25T12:20:02.165 INFO:teuthology.orchestra.run.smithi094.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-25T12:20:02.166 INFO:teuthology.orchestra.run.smithi094.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-25T12:20:02.203 INFO:teuthology.orchestra.run.smithi094.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-25T12:20:02.262 INFO:teuthology.orchestra.run.smithi094.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-25T12:20:02.268 INFO:teuthology.orchestra.run.smithi094.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-25T12:20:02.269 INFO:teuthology.orchestra.run.smithi094.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-25T12:20:02.270 INFO:teuthology.orchestra.run.smithi094.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-25T12:20:02.270 INFO:teuthology.orchestra.run.smithi094.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-25T12:20:02.443 INFO:teuthology.orchestra.run.smithi111.stdout:Preconfiguring packages ... 2024-04-25T12:20:02.605 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 55.7 MB in 5s (10.8 MB/s) 2024-04-25T12:20:02.880 INFO:teuthology.orchestra.run.smithi094.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-25T12:20:02.889 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-25T12:20:02.895 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T12:20:03.014 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T12:20:03.283 INFO:teuthology.orchestra.run.smithi094.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-25T12:20:03.638 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-25T12:20:04.076 INFO:teuthology.orchestra.run.smithi094.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-25T12:20:04.076 INFO:teuthology.orchestra.run.smithi094.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-25T12:20:04.077 INFO:teuthology.orchestra.run.smithi094.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-25T12:20:04.077 INFO:teuthology.orchestra.run.smithi094.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-25T12:20:04.109 INFO:teuthology.orchestra.run.smithi094.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-25T12:20:04.110 INFO:teuthology.orchestra.run.smithi094.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-25T12:20:04.140 INFO:teuthology.orchestra.run.smithi094.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-25T12:20:04.141 INFO:teuthology.orchestra.run.smithi094.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-25T12:20:04.547 INFO:teuthology.orchestra.run.smithi094.stdout:Preconfiguring packages ... 2024-04-25T12:20:04.610 INFO:teuthology.orchestra.run.smithi111.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-25T12:20:04.698 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 55.7 MB in 6s (10.0 MB/s) 2024-04-25T12:20:04.897 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package flex. 2024-04-25T12:20:04.962 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-25T12:20:04.967 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T12:20:05.001 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-25T12:20:05.007 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T12:20:05.014 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T12:20:05.169 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T12:20:05.537 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T12:20:05.727 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T12:20:05.967 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-25T12:20:06.129 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T12:20:06.649 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-25T12:20:06.654 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T12:20:06.776 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T12:20:06.877 INFO:teuthology.orchestra.run.smithi094.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-25T12:20:07.142 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package flex. 2024-04-25T12:20:07.193 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T12:20:07.235 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-25T12:20:07.241 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T12:20:07.282 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T12:20:07.333 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T12:20:07.677 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T12:20:07.764 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T12:20:07.904 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T12:20:08.051 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package bison. 2024-04-25T12:20:08.154 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-25T12:20:08.160 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T12:20:08.202 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T12:20:08.306 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T12:20:08.654 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-25T12:20:08.682 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-25T12:20:08.720 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T12:20:08.850 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-25T12:20:08.855 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T12:20:08.994 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T12:20:08.998 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package dump. 2024-04-25T12:20:09.026 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-25T12:20:09.065 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking dump (0.4b47-3) ... 2024-04-25T12:20:09.411 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package indent. 2024-04-25T12:20:09.412 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T12:20:09.439 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T12:20:09.477 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T12:20:09.542 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T12:20:09.730 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T12:20:09.746 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T12:20:09.788 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T12:20:09.878 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T12:20:10.067 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-25T12:20:10.095 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-25T12:20:10.134 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T12:20:10.260 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package bison. 2024-04-25T12:20:10.364 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-25T12:20:10.369 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T12:20:10.395 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T12:20:10.411 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T12:20:10.420 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T12:20:10.453 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T12:20:10.782 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T12:20:10.810 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T12:20:10.848 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T12:20:10.887 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-25T12:20:10.915 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-25T12:20:10.954 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T12:20:11.067 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T12:20:11.084 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T12:20:11.117 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T12:20:11.241 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package dump. 2024-04-25T12:20:11.268 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-25T12:20:11.307 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking dump (0.4b47-3) ... 2024-04-25T12:20:11.362 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libjson-perl. 2024-04-25T12:20:11.387 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-25T12:20:11.428 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-25T12:20:11.602 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package indent. 2024-04-25T12:20:11.630 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T12:20:11.661 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T12:20:11.740 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-25T12:20:11.768 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-25T12:20:11.807 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T12:20:11.922 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T12:20:11.938 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T12:20:11.980 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T12:20:12.292 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-25T12:20:12.320 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-25T12:20:12.367 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T12:20:12.603 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T12:20:12.630 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T12:20:12.686 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T12:20:13.023 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T12:20:13.050 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T12:20:13.089 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T12:20:13.325 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T12:20:13.353 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T12:20:13.392 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T12:20:13.460 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-25T12:20:13.488 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T12:20:13.526 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T12:20:13.636 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libjson-perl. 2024-04-25T12:20:13.652 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-25T12:20:13.686 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-25T12:20:13.779 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-25T12:20:13.796 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T12:20:13.837 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T12:20:13.997 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-25T12:20:14.025 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-25T12:20:14.064 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T12:20:14.165 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-25T12:20:14.193 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T12:20:14.232 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T12:20:14.560 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-25T12:20:14.588 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-25T12:20:14.626 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T12:20:14.938 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-25T12:20:14.966 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T12:20:15.004 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T12:20:15.349 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-25T12:20:15.377 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T12:20:15.416 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T12:20:15.752 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-25T12:20:15.767 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-25T12:20:15.780 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T12:20:15.794 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T12:20:15.819 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T12:20:15.825 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T12:20:16.080 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-25T12:20:16.096 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T12:20:16.138 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T12:20:16.416 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T12:20:16.444 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T12:20:16.482 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T12:20:16.590 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-25T12:20:16.617 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T12:20:16.826 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T12:20:16.971 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-25T12:20:17.000 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-25T12:20:17.038 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T12:20:17.165 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-25T12:20:17.193 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T12:20:17.232 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T12:20:17.383 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package modemmanager. 2024-04-25T12:20:17.411 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T12:20:17.441 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T12:20:17.518 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-25T12:20:17.534 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-25T12:20:17.568 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T12:20:17.887 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-25T12:20:17.915 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T12:20:17.954 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T12:20:18.065 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package network-manager. 2024-04-25T12:20:18.092 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T12:20:18.140 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-25T12:20:18.332 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-25T12:20:18.359 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T12:20:18.398 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T12:20:18.718 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-25T12:20:18.745 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T12:20:18.764 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ppp. 2024-04-25T12:20:18.776 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T12:20:18.792 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-25T12:20:19.062 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-25T12:20:19.065 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T12:20:19.078 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T12:20:19.120 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T12:20:19.372 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T12:20:19.385 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package pptp-linux. 2024-04-25T12:20:19.388 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T12:20:19.413 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-25T12:20:19.431 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T12:20:19.452 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-25T12:20:19.706 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-25T12:20:19.733 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-25T12:20:19.772 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-25T12:20:20.060 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-25T12:20:20.076 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-25T12:20:20.117 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T12:20:20.475 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-25T12:20:20.502 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-25T12:20:20.504 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package modemmanager. 2024-04-25T12:20:20.532 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T12:20:20.541 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking postgresql-client-common (238) ... 2024-04-25T12:20:20.579 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T12:20:20.837 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-25T12:20:20.853 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T12:20:20.895 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T12:20:21.244 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package network-manager. 2024-04-25T12:20:21.272 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T12:20:21.319 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-25T12:20:21.475 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package postgresql-common. 2024-04-25T12:20:21.504 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-25T12:20:21.561 INFO:teuthology.orchestra.run.smithi111.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-25T12:20:21.589 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking postgresql-common (238) ... 2024-04-25T12:20:22.028 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ppp. 2024-04-25T12:20:22.041 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package postgresql-14. 2024-04-25T12:20:22.056 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-25T12:20:22.068 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T12:20:22.110 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T12:20:22.320 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T12:20:22.633 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package pptp-linux. 2024-04-25T12:20:22.660 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-25T12:20:22.699 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-25T12:20:22.943 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-25T12:20:22.959 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-25T12:20:22.993 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-25T12:20:23.229 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-25T12:20:23.246 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-25T12:20:23.279 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-client-common (238) ... 2024-04-25T12:20:23.452 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package postgresql. 2024-04-25T12:20:23.466 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-25T12:20:23.510 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking postgresql (14+238) ... 2024-04-25T12:20:23.608 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-25T12:20:23.636 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T12:20:23.674 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T12:20:23.754 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package postgresql-client. 2024-04-25T12:20:23.770 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-25T12:20:23.812 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking postgresql-client (14+238) ... 2024-04-25T12:20:24.065 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-25T12:20:24.081 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-25T12:20:24.123 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-25T12:20:24.270 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-common. 2024-04-25T12:20:24.298 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-25T12:20:24.355 INFO:teuthology.orchestra.run.smithi094.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-25T12:20:24.385 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-common (238) ... 2024-04-25T12:20:24.451 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package tcl8.6. 2024-04-25T12:20:24.479 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-25T12:20:24.509 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T12:20:24.770 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package tcl. 2024-04-25T12:20:24.798 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-25T12:20:24.842 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-25T12:20:24.869 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-14. 2024-04-25T12:20:24.897 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T12:20:24.947 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T12:20:25.223 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package wpasupplicant. 2024-04-25T12:20:25.252 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-25T12:20:25.290 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T12:20:25.627 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-25T12:20:25.644 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-25T12:20:25.677 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-25T12:20:26.022 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-25T12:20:26.050 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-25T12:20:26.097 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T12:20:26.204 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql. 2024-04-25T12:20:26.221 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-25T12:20:26.263 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql (14+238) ... 2024-04-25T12:20:26.402 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up postgresql-client-common (238) ... 2024-04-25T12:20:26.473 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-client. 2024-04-25T12:20:26.490 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-25T12:20:26.532 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-client (14+238) ... 2024-04-25T12:20:26.603 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T12:20:26.729 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T12:20:26.775 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-25T12:20:26.792 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-25T12:20:26.834 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-25T12:20:26.855 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T12:20:26.981 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T12:20:27.108 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T12:20:27.203 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package tcl8.6. 2024-04-25T12:20:27.231 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-25T12:20:27.234 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T12:20:27.269 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T12:20:27.555 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package tcl. 2024-04-25T12:20:27.584 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-25T12:20:27.635 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-25T12:20:27.718 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-25T12:20:27.806 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T12:20:27.983 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package wpasupplicant. 2024-04-25T12:20:28.011 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-25T12:20:28.049 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T12:20:28.212 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T12:20:28.212 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T12:20:28.378 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-25T12:20:28.395 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-25T12:20:28.428 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-25T12:20:28.726 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T12:20:28.807 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-25T12:20:28.835 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-25T12:20:28.852 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T12:20:28.882 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T12:20:29.004 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T12:20:29.129 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-25T12:20:29.186 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-client-common (238) ... 2024-04-25T12:20:29.247 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T12:20:29.365 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T12:20:29.387 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T12:20:29.491 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T12:20:29.496 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T12:20:29.614 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T12:20:29.617 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T12:20:29.748 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T12:20:29.874 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T12:20:30.000 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T12:20:30.475 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-25T12:20:30.583 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T12:20:30.968 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T12:20:30.968 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T12:20:31.268 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T12:20:31.433 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T12:20:31.506 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up dump (0.4b47-3) ... 2024-04-25T12:20:31.559 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T12:20:31.659 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-25T12:20:31.685 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T12:20:31.784 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T12:20:31.803 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-25T12:20:31.912 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T12:20:31.936 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T12:20:32.013 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T12:20:32.062 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-25T12:20:32.188 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-25T12:20:32.305 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T12:20:32.379 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T12:20:32.449 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T12:20:32.508 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T12:20:32.575 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T12:20:32.634 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T12:20:32.751 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T12:20:32.877 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T12:20:33.003 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-25T12:20:33.171 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up postgresql-client (14+238) ... 2024-04-25T12:20:33.266 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T12:20:33.297 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-25T12:20:33.392 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up dump (0.4b47-3) ... 2024-04-25T12:20:33.486 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-25T12:20:33.544 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T12:20:33.662 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T12:20:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:33.766 INFO:teuthology.orchestra.run.smithi111.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-25T12:20:33.766 INFO:teuthology.orchestra.run.smithi111.stdout:which means they are currently configured by ifupdown: 2024-04-25T12:20:33.766 INFO:teuthology.orchestra.run.smithi111.stdout:- enp3s0f1 2024-04-25T12:20:33.766 INFO:teuthology.orchestra.run.smithi111.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-25T12:20:33.767 INFO:teuthology.orchestra.run.smithi111.stdout:remove their configuration from /etc/network/interfaces. 2024-04-25T12:20:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:33.788 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-25T12:20:33.894 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-25T12:20:33.914 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-25T12:20:34.040 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T12:20:34.158 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T12:20:34.180 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-25T12:20:34.226 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T12:20:34.335 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T12:20:34.495 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T12:20:34.529 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-25T12:20:34.622 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T12:20:34.748 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-25T12:20:34.916 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-client (14+238) ... 2024-04-25T12:20:35.017 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T12:20:35.042 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-25T12:20:35.160 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T12:20:35.286 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-25T12:20:35.412 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up postgresql-common (238) ... 2024-04-25T12:20:35.480 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:35.481 INFO:teuthology.orchestra.run.smithi094.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-25T12:20:35.481 INFO:teuthology.orchestra.run.smithi094.stdout:which means they are currently configured by ifupdown: 2024-04-25T12:20:35.481 INFO:teuthology.orchestra.run.smithi094.stdout:- enp3s0f1 2024-04-25T12:20:35.481 INFO:teuthology.orchestra.run.smithi094.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-25T12:20:35.481 INFO:teuthology.orchestra.run.smithi094.stdout:remove their configuration from /etc/network/interfaces. 2024-04-25T12:20:35.481 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:35.598 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-25T12:20:35.916 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-25T12:20:36.236 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-25T12:20:36.303 INFO:teuthology.orchestra.run.smithi111.stdout:Adding user postgres to group ssl-cert 2024-04-25T12:20:36.530 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:36.531 INFO:teuthology.orchestra.run.smithi111.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-25T12:20:36.719 INFO:teuthology.orchestra.run.smithi111.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-25T12:20:36.720 INFO:teuthology.orchestra.run.smithi111.stdout:Removing obsolete dictionary files: 2024-04-25T12:20:36.729 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T12:20:36.864 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T12:20:36.990 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-25T12:20:37.133 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-common (238) ... 2024-04-25T12:20:37.272 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-25T12:20:37.630 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T12:20:37.965 INFO:teuthology.orchestra.run.smithi111.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-25T12:20:37.981 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-25T12:20:38.018 INFO:teuthology.orchestra.run.smithi094.stdout:Adding user postgres to group ssl-cert 2024-04-25T12:20:38.025 INFO:teuthology.orchestra.run.smithi111.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-25T12:20:38.025 INFO:teuthology.orchestra.run.smithi111.stdout:This user must also own the server process. 2024-04-25T12:20:38.025 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:38.026 INFO:teuthology.orchestra.run.smithi111.stdout:The database cluster will be initialized with locale "en_US". 2024-04-25T12:20:38.026 INFO:teuthology.orchestra.run.smithi111.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-25T12:20:38.026 INFO:teuthology.orchestra.run.smithi111.stdout:The default text search configuration will be set to "english". 2024-04-25T12:20:38.026 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:38.026 INFO:teuthology.orchestra.run.smithi111.stdout:Data page checksums are disabled. 2024-04-25T12:20:38.026 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:38.026 INFO:teuthology.orchestra.run.smithi111.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-25T12:20:38.027 INFO:teuthology.orchestra.run.smithi111.stdout:creating subdirectories ... ok 2024-04-25T12:20:38.027 INFO:teuthology.orchestra.run.smithi111.stdout:selecting dynamic shared memory implementation ... posix 2024-04-25T12:20:38.042 INFO:teuthology.orchestra.run.smithi111.stdout:selecting default max_connections ... 100 2024-04-25T12:20:38.062 INFO:teuthology.orchestra.run.smithi111.stdout:selecting default shared_buffers ... 128MB 2024-04-25T12:20:38.074 INFO:teuthology.orchestra.run.smithi111.stdout:selecting default time zone ... Etc/UTC 2024-04-25T12:20:38.074 INFO:teuthology.orchestra.run.smithi111.stdout:creating configuration files ... ok 2024-04-25T12:20:38.190 INFO:teuthology.orchestra.run.smithi111.stdout:running bootstrap script ... ok 2024-04-25T12:20:38.243 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:38.244 INFO:teuthology.orchestra.run.smithi094.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-25T12:20:38.427 INFO:teuthology.orchestra.run.smithi094.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-25T12:20:38.427 INFO:teuthology.orchestra.run.smithi094.stdout:Removing obsolete dictionary files: 2024-04-25T12:20:38.834 INFO:teuthology.orchestra.run.smithi111.stdout:performing post-bootstrap initialization ... ok 2024-04-25T12:20:38.966 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-25T12:20:39.345 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T12:20:39.441 INFO:teuthology.orchestra.run.smithi111.stdout:syncing data to disk ... ok 2024-04-25T12:20:39.661 INFO:teuthology.orchestra.run.smithi094.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-25T12:20:39.682 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-25T12:20:39.726 INFO:teuthology.orchestra.run.smithi094.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-25T12:20:39.726 INFO:teuthology.orchestra.run.smithi094.stdout:This user must also own the server process. 2024-04-25T12:20:39.727 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:39.727 INFO:teuthology.orchestra.run.smithi094.stdout:The database cluster will be initialized with locale "en_US". 2024-04-25T12:20:39.727 INFO:teuthology.orchestra.run.smithi094.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-25T12:20:39.727 INFO:teuthology.orchestra.run.smithi094.stdout:The default text search configuration will be set to "english". 2024-04-25T12:20:39.727 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:39.727 INFO:teuthology.orchestra.run.smithi094.stdout:Data page checksums are disabled. 2024-04-25T12:20:39.727 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:39.727 INFO:teuthology.orchestra.run.smithi094.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-25T12:20:39.728 INFO:teuthology.orchestra.run.smithi094.stdout:creating subdirectories ... ok 2024-04-25T12:20:39.728 INFO:teuthology.orchestra.run.smithi094.stdout:selecting dynamic shared memory implementation ... posix 2024-04-25T12:20:39.742 INFO:teuthology.orchestra.run.smithi094.stdout:selecting default max_connections ... 100 2024-04-25T12:20:39.762 INFO:teuthology.orchestra.run.smithi094.stdout:selecting default shared_buffers ... 128MB 2024-04-25T12:20:39.772 INFO:teuthology.orchestra.run.smithi094.stdout:selecting default time zone ... Etc/UTC 2024-04-25T12:20:39.772 INFO:teuthology.orchestra.run.smithi094.stdout:creating configuration files ... ok 2024-04-25T12:20:39.832 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-25T12:20:39.888 INFO:teuthology.orchestra.run.smithi094.stdout:running bootstrap script ... ok 2024-04-25T12:20:40.546 INFO:teuthology.orchestra.run.smithi094.stdout:performing post-bootstrap initialization ... ok 2024-04-25T12:20:41.177 INFO:teuthology.orchestra.run.smithi094.stdout:syncing data to disk ... ok 2024-04-25T12:20:41.569 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-25T12:20:42.562 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T12:20:42.688 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-25T12:20:42.814 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up postgresql (14+238) ... 2024-04-25T12:20:42.915 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T12:20:43.041 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T12:20:43.294 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T12:20:43.294 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T12:20:43.860 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T12:20:43.961 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-25T12:20:44.255 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T12:20:44.320 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T12:20:44.399 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T12:20:44.446 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-25T12:20:44.555 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql (14+238) ... 2024-04-25T12:20:44.665 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T12:20:44.791 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T12:20:45.079 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T12:20:45.080 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T12:20:45.442 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-25T12:20:45.542 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T12:20:45.619 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T12:20:45.712 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-25T12:20:46.023 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T12:20:46.042 INFO:teuthology.orchestra.run.smithi111.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T12:20:46.049 DEBUG:teuthology.parallel:result is None 2024-04-25T12:20:46.175 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T12:20:47.522 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-25T12:20:47.630 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T12:20:48.128 INFO:teuthology.orchestra.run.smithi094.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T12:20:48.132 DEBUG:teuthology.parallel:result is None 2024-04-25T12:20:48.133 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T12:20:48.272 DEBUG:teuthology.orchestra.run.smithi094:> dpkg-query -W -f '${Version}' ceph 2024-04-25T12:20:48.291 INFO:teuthology.orchestra.run.smithi094.stdout:19.0.0-3156-gd69f13d8-1jammy 2024-04-25T12:20:48.291 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156-gd69f13d8-1jammy 2024-04-25T12:20:48.291 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156-gd69f13d8-1jammy is installed. 2024-04-25T12:20:48.292 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T12:20:48.430 DEBUG:teuthology.orchestra.run.smithi111:> dpkg-query -W -f '${Version}' ceph 2024-04-25T12:20:48.449 INFO:teuthology.orchestra.run.smithi111.stdout:19.0.0-3156-gd69f13d8-1jammy 2024-04-25T12:20:48.449 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156-gd69f13d8-1jammy 2024-04-25T12:20:48.450 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156-gd69f13d8-1jammy is installed. 2024-04-25T12:20:48.451 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T12:20:48.451 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:20:48.451 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T12:20:48.465 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T12:20:48.465 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T12:20:48.506 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T12:20:48.506 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:20:48.506 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T12:20:48.520 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T12:20:48.576 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T12:20:48.576 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T12:20:48.589 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T12:20:48.644 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T12:20:48.645 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:20:48.645 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T12:20:48.657 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T12:20:48.712 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T12:20:48.712 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T12:20:48.725 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T12:20:48.780 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T12:20:48.780 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:20:48.780 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T12:20:48.792 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T12:20:48.847 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T12:20:48.847 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T12:20:48.860 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T12:20:48.916 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T12:20:48.996 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T12:20:48.996 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 777 /var/log/ceph 2024-04-25T12:20:48.998 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 777 /var/log/ceph 2024-04-25T12:20:49.010 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T12:20:49.011 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T12:20:49.054 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T12:20:49.066 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T12:20:49.067 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T12:20:49.106 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T12:20:49.127 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T12:20:49.127 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T12:20:49.127 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T12:20:49.128 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:20:49.128 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T12:20:49.165 DEBUG:teuthology.orchestra.run.smithi094:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T12:20:49.241 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T12:20:49.241 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T12:20:49.247 DEBUG:teuthology.orchestra.run.smithi111:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T12:20:49.326 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T12:20:49.327 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T12:20:49.327 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673355', 'branch': 'wip-lusov-quiescer', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}}', 'email': None, 'first_in_suite': False, 'job_id': '7673355', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-lusov-quiescer'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-quiescer', 'sha1': 'df40303764f976ac2e973c1ef2b40d1ebbda473b'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 2866, 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'sleep_before_teardown': 0, 'subset': '200/111111', 'suite': 'fs', 'suite_branch': 'wip-lusov-quiescer', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_df40303764f976ac2e973c1ef2b40d1ebbda473b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph', 'suite_sha1': 'df40303764f976ac2e973c1ef2b40d1ebbda473b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi094.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJfTSv7vMzHvjQXYZUaACokviymJH9s74MyO3qsaugg1TGjlYs3nxEsrIQdStWPCYKUur12JmThsUYMd+n2RGoA=', 'smithi111.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLHwSyuUZgTTzFyWt6IuQv0TtKrF/6cj/pFgbB9JWdq+kIXngUeQPqUL31ZMTODhfqMLpYt7noj5lvtH6/PRnAQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'quiescer': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_11:13:36', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T12:20:49.327 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T12:20:49.330 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T12:20:49.373 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T12:20:49.378 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T12:20:49.433 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:20:49.433 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T12:20:49.438 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T12:20:49.438 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_1 2024-04-25T12:20:49.485 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T12:20:49.485 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T12:20:49.485 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 876 Links: 1 2024-04-25T12:20:49.485 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T12:20:49.485 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-04-25 12:14:40.049177156 +0000 2024-04-25T12:20:49.485 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-04-25 12:14:39.777179585 +0000 2024-04-25T12:20:49.485 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-04-25 12:14:39.777179585 +0000 2024-04-25T12:20:49.486 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2024-04-25T12:20:49.486 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T12:20:49.539 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-04-25T12:20:49.539 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-04-25T12:20:49.539 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000288366 s, 1.8 MB/s 2024-04-25T12:20:49.541 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T12:20:49.590 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_2 2024-04-25T12:20:49.637 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T12:20:49.637 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T12:20:49.637 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-04-25T12:20:49.637 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T12:20:49.637 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-04-25 12:14:40.269175191 +0000 2024-04-25T12:20:49.637 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-04-25 12:14:40.265175227 +0000 2024-04-25T12:20:49.637 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-04-25 12:14:40.265175227 +0000 2024-04-25T12:20:49.637 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2024-04-25T12:20:49.638 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T12:20:49.691 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-04-25T12:20:49.691 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-04-25T12:20:49.691 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000209141 s, 2.4 MB/s 2024-04-25T12:20:49.692 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T12:20:49.742 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_3 2024-04-25T12:20:49.789 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T12:20:49.789 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T12:20:49.789 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-04-25T12:20:49.789 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T12:20:49.789 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-04-25 12:14:41.045168259 +0000 2024-04-25T12:20:49.789 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-04-25 12:14:40.785170583 +0000 2024-04-25T12:20:49.789 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-04-25 12:14:40.785170583 +0000 2024-04-25T12:20:49.789 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2024-04-25T12:20:49.789 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T12:20:49.843 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-04-25T12:20:49.843 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-04-25T12:20:49.843 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.00022226 s, 2.3 MB/s 2024-04-25T12:20:49.844 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T12:20:49.894 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_4 2024-04-25T12:20:49.941 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T12:20:49.941 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T12:20:49.941 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-04-25T12:20:49.941 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T12:20:49.941 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-04-25 12:14:41.549163758 +0000 2024-04-25T12:20:49.941 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-04-25 12:14:41.289166080 +0000 2024-04-25T12:20:49.941 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-04-25 12:14:41.289166080 +0000 2024-04-25T12:20:49.941 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2024-04-25T12:20:49.942 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T12:20:49.995 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-04-25T12:20:49.996 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-04-25T12:20:49.996 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000306311 s, 1.7 MB/s 2024-04-25T12:20:49.997 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T12:20:50.047 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T12:20:50.047 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T12:20:50.047 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T12:20:50.052 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T12:20:50.053 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_1 2024-04-25T12:20:50.101 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T12:20:50.101 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T12:20:50.101 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 862 Links: 1 2024-04-25T12:20:50.101 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T12:20:50.102 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-04-25 12:14:43.343324632 +0000 2024-04-25T12:20:50.102 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-04-25 12:14:43.083338656 +0000 2024-04-25T12:20:50.102 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-04-25 12:14:43.083338656 +0000 2024-04-25T12:20:50.102 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-04-25T12:20:50.102 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T12:20:50.155 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-04-25T12:20:50.156 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-04-25T12:20:50.156 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000462551 s, 1.1 MB/s 2024-04-25T12:20:50.157 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T12:20:50.206 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_2 2024-04-25T12:20:50.253 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T12:20:50.253 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T12:20:50.253 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 878 Links: 1 2024-04-25T12:20:50.253 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T12:20:50.253 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-04-25 12:14:43.815299176 +0000 2024-04-25T12:20:50.253 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-04-25 12:14:43.567312551 +0000 2024-04-25T12:20:50.253 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-04-25 12:14:43.567312551 +0000 2024-04-25T12:20:50.253 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-04-25T12:20:50.254 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T12:20:50.307 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-04-25T12:20:50.307 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-04-25T12:20:50.307 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000312288 s, 1.6 MB/s 2024-04-25T12:20:50.308 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T12:20:50.358 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_3 2024-04-25T12:20:50.405 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T12:20:50.405 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T12:20:50.405 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 902 Links: 1 2024-04-25T12:20:50.405 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T12:20:50.405 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-04-25 12:14:44.295273577 +0000 2024-04-25T12:20:50.405 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-04-25 12:14:44.039287128 +0000 2024-04-25T12:20:50.405 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-04-25 12:14:44.039287128 +0000 2024-04-25T12:20:50.405 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-04-25T12:20:50.406 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T12:20:50.459 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-04-25T12:20:50.459 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-04-25T12:20:50.460 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.0004137 s, 1.2 MB/s 2024-04-25T12:20:50.461 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T12:20:50.511 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_4 2024-04-25T12:20:50.557 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T12:20:50.557 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T12:20:50.557 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 919 Links: 1 2024-04-25T12:20:50.557 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T12:20:50.557 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-04-25 12:14:44.815246053 +0000 2024-04-25T12:20:50.557 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-04-25 12:14:44.543260452 +0000 2024-04-25T12:20:50.557 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-04-25 12:14:44.543260452 +0000 2024-04-25T12:20:50.558 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-04-25T12:20:50.558 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T12:20:50.611 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-04-25T12:20:50.611 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-04-25T12:20:50.611 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000287789 s, 1.8 MB/s 2024-04-25T12:20:50.612 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T12:20:50.658 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T12:20:50.659 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi094.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi111.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T12:20:50.659 INFO:tasks.ceph:Generating config... 2024-04-25T12:20:50.660 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T12:20:50.660 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-04-25T12:20:50.660 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T12:20:50.660 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T12:20:50.660 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T12:20:50.660 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T12:20:50.660 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T12:20:50.660 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T12:20:50.660 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T12:20:50.660 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-25T12:20:50.660 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-25T12:20:50.661 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-25T12:20:50.661 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-25T12:20:50.661 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T12:20:50.661 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T12:20:50.661 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-04-25T12:20:50.661 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T12:20:50.661 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T12:20:50.661 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-04-25T12:20:50.661 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-04-25T12:20:50.661 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-04-25T12:20:50.661 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-04-25T12:20:50.661 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-04-25T12:20:50.661 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-04-25T12:20:50.661 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-04-25T12:20:50.661 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T12:20:50.661 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T12:20:50.662 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T12:20:50.662 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-25T12:20:50.662 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T12:20:50.662 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T12:20:50.662 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T12:20:50.662 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T12:20:50.662 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T12:20:50.662 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-25T12:20:50.662 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T12:20:50.662 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T12:20:50.662 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T12:20:50.662 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-25T12:20:50.662 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-25T12:20:50.662 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T12:20:50.662 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T12:20:50.663 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-25T12:20:50.663 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-04-25T12:20:50.663 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T12:20:50.663 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T12:20:50.663 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T12:20:50.663 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-04-25T12:20:50.663 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-04-25T12:20:50.663 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-04-25T12:20:50.663 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-04-25T12:20:50.663 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-25T12:20:50.663 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T12:20:50.663 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-25T12:20:50.663 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T12:20:50.663 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T12:20:50.664 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T12:20:50.664 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T12:20:50.698 INFO:teuthology.orchestra.run.smithi094.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T12:20:50.712 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T12:20:50.791 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T12:20:50.844 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.94'), ('mon.b', '172.21.15.111'), ('mon.c', '[v2:172.21.15.111:3301,v1:172.21.15.111:6790]')] 2024-04-25T12:20:50.844 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.94,172.21.15.111,[v2:172.21.15.111:3301,v1:172.21.15.111:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T12:20:50.845 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:20:50.845 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T12:20:50.893 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.94 --add b 172.21.15.111 --addv c '[v2:172.21.15.111:3301,v1:172.21.15.111:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:20:50.979 INFO:teuthology.orchestra.run.smithi094.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:20:50.979 INFO:teuthology.orchestra.run.smithi094.stdout:monmaptool: generated fsid 7059a9e2-aec4-4b84-b942-caf531e15da3 2024-04-25T12:20:50.979 INFO:teuthology.orchestra.run.smithi094.stdout:setting min_mon_release = quincy 2024-04-25T12:20:50.979 INFO:teuthology.orchestra.run.smithi094.stdout:epoch 0 2024-04-25T12:20:50.979 INFO:teuthology.orchestra.run.smithi094.stdout:fsid 7059a9e2-aec4-4b84-b942-caf531e15da3 2024-04-25T12:20:50.979 INFO:teuthology.orchestra.run.smithi094.stdout:last_changed 2024-04-25T12:20:50.979452+0000 2024-04-25T12:20:50.979 INFO:teuthology.orchestra.run.smithi094.stdout:created 2024-04-25T12:20:50.979452+0000 2024-04-25T12:20:50.979 INFO:teuthology.orchestra.run.smithi094.stdout:min_mon_release 17 (quincy) 2024-04-25T12:20:50.979 INFO:teuthology.orchestra.run.smithi094.stdout:election_strategy: 1 2024-04-25T12:20:50.979 INFO:teuthology.orchestra.run.smithi094.stdout:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-04-25T12:20:50.979 INFO:teuthology.orchestra.run.smithi094.stdout:1: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.b 2024-04-25T12:20:50.979 INFO:teuthology.orchestra.run.smithi094.stdout:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-04-25T12:20:50.979 INFO:teuthology.orchestra.run.smithi094.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T12:20:50.981 DEBUG:teuthology.orchestra.run.smithi094:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T12:20:51.028 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7059a9e2-aec4-4b84-b942-caf531e15da3... 2024-04-25T12:20:51.029 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T12:20:51.074 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T12:20:51.102 INFO:teuthology.orchestra.run.smithi094.stdout:[global] 2024-04-25T12:20:51.105 INFO:teuthology.orchestra.run.smithi094.stdout: chdir = "" 2024-04-25T12:20:51.106 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T12:20:51.106 INFO:teuthology.orchestra.run.smithi094.stdout: auth supported = cephx 2024-04-25T12:20:51.106 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.106 INFO:teuthology.orchestra.run.smithi094.stdout: filestore xattr use omap = true 2024-04-25T12:20:51.106 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.106 INFO:teuthology.orchestra.run.smithi094.stdout: mon clock drift allowed = 1.000 2024-04-25T12:20:51.106 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.106 INFO:teuthology.orchestra.run.smithi094.stdout: osd crush chooseleaf type = 0 2024-04-25T12:20:51.106 INFO:teuthology.orchestra.run.smithi094.stdout: auth debug = true 2024-04-25T12:20:51.106 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.106 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on old message = true 2024-04-25T12:20:51.106 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on bug = true 2024-04-25T12:20:51.107 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.107 INFO:teuthology.orchestra.run.smithi094.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T12:20:51.107 INFO:teuthology.orchestra.run.smithi094.stdout: mon pg warn max object skew = 0 2024-04-25T12:20:51.107 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.107 INFO:teuthology.orchestra.run.smithi094.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T12:20:51.107 INFO:teuthology.orchestra.run.smithi094.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T12:20:51.107 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.107 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default size = 2 2024-04-25T12:20:51.107 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.107 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow primary affinity = true 2024-04-25T12:20:51.107 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow pg remap = true 2024-04-25T12:20:51.107 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on legacy crush tunables = false 2024-04-25T12:20:51.107 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on crush straw calc version zero = false 2024-04-25T12:20:51.107 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on no sortbitwise = false 2024-04-25T12:20:51.107 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on osd down out interval zero = false 2024-04-25T12:20:51.107 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on too few osds = false 2024-04-25T12:20:51.108 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T12:20:51.108 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T12:20:51.108 INFO:teuthology.orchestra.run.smithi094.stdout: mon_allow_pool_size_one = true 2024-04-25T12:20:51.108 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.108 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T12:20:51.108 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.108 INFO:teuthology.orchestra.run.smithi094.stdout: osd default data pool replay window = 5 2024-04-25T12:20:51.108 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.108 INFO:teuthology.orchestra.run.smithi094.stdout: mon allow pool delete = true 2024-04-25T12:20:51.108 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.108 INFO:teuthology.orchestra.run.smithi094.stdout: mon cluster log file level = debug 2024-04-25T12:20:51.108 INFO:teuthology.orchestra.run.smithi094.stdout: debug asserts on shutdown = true 2024-04-25T12:20:51.108 INFO:teuthology.orchestra.run.smithi094.stdout: mon health detail to clog = false 2024-04-25T12:20:51.108 INFO:teuthology.orchestra.run.smithi094.stdout: mon host = "172.21.15.94,172.21.15.111,[v2:172.21.15.111:3301,v1:172.21.15.111:6790]" 2024-04-25T12:20:51.108 INFO:teuthology.orchestra.run.smithi094.stdout: fsid = 7059a9e2-aec4-4b84-b942-caf531e15da3 2024-04-25T12:20:51.109 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.109 INFO:teuthology.orchestra.run.smithi094.stdout:[osd] 2024-04-25T12:20:51.109 INFO:teuthology.orchestra.run.smithi094.stdout: osd journal size = 100 2024-04-25T12:20:51.109 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.109 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub load threshold = 5.0 2024-04-25T12:20:51.109 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub max interval = 600 2024-04-25T12:20:51.109 INFO:teuthology.orchestra.run.smithi094.stdout: osd mclock profile = high_recovery_ops 2024-04-25T12:20:51.109 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.109 INFO:teuthology.orchestra.run.smithi094.stdout: osd recover clone overlap = true 2024-04-25T12:20:51.109 INFO:teuthology.orchestra.run.smithi094.stdout: osd recovery max chunk = 1048576 2024-04-25T12:20:51.109 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.109 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug shutdown = true 2024-04-25T12:20:51.109 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug op order = true 2024-04-25T12:20:51.109 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug verify stray on activate = true 2024-04-25T12:20:51.109 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug trim objects = true 2024-04-25T12:20:51.109 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.110 INFO:teuthology.orchestra.run.smithi094.stdout: osd open classes on start = true 2024-04-25T12:20:51.110 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug pg log writeout = true 2024-04-25T12:20:51.110 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.110 INFO:teuthology.orchestra.run.smithi094.stdout: osd deep scrub update digest min age = 30 2024-04-25T12:20:51.110 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.110 INFO:teuthology.orchestra.run.smithi094.stdout: osd map max advance = 10 2024-04-25T12:20:51.110 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.110 INFO:teuthology.orchestra.run.smithi094.stdout: journal zero on create = true 2024-04-25T12:20:51.110 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.110 INFO:teuthology.orchestra.run.smithi094.stdout: filestore ondisk finisher threads = 3 2024-04-25T12:20:51.110 INFO:teuthology.orchestra.run.smithi094.stdout: filestore apply finisher threads = 3 2024-04-25T12:20:51.110 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.110 INFO:teuthology.orchestra.run.smithi094.stdout: bdev debug aio = true 2024-04-25T12:20:51.110 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug misdirected ops = true 2024-04-25T12:20:51.110 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore block size = 96636764160 2024-04-25T12:20:51.111 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore fsck on mount = True 2024-04-25T12:20:51.111 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluefs = 20 2024-04-25T12:20:51.111 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluestore = 20 2024-04-25T12:20:51.111 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-04-25T12:20:51.111 INFO:teuthology.orchestra.run.smithi094.stdout: debug osd = 20 2024-04-25T12:20:51.111 INFO:teuthology.orchestra.run.smithi094.stdout: debug rocksdb = 10 2024-04-25T12:20:51.111 INFO:teuthology.orchestra.run.smithi094.stdout: mon client directed command retry = 5 2024-04-25T12:20:51.111 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T12:20:51.111 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd full ratio = 0.9 2024-04-25T12:20:51.111 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd nearfull ratio = 0.8 2024-04-25T12:20:51.111 INFO:teuthology.orchestra.run.smithi094.stdout: ms inject delay max = 1 2024-04-25T12:20:51.111 INFO:teuthology.orchestra.run.smithi094.stdout: ms inject delay probability = 0.005 2024-04-25T12:20:51.111 INFO:teuthology.orchestra.run.smithi094.stdout: ms inject delay type = client mds 2024-04-25T12:20:51.111 INFO:teuthology.orchestra.run.smithi094.stdout: ms inject socket failures = 2500 2024-04-25T12:20:51.111 INFO:teuthology.orchestra.run.smithi094.stdout: osd blocked scrub grace period = 3600 2024-04-25T12:20:51.112 INFO:teuthology.orchestra.run.smithi094.stdout: osd failsafe full ratio = 0.95 2024-04-25T12:20:51.112 INFO:teuthology.orchestra.run.smithi094.stdout: osd max markdown count = 1000 2024-04-25T12:20:51.112 INFO:teuthology.orchestra.run.smithi094.stdout: osd objectstore = bluestore 2024-04-25T12:20:51.112 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2024-04-25T12:20:51.112 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.112 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr] 2024-04-25T12:20:51.112 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-04-25T12:20:51.112 INFO:teuthology.orchestra.run.smithi094.stdout: debug mgr = 20 2024-04-25T12:20:51.112 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-04-25T12:20:51.112 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-04-25T12:20:51.112 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-04-25T12:20:51.112 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-04-25T12:20:51.112 INFO:teuthology.orchestra.run.smithi094.stdout: mgr/telemetry/nag = false 2024-04-25T12:20:51.112 INFO:teuthology.orchestra.run.smithi094.stdout: debug client = 20 2024-04-25T12:20:51.112 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.113 INFO:teuthology.orchestra.run.smithi094.stdout:[mon] 2024-04-25T12:20:51.113 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-04-25T12:20:51.113 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-04-25T12:20:51.113 INFO:teuthology.orchestra.run.smithi094.stdout: debug paxos = 20 2024-04-25T12:20:51.113 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-04-25T12:20:51.113 INFO:teuthology.orchestra.run.smithi094.stdout: mon data avail warn = 5 2024-04-25T12:20:51.113 INFO:teuthology.orchestra.run.smithi094.stdout: mon mgr mkfs grace = 240 2024-04-25T12:20:51.113 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-04-25T12:20:51.113 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd reporter subtree level = osd 2024-04-25T12:20:51.113 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd prime pg temp = true 2024-04-25T12:20:51.113 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-04-25T12:20:51.113 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.113 INFO:teuthology.orchestra.run.smithi094.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T12:20:51.113 INFO:teuthology.orchestra.run.smithi094.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T12:20:51.113 INFO:teuthology.orchestra.run.smithi094.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T12:20:51.114 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.114 INFO:teuthology.orchestra.run.smithi094.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T12:20:51.114 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T12:20:51.114 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T12:20:51.114 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.114 INFO:teuthology.orchestra.run.smithi094.stdout: # 1m isn't quite enough 2024-04-25T12:20:51.114 INFO:teuthology.orchestra.run.smithi094.stdout: mon_down_mkfs_grace = 2m 2024-04-25T12:20:51.114 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.114 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_filestore_osds = false 2024-04-25T12:20:51.114 INFO:teuthology.orchestra.run.smithi094.stdout: mon down mkfs grace = 300 2024-04-25T12:20:51.114 INFO:teuthology.orchestra.run.smithi094.stdout: mon op complaint time = 120 2024-04-25T12:20:51.114 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:20:51.114 INFO:teuthology.orchestra.run.smithi094.stdout:[client] 2024-04-25T12:20:51.114 INFO:teuthology.orchestra.run.smithi094.stdout: rgw cache enabled = true 2024-04-25T12:20:51.115 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable ops log = true 2024-04-25T12:20:51.115 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable usage log = true 2024-04-25T12:20:51.115 INFO:teuthology.orchestra.run.smithi094.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T12:20:51.115 INFO:teuthology.orchestra.run.smithi094.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T12:20:51.115 INFO:teuthology.orchestra.run.smithi094.stdout: client mount timeout = 600 2024-04-25T12:20:51.115 INFO:teuthology.orchestra.run.smithi094.stdout: client_shutdown_timeout = 120 2024-04-25T12:20:51.115 INFO:teuthology.orchestra.run.smithi094.stdout: debug client = 20 2024-04-25T12:20:51.115 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-04-25T12:20:51.115 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2024-04-25T12:20:51.115 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2024-04-25T12:20:51.115 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.a] 2024-04-25T12:20:51.115 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.b] 2024-04-25T12:20:51.115 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.c] 2024-04-25T12:20:51.115 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.a] 2024-04-25T12:20:51.116 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.c] 2024-04-25T12:20:51.116 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.e] 2024-04-25T12:20:51.116 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.b] 2024-04-25T12:20:51.116 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.d] 2024-04-25T12:20:51.116 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.f] 2024-04-25T12:20:51.116 INFO:teuthology.orchestra.run.smithi094.stdout:[mds] 2024-04-25T12:20:51.116 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds = 20 2024-04-25T12:20:51.116 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds balancer = 20 2024-04-25T12:20:51.116 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-04-25T12:20:51.116 INFO:teuthology.orchestra.run.smithi094.stdout: mds bal fragment size max = 10000 2024-04-25T12:20:51.116 INFO:teuthology.orchestra.run.smithi094.stdout: mds bal merge size = 5 2024-04-25T12:20:51.116 INFO:teuthology.orchestra.run.smithi094.stdout: mds bal split bits = 3 2024-04-25T12:20:51.116 INFO:teuthology.orchestra.run.smithi094.stdout: mds bal split size = 100 2024-04-25T12:20:51.116 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug frag = True 2024-04-25T12:20:51.116 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug scatterstat = True 2024-04-25T12:20:51.116 INFO:teuthology.orchestra.run.smithi094.stdout: mds oft prefetch dirfrags = True 2024-04-25T12:20:51.117 INFO:teuthology.orchestra.run.smithi094.stdout: mds op complaint time = 180 2024-04-25T12:20:51.117 INFO:teuthology.orchestra.run.smithi094.stdout: mds verify scatter = True 2024-04-25T12:20:51.117 INFO:teuthology.orchestra.run.smithi094.stdout: mds_dir_prefetch = True 2024-04-25T12:20:51.117 INFO:teuthology.orchestra.run.smithi094.stdout: mds_sleep_rank_change = 5000000.0 2024-04-25T12:20:51.117 INFO:teuthology.orchestra.run.smithi094.stdout: mon client directed command retry = 5 2024-04-25T12:20:51.117 INFO:teuthology.orchestra.run.smithi094.stdout: ms inject delay max = 1 2024-04-25T12:20:51.117 INFO:teuthology.orchestra.run.smithi094.stdout: ms inject delay probability = 0.005 2024-04-25T12:20:51.117 INFO:teuthology.orchestra.run.smithi094.stdout: ms inject delay type = client mds osd 2024-04-25T12:20:51.117 INFO:teuthology.orchestra.run.smithi094.stdout: ms inject socket failures = 2500 2024-04-25T12:20:51.117 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2024-04-25T12:20:51.117 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2024-04-25T12:20:51.117 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2024-04-25T12:20:51.119 INFO:teuthology.orchestra.run.smithi111.stdout:[global] 2024-04-25T12:20:51.119 INFO:teuthology.orchestra.run.smithi111.stdout: chdir = "" 2024-04-25T12:20:51.119 INFO:teuthology.orchestra.run.smithi111.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T12:20:51.119 INFO:teuthology.orchestra.run.smithi111.stdout: auth supported = cephx 2024-04-25T12:20:51.119 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.119 INFO:teuthology.orchestra.run.smithi111.stdout: filestore xattr use omap = true 2024-04-25T12:20:51.119 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.119 INFO:teuthology.orchestra.run.smithi111.stdout: mon clock drift allowed = 1.000 2024-04-25T12:20:51.119 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.119 INFO:teuthology.orchestra.run.smithi111.stdout: osd crush chooseleaf type = 0 2024-04-25T12:20:51.119 INFO:teuthology.orchestra.run.smithi111.stdout: auth debug = true 2024-04-25T12:20:51.119 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.119 INFO:teuthology.orchestra.run.smithi111.stdout: ms die on old message = true 2024-04-25T12:20:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: ms die on bug = true 2024-04-25T12:20:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T12:20:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: mon pg warn max object skew = 0 2024-04-25T12:20:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T12:20:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T12:20:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: osd pool default size = 2 2024-04-25T12:20:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd allow primary affinity = true 2024-04-25T12:20:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd allow pg remap = true 2024-04-25T12:20:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on legacy crush tunables = false 2024-04-25T12:20:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on crush straw calc version zero = false 2024-04-25T12:20:51.120 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on no sortbitwise = false 2024-04-25T12:20:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on osd down out interval zero = false 2024-04-25T12:20:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on too few osds = false 2024-04-25T12:20:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T12:20:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T12:20:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: mon_allow_pool_size_one = true 2024-04-25T12:20:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T12:20:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: osd default data pool replay window = 5 2024-04-25T12:20:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: mon allow pool delete = true 2024-04-25T12:20:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: mon cluster log file level = debug 2024-04-25T12:20:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: debug asserts on shutdown = true 2024-04-25T12:20:51.121 INFO:teuthology.orchestra.run.smithi111.stdout: mon health detail to clog = false 2024-04-25T12:20:51.122 INFO:teuthology.orchestra.run.smithi111.stdout: mon host = "172.21.15.94,172.21.15.111,[v2:172.21.15.111:3301,v1:172.21.15.111:6790]" 2024-04-25T12:20:51.122 INFO:teuthology.orchestra.run.smithi111.stdout: fsid = 7059a9e2-aec4-4b84-b942-caf531e15da3 2024-04-25T12:20:51.122 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.122 INFO:teuthology.orchestra.run.smithi111.stdout:[osd] 2024-04-25T12:20:51.122 INFO:teuthology.orchestra.run.smithi111.stdout: osd journal size = 100 2024-04-25T12:20:51.122 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.122 INFO:teuthology.orchestra.run.smithi111.stdout: osd scrub load threshold = 5.0 2024-04-25T12:20:51.122 INFO:teuthology.orchestra.run.smithi111.stdout: osd scrub max interval = 600 2024-04-25T12:20:51.122 INFO:teuthology.orchestra.run.smithi111.stdout: osd mclock profile = high_recovery_ops 2024-04-25T12:20:51.122 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.122 INFO:teuthology.orchestra.run.smithi111.stdout: osd recover clone overlap = true 2024-04-25T12:20:51.122 INFO:teuthology.orchestra.run.smithi111.stdout: osd recovery max chunk = 1048576 2024-04-25T12:20:51.122 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.122 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug shutdown = true 2024-04-25T12:20:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug op order = true 2024-04-25T12:20:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug verify stray on activate = true 2024-04-25T12:20:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug trim objects = true 2024-04-25T12:20:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: osd open classes on start = true 2024-04-25T12:20:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug pg log writeout = true 2024-04-25T12:20:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: osd deep scrub update digest min age = 30 2024-04-25T12:20:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: osd map max advance = 10 2024-04-25T12:20:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: journal zero on create = true 2024-04-25T12:20:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: filestore ondisk finisher threads = 3 2024-04-25T12:20:51.123 INFO:teuthology.orchestra.run.smithi111.stdout: filestore apply finisher threads = 3 2024-04-25T12:20:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: bdev debug aio = true 2024-04-25T12:20:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug misdirected ops = true 2024-04-25T12:20:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore block size = 96636764160 2024-04-25T12:20:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore fsck on mount = True 2024-04-25T12:20:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: debug bluefs = 20 2024-04-25T12:20:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: debug bluestore = 20 2024-04-25T12:20:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-04-25T12:20:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: debug osd = 20 2024-04-25T12:20:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: debug rocksdb = 10 2024-04-25T12:20:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: mon client directed command retry = 5 2024-04-25T12:20:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T12:20:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd full ratio = 0.9 2024-04-25T12:20:51.124 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd nearfull ratio = 0.8 2024-04-25T12:20:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: ms inject delay max = 1 2024-04-25T12:20:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: ms inject delay probability = 0.005 2024-04-25T12:20:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: ms inject delay type = client mds 2024-04-25T12:20:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: ms inject socket failures = 2500 2024-04-25T12:20:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: osd blocked scrub grace period = 3600 2024-04-25T12:20:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: osd failsafe full ratio = 0.95 2024-04-25T12:20:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: osd max markdown count = 1000 2024-04-25T12:20:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: osd objectstore = bluestore 2024-04-25T12:20:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: osd op complaint time = 180 2024-04-25T12:20:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.125 INFO:teuthology.orchestra.run.smithi111.stdout:[mgr] 2024-04-25T12:20:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-04-25T12:20:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: debug mgr = 20 2024-04-25T12:20:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: debug mon = 20 2024-04-25T12:20:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: debug auth = 20 2024-04-25T12:20:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min pgs per osd = 4 2024-04-25T12:20:51.125 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min bytes per osd = 10 2024-04-25T12:20:51.126 INFO:teuthology.orchestra.run.smithi111.stdout: mgr/telemetry/nag = false 2024-04-25T12:20:51.126 INFO:teuthology.orchestra.run.smithi111.stdout: debug client = 20 2024-04-25T12:20:51.126 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.126 INFO:teuthology.orchestra.run.smithi111.stdout:[mon] 2024-04-25T12:20:51.126 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-04-25T12:20:51.126 INFO:teuthology.orchestra.run.smithi111.stdout: debug mon = 20 2024-04-25T12:20:51.126 INFO:teuthology.orchestra.run.smithi111.stdout: debug paxos = 20 2024-04-25T12:20:51.126 INFO:teuthology.orchestra.run.smithi111.stdout: debug auth = 20 2024-04-25T12:20:51.126 INFO:teuthology.orchestra.run.smithi111.stdout: mon data avail warn = 5 2024-04-25T12:20:51.126 INFO:teuthology.orchestra.run.smithi111.stdout: mon mgr mkfs grace = 240 2024-04-25T12:20:51.126 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min pgs per osd = 4 2024-04-25T12:20:51.126 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd reporter subtree level = osd 2024-04-25T12:20:51.126 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd prime pg temp = true 2024-04-25T12:20:51.126 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min bytes per osd = 10 2024-04-25T12:20:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T12:20:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T12:20:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T12:20:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T12:20:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T12:20:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T12:20:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: # 1m isn't quite enough 2024-04-25T12:20:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: mon_down_mkfs_grace = 2m 2024-04-25T12:20:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_filestore_osds = false 2024-04-25T12:20:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: mon down mkfs grace = 300 2024-04-25T12:20:51.127 INFO:teuthology.orchestra.run.smithi111.stdout: mon op complaint time = 120 2024-04-25T12:20:51.128 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T12:20:51.128 INFO:teuthology.orchestra.run.smithi111.stdout:[client] 2024-04-25T12:20:51.128 INFO:teuthology.orchestra.run.smithi111.stdout: rgw cache enabled = true 2024-04-25T12:20:51.128 INFO:teuthology.orchestra.run.smithi111.stdout: rgw enable ops log = true 2024-04-25T12:20:51.128 INFO:teuthology.orchestra.run.smithi111.stdout: rgw enable usage log = true 2024-04-25T12:20:51.128 INFO:teuthology.orchestra.run.smithi111.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T12:20:51.128 INFO:teuthology.orchestra.run.smithi111.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T12:20:51.128 INFO:teuthology.orchestra.run.smithi111.stdout: client mount timeout = 600 2024-04-25T12:20:51.128 INFO:teuthology.orchestra.run.smithi111.stdout: client_shutdown_timeout = 120 2024-04-25T12:20:51.128 INFO:teuthology.orchestra.run.smithi111.stdout: debug client = 20 2024-04-25T12:20:51.128 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-04-25T12:20:51.128 INFO:teuthology.orchestra.run.smithi111.stdout: rados mon op timeout = 900 2024-04-25T12:20:51.128 INFO:teuthology.orchestra.run.smithi111.stdout: rados osd op timeout = 900 2024-04-25T12:20:51.128 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.a] 2024-04-25T12:20:51.128 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.b] 2024-04-25T12:20:51.129 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.c] 2024-04-25T12:20:51.129 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.a] 2024-04-25T12:20:51.129 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.c] 2024-04-25T12:20:51.129 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.e] 2024-04-25T12:20:51.129 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.b] 2024-04-25T12:20:51.129 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.d] 2024-04-25T12:20:51.129 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.f] 2024-04-25T12:20:51.129 INFO:teuthology.orchestra.run.smithi111.stdout:[mds] 2024-04-25T12:20:51.129 INFO:teuthology.orchestra.run.smithi111.stdout: debug mds = 20 2024-04-25T12:20:51.129 INFO:teuthology.orchestra.run.smithi111.stdout: debug mds balancer = 20 2024-04-25T12:20:51.129 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-04-25T12:20:51.129 INFO:teuthology.orchestra.run.smithi111.stdout: mds bal fragment size max = 10000 2024-04-25T12:20:51.129 INFO:teuthology.orchestra.run.smithi111.stdout: mds bal merge size = 5 2024-04-25T12:20:51.129 INFO:teuthology.orchestra.run.smithi111.stdout: mds bal split bits = 3 2024-04-25T12:20:51.129 INFO:teuthology.orchestra.run.smithi111.stdout: mds bal split size = 100 2024-04-25T12:20:51.129 INFO:teuthology.orchestra.run.smithi111.stdout: mds debug frag = True 2024-04-25T12:20:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: mds debug scatterstat = True 2024-04-25T12:20:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: mds oft prefetch dirfrags = True 2024-04-25T12:20:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: mds op complaint time = 180 2024-04-25T12:20:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: mds verify scatter = True 2024-04-25T12:20:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: mds_dir_prefetch = True 2024-04-25T12:20:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: mds_sleep_rank_change = 5000000.0 2024-04-25T12:20:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: mon client directed command retry = 5 2024-04-25T12:20:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: ms inject delay max = 1 2024-04-25T12:20:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: ms inject delay probability = 0.005 2024-04-25T12:20:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: ms inject delay type = client mds osd 2024-04-25T12:20:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: ms inject socket failures = 2500 2024-04-25T12:20:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: osd op complaint time = 180 2024-04-25T12:20:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: rados mon op timeout = 900 2024-04-25T12:20:51.130 INFO:teuthology.orchestra.run.smithi111.stdout: rados osd op timeout = 900 2024-04-25T12:20:51.131 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T12:20:51.131 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T12:20:51.213 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T12:20:51.213 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:20:51.213 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T12:20:51.218 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:20:51.219 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T12:20:51.269 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi094.front.sepia.ceph.com 2024-04-25T12:20:51.269 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:20:51.269 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T12:20:51.269 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T12:20:51.334 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:20:51.334 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:20:51.381 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi111.front.sepia.ceph.com 2024-04-25T12:20:51.381 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T12:20:51.381 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T12:20:51.381 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T12:20:51.405 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T12:20:51.405 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:20:51.453 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T12:20:51.453 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T12:20:51.453 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T12:20:51.496 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T12:20:51.499 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T12:20:51.540 INFO:teuthology.orchestra.run.smithi111.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T12:20:51.564 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T12:20:51.564 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T12:20:51.602 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T12:20:51.605 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T12:20:51.664 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T12:20:51.748 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T12:20:51.751 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T12:20:51.804 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-25T12:20:51.888 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-25T12:20:51.890 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-25T12:20:51.943 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T12:20:51.987 INFO:teuthology.orchestra.run.smithi111.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T12:20:51.990 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T12:20:52.044 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T12:20:52.130 INFO:teuthology.orchestra.run.smithi111.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T12:20:52.133 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-25T12:20:52.188 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-25T12:20:52.270 INFO:teuthology.orchestra.run.smithi111.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-25T12:20:52.273 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-25T12:20:52.332 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T12:20:52.332 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T12:20:52.369 INFO:teuthology.orchestra.run.smithi094.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T12:20:52.379 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T12:20:52.379 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi094.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi111.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T12:20:52.379 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T12:20:52.436 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T12:20:52.436 INFO:tasks.ceph:role: osd.0 2024-04-25T12:20:52.436 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi094.front.sepia.ceph.com 2024-04-25T12:20:52.436 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T12:20:52.493 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T12:20:52.493 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T12:20:52.493 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T12:20:52.493 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T12:20:52.493 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T12:20:52.493 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-04-25T12:20:52.493 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T12:20:52.493 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T12:20:52.493 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T12:20:52.493 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T12:20:52.525 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-04-25T12:20:52.527 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-04-25T12:20:52.527 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T12:20:52.584 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T12:20:52.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:20:52.638 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T12:20:52.638 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T12:20:52.692 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T12:20:52.692 INFO:tasks.ceph:role: osd.1 2024-04-25T12:20:52.692 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi094.front.sepia.ceph.com 2024-04-25T12:20:52.692 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T12:20:52.748 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T12:20:52.748 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T12:20:52.748 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T12:20:52.749 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T12:20:52.749 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T12:20:52.749 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-04-25T12:20:52.749 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T12:20:52.749 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T12:20:52.749 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T12:20:52.749 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T12:20:52.778 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-04-25T12:20:52.779 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-04-25T12:20:52.779 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T12:20:52.838 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T12:20:52.889 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:20:52.889 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T12:20:52.890 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T12:20:52.942 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T12:20:52.942 INFO:tasks.ceph:role: osd.2 2024-04-25T12:20:52.942 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi094.front.sepia.ceph.com 2024-04-25T12:20:52.942 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T12:20:52.997 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T12:20:52.997 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T12:20:52.997 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T12:20:52.997 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T12:20:52.997 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T12:20:52.997 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-04-25T12:20:52.997 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T12:20:52.997 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T12:20:52.997 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T12:20:52.998 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T12:20:53.027 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-04-25T12:20:53.029 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-04-25T12:20:53.029 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T12:20:53.089 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T12:20:53.146 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T12:20:53.147 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:20:53.147 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T12:20:53.199 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T12:20:53.200 INFO:tasks.ceph:role: osd.3 2024-04-25T12:20:53.200 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi094.front.sepia.ceph.com 2024-04-25T12:20:53.200 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T12:20:53.253 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T12:20:53.253 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T12:20:53.253 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T12:20:53.253 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T12:20:53.253 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T12:20:53.253 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-04-25T12:20:53.253 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T12:20:53.253 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T12:20:53.253 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T12:20:53.254 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T12:20:53.284 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-04-25T12:20:53.286 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-04-25T12:20:53.286 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T12:20:53.347 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T12:20:53.397 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:20:53.397 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T12:20:53.397 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:20:53.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:20:53.503+0000 7f89cb89e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T12:20:53.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:20:53.503+0000 7f89cb89e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T12:20:53.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:20:53.503+0000 7f89cb89e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T12:20:53.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:20:53.503+0000 7f89cb89e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T12:20:53.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:20:53.503+0000 7f89cb89e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T12:20:53.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:20:53.503+0000 7f89cb89e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T12:20:56.470 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T12:20:56.484 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:20:56.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:20:56.559+0000 7f099fb4c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T12:20:56.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:20:56.559+0000 7f099fb4c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T12:20:56.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:20:56.559+0000 7f099fb4c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T12:20:56.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:20:56.559+0000 7f099fb4c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T12:20:56.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:20:56.559+0000 7f099fb4c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T12:20:56.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:20:56.559+0000 7f099fb4c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T12:20:59.527 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T12:20:59.581 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:20:59.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:20:59.659+0000 7f536a6ff7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T12:20:59.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:20:59.659+0000 7f536a6ff7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T12:20:59.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:20:59.659+0000 7f536a6ff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T12:20:59.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:20:59.659+0000 7f536a6ff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T12:20:59.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:20:59.659+0000 7f536a6ff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T12:20:59.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:20:59.659+0000 7f536a6ff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T12:21:02.644 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T12:21:02.701 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:21:02.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:02.779+0000 7fe89684d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T12:21:02.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:02.779+0000 7fe89684d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T12:21:02.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:02.779+0000 7fe89684d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T12:21:02.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:02.779+0000 7fe89684d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T12:21:02.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:02.779+0000 7fe89684d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T12:21:02.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:02.779+0000 7fe89684d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T12:21:05.764 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T12:21:05.816 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T12:21:05.830 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T12:21:05.831 INFO:tasks.ceph:role: osd.4 2024-04-25T12:21:05.831 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-25T12:21:05.831 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T12:21:05.893 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T12:21:05.893 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T12:21:05.893 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T12:21:05.893 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T12:21:05.893 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T12:21:05.893 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2024-04-25T12:21:05.893 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T12:21:05.893 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T12:21:05.893 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T12:21:05.893 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T12:21:06.363 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2024-04-25T12:21:06.365 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2024-04-25T12:21:06.366 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T12:21:06.487 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T12:21:06.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:21:06.498 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T12:21:06.499 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T12:21:06.552 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T12:21:06.552 INFO:tasks.ceph:role: osd.5 2024-04-25T12:21:06.553 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-25T12:21:06.553 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T12:21:06.617 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T12:21:06.617 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T12:21:06.617 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T12:21:06.617 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T12:21:06.617 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T12:21:06.617 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2024-04-25T12:21:06.618 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T12:21:06.618 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T12:21:06.618 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T12:21:06.618 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T12:21:07.050 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2024-04-25T12:21:07.052 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2024-04-25T12:21:07.052 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T12:21:07.114 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T12:21:07.165 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T12:21:07.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:21:07.166 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T12:21:07.221 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T12:21:07.221 INFO:tasks.ceph:role: osd.6 2024-04-25T12:21:07.221 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-25T12:21:07.221 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T12:21:07.285 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T12:21:07.285 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T12:21:07.285 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T12:21:07.285 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T12:21:07.285 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T12:21:07.285 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2024-04-25T12:21:07.285 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T12:21:07.285 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T12:21:07.285 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T12:21:07.285 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T12:21:07.735 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2024-04-25T12:21:07.738 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2024-04-25T12:21:07.738 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T12:21:07.828 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T12:21:07.837 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:21:07.838 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T12:21:07.838 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T12:21:07.893 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T12:21:07.893 INFO:tasks.ceph:role: osd.7 2024-04-25T12:21:07.893 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-25T12:21:07.893 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T12:21:07.958 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T12:21:07.958 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T12:21:07.958 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T12:21:07.958 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T12:21:07.958 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T12:21:07.958 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2024-04-25T12:21:07.958 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T12:21:07.958 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T12:21:07.958 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T12:21:07.958 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T12:21:08.416 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2024-04-25T12:21:08.418 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2024-04-25T12:21:08.418 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T12:21:08.569 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T12:21:08.580 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T12:21:08.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:21:08.581 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:21:08.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:08.697+0000 7f7d4ea567c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T12:21:08.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:08.705+0000 7f7d4ea567c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T12:21:08.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:08.705+0000 7f7d4ea567c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T12:21:08.707 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:08.705+0000 7f7d4ea567c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T12:21:08.707 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:08.705+0000 7f7d4ea567c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T12:21:08.711 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:08.709+0000 7f7d4ea567c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T12:21:11.713 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T12:21:11.727 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:21:11.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:11.805+0000 7f751894f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T12:21:11.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:11.805+0000 7f751894f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T12:21:11.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:11.805+0000 7f751894f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T12:21:11.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:11.805+0000 7f751894f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T12:21:11.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:11.805+0000 7f751894f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T12:21:11.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:11.805+0000 7f751894f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T12:21:14.771 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T12:21:14.827 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:21:14.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:14.905+0000 7fc133ff67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T12:21:14.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:14.905+0000 7fc133ff67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T12:21:14.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:14.905+0000 7fc133ff67c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T12:21:14.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:14.905+0000 7fc133ff67c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T12:21:14.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:14.905+0000 7fc133ff67c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T12:21:14.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:14.905+0000 7fc133ff67c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T12:21:17.880 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T12:21:17.937 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:21:18.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:18.017+0000 7ffaa43ce7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T12:21:18.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:18.017+0000 7ffaa43ce7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T12:21:18.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:18.017+0000 7ffaa43ce7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T12:21:18.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:18.017+0000 7ffaa43ce7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T12:21:18.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:18.017+0000 7ffaa43ce7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T12:21:18.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:18.021+0000 7ffaa43ce7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T12:21:19.330 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:21:19.333 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:21:20.991 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T12:21:21.004 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T12:21:21.004 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:21:21.004 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T12:21:21.018 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:21:21.018 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T12:21:21.072 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:21:21.072 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T12:21:21.127 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:21:21.128 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-25T12:21:21.181 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:21:21.181 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T12:21:21.235 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:21:21.236 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T12:21:21.288 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:21:21.288 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T12:21:21.346 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:21:21.347 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T12:21:21.400 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T12:21:21.401 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T12:21:21.414 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T12:21:21.414 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T12:21:21.469 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T12:21:21.469 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-25T12:21:21.528 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T12:21:21.528 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-25T12:21:21.579 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T12:21:21.579 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T12:21:21.631 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T12:21:21.631 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T12:21:21.688 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T12:21:21.688 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T12:21:21.741 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T12:21:21.741 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T12:21:21.795 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:21:21.796 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T12:21:21.801 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T12:21:21.802 DEBUG:teuthology.orchestra.run.smithi094:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T12:21:21.846 DEBUG:teuthology.orchestra.run.smithi111:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T12:21:21.855 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr.y] 2024-04-25T12:21:21.855 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCjSipmZlyoHRAAkdE3HSqbSAlfxK/StxgiWg== 2024-04-25T12:21:21.855 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.a] 2024-04-25T12:21:21.855 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCjSipmv+v3IxAA8cPey+GFKCCmJgcT5VYUSw== 2024-04-25T12:21:21.855 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.c] 2024-04-25T12:21:21.855 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCjSipmKVmnLBAAFicko9mn6ZEicrSe1XwOYA== 2024-04-25T12:21:21.855 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.e] 2024-04-25T12:21:21.855 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCjSipm/kD5NBAA0wSR4eQRxJE34qoWrRaoyQ== 2024-04-25T12:21:21.856 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.0] 2024-04-25T12:21:21.856 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQClSipmWaYwHhAAeS2YtsgLUH0+4pAjlhTEsg== 2024-04-25T12:21:21.856 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.1] 2024-04-25T12:21:21.856 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCoSipmbyadIRAAAkTKWHB3UA+pT6sx3vpV4g== 2024-04-25T12:21:21.856 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.2] 2024-04-25T12:21:21.856 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCrSipm9x16JxAAlOjMSNEQnjlkBbeXlZ0G6g== 2024-04-25T12:21:21.856 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.3] 2024-04-25T12:21:21.856 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCuSipmnJ+2LhAAo1pT0YBnJWwN30f60pC5zw== 2024-04-25T12:21:21.856 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr.x] 2024-04-25T12:21:21.856 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCjSipmx21UIBAA+T9f5pdYxwPHfLnVwVII+Q== 2024-04-25T12:21:21.856 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.b] 2024-04-25T12:21:21.856 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCjSipmgqbtOhAALYe+FVK1j2ap1sb/2Y2gpg== 2024-04-25T12:21:21.857 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.d] 2024-04-25T12:21:21.857 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCkSipmm/zcBxAAYuExwWv6g2ikcnXcYcA9Jg== 2024-04-25T12:21:21.857 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.f] 2024-04-25T12:21:21.857 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCkSipmf+M8EBAAtgwcjJRQsDGLx1uBO7ovVQ== 2024-04-25T12:21:21.857 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.4] 2024-04-25T12:21:21.857 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQC0Sipm2myyKRAAiGCFNzh2TFO3et3dLwsUkQ== 2024-04-25T12:21:21.857 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.5] 2024-04-25T12:21:21.857 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQC3Sipm5QYsMBAAGTfPbMuFQXeLnCSz1PDdQA== 2024-04-25T12:21:21.857 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.6] 2024-04-25T12:21:21.857 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQC6SipmCAYnNhAAxRxLvoqwGiQRP979HJ1ljw== 2024-04-25T12:21:21.857 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.7] 2024-04-25T12:21:21.857 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQC+SipmLjpIARAAhQ9Qnd1K9Cstgg7emqWK7g== 2024-04-25T12:21:21.857 INFO:teuthology.orchestra.run.smithi094.stdout:[client.0] 2024-04-25T12:21:21.858 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCkSipmYAwHFhAA09tkDrRg2X3KWPUKdOR58Q== 2024-04-25T12:21:21.859 INFO:teuthology.orchestra.run.smithi111.stdout:[mgr.y] 2024-04-25T12:21:21.859 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQCjSipmZlyoHRAAkdE3HSqbSAlfxK/StxgiWg== 2024-04-25T12:21:21.859 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.a] 2024-04-25T12:21:21.859 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQCjSipmv+v3IxAA8cPey+GFKCCmJgcT5VYUSw== 2024-04-25T12:21:21.859 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.c] 2024-04-25T12:21:21.859 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQCjSipmKVmnLBAAFicko9mn6ZEicrSe1XwOYA== 2024-04-25T12:21:21.860 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.e] 2024-04-25T12:21:21.860 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQCjSipm/kD5NBAA0wSR4eQRxJE34qoWrRaoyQ== 2024-04-25T12:21:21.860 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.0] 2024-04-25T12:21:21.860 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQClSipmWaYwHhAAeS2YtsgLUH0+4pAjlhTEsg== 2024-04-25T12:21:21.860 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.1] 2024-04-25T12:21:21.860 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQCoSipmbyadIRAAAkTKWHB3UA+pT6sx3vpV4g== 2024-04-25T12:21:21.860 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.2] 2024-04-25T12:21:21.860 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQCrSipm9x16JxAAlOjMSNEQnjlkBbeXlZ0G6g== 2024-04-25T12:21:21.860 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.3] 2024-04-25T12:21:21.860 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQCuSipmnJ+2LhAAo1pT0YBnJWwN30f60pC5zw== 2024-04-25T12:21:21.860 INFO:teuthology.orchestra.run.smithi111.stdout:[mgr.x] 2024-04-25T12:21:21.860 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQCjSipmx21UIBAA+T9f5pdYxwPHfLnVwVII+Q== 2024-04-25T12:21:21.861 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.b] 2024-04-25T12:21:21.861 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQCjSipmgqbtOhAALYe+FVK1j2ap1sb/2Y2gpg== 2024-04-25T12:21:21.861 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.d] 2024-04-25T12:21:21.861 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQCkSipmm/zcBxAAYuExwWv6g2ikcnXcYcA9Jg== 2024-04-25T12:21:21.861 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.f] 2024-04-25T12:21:21.861 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQCkSipmf+M8EBAAtgwcjJRQsDGLx1uBO7ovVQ== 2024-04-25T12:21:21.861 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.4] 2024-04-25T12:21:21.861 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQC0Sipm2myyKRAAiGCFNzh2TFO3et3dLwsUkQ== 2024-04-25T12:21:21.861 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.5] 2024-04-25T12:21:21.861 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQC3Sipm5QYsMBAAGTfPbMuFQXeLnCSz1PDdQA== 2024-04-25T12:21:21.861 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.6] 2024-04-25T12:21:21.861 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQC6SipmCAYnNhAAxRxLvoqwGiQRP979HJ1ljw== 2024-04-25T12:21:21.861 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.7] 2024-04-25T12:21:21.861 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQC+SipmLjpIARAAhQ9Qnd1K9Cstgg7emqWK7g== 2024-04-25T12:21:21.861 INFO:teuthology.orchestra.run.smithi111.stdout:[client.0] 2024-04-25T12:21:21.862 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQCkSipmYAwHFhAA09tkDrRg2X3KWPUKdOR58Q== 2024-04-25T12:21:21.862 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T12:21:21.902 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T12:21:21.946 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:21:21.990 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:21:22.036 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:21:22.039 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:21:22.128 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:21:22.130 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:21:22.172 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:21:22.214 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:21:22.257 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:21:22.259 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:21:22.339 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:21:22.342 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:21:22.419 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:21:22.422 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:21:22.499 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T12:21:22.506 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T12:21:22.582 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:21:22.590 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:21:22.669 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:21:22.678 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:21:22.720 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:21:22.766 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:21:22.805 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:21:22.850 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:21:22.892 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:21:22.930 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:21:22.978 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:21:23.010 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:21:23.063 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:21:23.090 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:21:23.144 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T12:21:23.174 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T12:21:23.236 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T12:21:23.236 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T12:21:23.271 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T12:21:23.363 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T12:21:23.374 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T12:21:23.387 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T12:21:23.476 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T12:21:23.486 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T12:21:23.537 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T12:21:23.629 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T12:21:23.687 DEBUG:teuthology.orchestra.run.smithi094:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:21:23.689 DEBUG:teuthology.orchestra.run.smithi111:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:21:23.732 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T12:21:23.733 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T12:21:23.733 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T12:21:23.738 INFO:tasks.ceph.mon.a:Started 2024-04-25T12:21:23.738 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T12:21:23.738 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T12:21:23.777 INFO:tasks.ceph.mon.b:Started 2024-04-25T12:21:23.778 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T12:21:23.778 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T12:21:23.780 INFO:tasks.ceph.mon.c:Started 2024-04-25T12:21:23.780 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T12:21:23.781 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T12:21:23.781 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T12:21:23.783 INFO:tasks.ceph.mgr.y:Started 2024-04-25T12:21:23.784 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T12:21:23.784 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T12:21:23.786 INFO:tasks.ceph.mgr.x:Started 2024-04-25T12:21:23.786 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T12:21:23.786 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T12:21:23.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:23.898+0000 7f54b468b640 1 Processor -- start 2024-04-25T12:21:23.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:23.898+0000 7f54b468b640 1 -- start start 2024-04-25T12:21:23.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:23.898+0000 7f54b468b640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f54ac159cf0 0x7f54ac071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:23.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:23.898+0000 7f54b468b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f54ac0c6210 0x7f54ac0c6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:23.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:23.898+0000 7f54b468b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54ac0c8080 con 0x7f54ac0c9370 2024-04-25T12:21:23.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:23.898+0000 7f54b468b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f54ac0c5d80 con 0x7f54ac0c6210 2024-04-25T12:21:23.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:23.898+0000 7f54b468b640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f54ac0c8360 con 0x7f54ac159cf0 2024-04-25T12:21:23.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:23.898+0000 7f54b1c26640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f54ac0c6210 0x7f54ac0c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:23.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:23.898+0000 7f54b1c26640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f54ac0c6210 0x7f54ac0c6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59340/0 (socket says 172.21.15.94:59340) 2024-04-25T12:21:23.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:23.898+0000 7f54b1c26640 1 -- 172.21.15.94:0/673018157 learned_addr learned my addr 172.21.15.94:0/673018157 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:23.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:23.898+0000 7f54b2c28640 1 --1- 172.21.15.94:0/673018157 >> v1:172.21.15.94:6789/0 conn(0x7f54ac0c9370 0x7f54ac0cb1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:34942/0 (socket says 172.21.15.94:34942) 2024-04-25T12:21:23.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:23.898+0000 7f54b1c26640 1 -- 172.21.15.94:0/673018157 >> v2:172.21.15.94:3300/0 conn(0x7f54ac0c6210 msgr2=0x7f54ac0c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T12:21:23.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:23.898+0000 7f54b1c26640 1 -- 172.21.15.94:0/673018157 >> v2:172.21.15.94:3300/0 conn(0x7f54ac0c6210 msgr2=0x7f54ac0c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:21:23.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:23.898+0000 7f54b1c26640 1 --2- 172.21.15.94:0/673018157 >> v2:172.21.15.94:3300/0 conn(0x7f54ac0c6210 0x7f54ac0c6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:21:23.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:23.902+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> v2:172.21.15.111:3300/0 conn(0x7f54ac159cf0 0x7f54ac071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:23.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:23.902+0000 7f54b1c26640 1 --2- 172.21.15.94:0/673018157 >> v2:172.21.15.94:3300/0 conn(0x7f54ac0c6210 0x7f54ac0c6630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T12:21:23.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:23.902+0000 7f54b2427640 1 -- 172.21.15.94:0/673018157 >> v2:172.21.15.111:3300/0 conn(0x7f54ac159cf0 msgr2=0x7f54ac071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T12:21:23.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:23.902+0000 7f54b2427640 1 -- 172.21.15.94:0/673018157 >> v2:172.21.15.111:3300/0 conn(0x7f54ac159cf0 msgr2=0x7f54ac071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:21:23.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:23.902+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> v2:172.21.15.111:3300/0 conn(0x7f54ac159cf0 0x7f54ac071530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:21:23.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:23.902+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> v2:172.21.15.111:3300/0 conn(0x7f54ac159cf0 0x7f54ac071530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T12:21:24.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:24.106+0000 7f54b1c26640 1 --2- 172.21.15.94:0/673018157 >> v2:172.21.15.94:3300/0 conn(0x7f54ac0c6210 0x7f54ac0c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:24.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:24.106+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> v2:172.21.15.111:3300/0 conn(0x7f54ac159cf0 0x7f54ac071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:24.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:24.106+0000 7f54b1c26640 1 -- 172.21.15.94:0/673018157 >> v2:172.21.15.94:3300/0 conn(0x7f54ac0c6210 msgr2=0x7f54ac0c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T12:21:24.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:24.106+0000 7f54b1c26640 1 -- 172.21.15.94:0/673018157 >> v2:172.21.15.94:3300/0 conn(0x7f54ac0c6210 msgr2=0x7f54ac0c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:21:24.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:24.106+0000 7f54b1c26640 1 --2- 172.21.15.94:0/673018157 >> v2:172.21.15.94:3300/0 conn(0x7f54ac0c6210 0x7f54ac0c6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:21:24.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:24.106+0000 7f54b1c26640 1 --2- 172.21.15.94:0/673018157 >> v2:172.21.15.94:3300/0 conn(0x7f54ac0c6210 0x7f54ac0c6630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T12:21:24.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:24.106+0000 7f54b2427640 1 -- 172.21.15.94:0/673018157 >> v2:172.21.15.111:3300/0 conn(0x7f54ac159cf0 msgr2=0x7f54ac071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T12:21:24.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:24.106+0000 7f54b2427640 1 -- 172.21.15.94:0/673018157 >> v2:172.21.15.111:3300/0 conn(0x7f54ac159cf0 msgr2=0x7f54ac071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:21:24.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:24.106+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> v2:172.21.15.111:3300/0 conn(0x7f54ac159cf0 0x7f54ac071530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:21:24.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:24.106+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> v2:172.21.15.111:3300/0 conn(0x7f54ac159cf0 0x7f54ac071530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T12:21:24.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:24.510+0000 7f54b1c26640 1 --2- 172.21.15.94:0/673018157 >> v2:172.21.15.94:3300/0 conn(0x7f54ac0c6210 0x7f54ac0c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:24.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:24.510+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> v2:172.21.15.111:3300/0 conn(0x7f54ac159cf0 0x7f54ac071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:24.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:24.510+0000 7f54b1c26640 1 -- 172.21.15.94:0/673018157 >> v2:172.21.15.94:3300/0 conn(0x7f54ac0c6210 msgr2=0x7f54ac0c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T12:21:24.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:24.510+0000 7f54b1c26640 1 -- 172.21.15.94:0/673018157 >> v2:172.21.15.94:3300/0 conn(0x7f54ac0c6210 msgr2=0x7f54ac0c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:21:24.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:24.510+0000 7f54b1c26640 1 --2- 172.21.15.94:0/673018157 >> v2:172.21.15.94:3300/0 conn(0x7f54ac0c6210 0x7f54ac0c6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:21:24.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:24.510+0000 7f54b2427640 1 -- 172.21.15.94:0/673018157 >> v2:172.21.15.111:3300/0 conn(0x7f54ac159cf0 msgr2=0x7f54ac071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T12:21:24.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:24.510+0000 7f54b2427640 1 -- 172.21.15.94:0/673018157 >> v2:172.21.15.111:3300/0 conn(0x7f54ac159cf0 msgr2=0x7f54ac071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:21:24.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:24.510+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> v2:172.21.15.111:3300/0 conn(0x7f54ac159cf0 0x7f54ac071530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:21:24.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:24.510+0000 7f54b1c26640 1 --2- 172.21.15.94:0/673018157 >> v2:172.21.15.94:3300/0 conn(0x7f54ac0c6210 0x7f54ac0c6630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T12:21:24.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:24.510+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> v2:172.21.15.111:3300/0 conn(0x7f54ac159cf0 0x7f54ac071530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T12:21:25.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:25.314+0000 7f54b1c26640 1 --2- 172.21.15.94:0/673018157 >> v2:172.21.15.94:3300/0 conn(0x7f54ac0c6210 0x7f54ac0c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:25.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:25.314+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> v2:172.21.15.111:3300/0 conn(0x7f54ac159cf0 0x7f54ac071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:25.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:25.314+0000 7f54b1c26640 1 -- 172.21.15.94:0/673018157 >> v2:172.21.15.94:3300/0 conn(0x7f54ac0c6210 msgr2=0x7f54ac0c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T12:21:25.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:25.314+0000 7f54b1c26640 1 -- 172.21.15.94:0/673018157 >> v2:172.21.15.94:3300/0 conn(0x7f54ac0c6210 msgr2=0x7f54ac0c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:21:25.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:25.314+0000 7f54b1c26640 1 --2- 172.21.15.94:0/673018157 >> v2:172.21.15.94:3300/0 conn(0x7f54ac0c6210 0x7f54ac0c6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:21:25.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:25.314+0000 7f54b2427640 1 -- 172.21.15.94:0/673018157 >> v2:172.21.15.111:3300/0 conn(0x7f54ac159cf0 msgr2=0x7f54ac071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T12:21:25.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:25.314+0000 7f54b2427640 1 -- 172.21.15.94:0/673018157 >> v2:172.21.15.111:3300/0 conn(0x7f54ac159cf0 msgr2=0x7f54ac071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:21:25.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:25.314+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> v2:172.21.15.111:3300/0 conn(0x7f54ac159cf0 0x7f54ac071530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:21:25.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:25.314+0000 7f54b1c26640 1 --2- 172.21.15.94:0/673018157 >> v2:172.21.15.94:3300/0 conn(0x7f54ac0c6210 0x7f54ac0c6630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T12:21:25.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:25.314+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> v2:172.21.15.111:3300/0 conn(0x7f54ac159cf0 0x7f54ac071530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T12:21:26.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:26.898+0000 7f549ffff640 1 -- 172.21.15.94:0/673018157 >> v2:172.21.15.111:3300/0 conn(0x7f54ac159cf0 msgr2=0x7f54ac071530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T12:21:26.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:26.898+0000 7f549ffff640 1 --2- 172.21.15.94:0/673018157 >> v2:172.21.15.111:3300/0 conn(0x7f54ac159cf0 0x7f54ac071530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:26.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:26.898+0000 7f549ffff640 1 -- 172.21.15.94:0/673018157 >> v2:172.21.15.94:3300/0 conn(0x7f54ac0c6210 msgr2=0x7f54ac0c6630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T12:21:26.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:26.898+0000 7f549ffff640 1 --2- 172.21.15.94:0/673018157 >> v2:172.21.15.94:3300/0 conn(0x7f54ac0c6210 0x7f54ac0c6630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:26.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:26.898+0000 7f549ffff640 1 -- 172.21.15.94:0/673018157 >> v1:172.21.15.94:6789/0 conn(0x7f54ac0c9370 legacy=0x7f54ac0cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:26.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:26.898+0000 7f549ffff640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 0x7f5490005ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:26.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:26.902+0000 7f549ffff640 1 -- 172.21.15.94:0/673018157 --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54ac0c8640 con 0x7f54900061f0 2024-04-25T12:21:26.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:26.902+0000 7f549ffff640 1 -- 172.21.15.94:0/673018157 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f54ac0c5d80 con 0x7f54900036c0 2024-04-25T12:21:26.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:26.902+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 0x7f5490005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:26.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:26.902+0000 7f54b2427640 1 -- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 msgr2=0x7f5490005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T12:21:26.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:26.902+0000 7f54b2427640 1 -- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 msgr2=0x7f5490005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:21:26.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:26.902+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 0x7f5490005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:21:26.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:26.902+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 0x7f5490005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T12:21:27.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:27.106+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 0x7f5490005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:27.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:27.106+0000 7f54b2427640 1 -- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 msgr2=0x7f5490005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T12:21:27.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:27.106+0000 7f54b2427640 1 -- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 msgr2=0x7f5490005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:21:27.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:27.106+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 0x7f5490005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:21:27.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:27.106+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 0x7f5490005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T12:21:27.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:27.510+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 0x7f5490005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:27.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:27.510+0000 7f54b2427640 1 -- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 msgr2=0x7f5490005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T12:21:27.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:27.510+0000 7f54b2427640 1 -- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 msgr2=0x7f5490005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:21:27.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:27.510+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 0x7f5490005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:21:27.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:27.510+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 0x7f5490005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T12:21:28.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:28.314+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 0x7f5490005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:28.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:28.314+0000 7f54b2427640 1 -- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 msgr2=0x7f5490005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T12:21:28.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:28.314+0000 7f54b2427640 1 -- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 msgr2=0x7f5490005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:21:28.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:28.314+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 0x7f5490005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:21:28.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:28.314+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 0x7f5490005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T12:21:29.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.146+0000 7f54b1425640 1 -- 172.21.15.94:0/673018157 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 192795706 0 0) 0x7f54ac0c8640 con 0x7f54900061f0 2024-04-25T12:21:29.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.146+0000 7f54b1425640 1 -- 172.21.15.94:0/673018157 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5498003530 con 0x7f54900061f0 2024-04-25T12:21:29.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.150+0000 7f54b1425640 1 -- 172.21.15.94:0/673018157 <== mon.1 v1:172.21.15.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2715271485 0 0) 0x7f5498003530 con 0x7f54900061f0 2024-04-25T12:21:29.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.150+0000 7f54b1425640 1 -- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 msgr2=0x7f5490005ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T12:21:29.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.150+0000 7f54b1425640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 0x7f5490005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.150+0000 7f54b1425640 1 -- 172.21.15.94:0/673018157 --> v1:172.21.15.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f549000b080 con 0x7f54900061f0 2024-04-25T12:21:29.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.150+0000 7f54b1425640 1 -- 172.21.15.94:0/673018157 <== mon.1 v1:172.21.15.111:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7f54a800f040 con 0x7f54900061f0 2024-04-25T12:21:29.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.150+0000 7f54b1425640 1 -- 172.21.15.94:0/673018157 >> v1:172.21.15.111:6789/0 conn(0x7f54900061f0 legacy=0x7f5490008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.150+0000 7f54b2c28640 1 -- 172.21.15.94:0/673018157 reap_dead start 2024-04-25T12:21:29.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.150+0000 7f54b1425640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 0x7f54980039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.150+0000 7f54b1425640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5498004020 0x7f5498004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.150+0000 7f54b1425640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5498004da0 0x7f5498005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.150+0000 7f54b1425640 1 -- 172.21.15.94:0/673018157 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac0c5d80 con 0x7f5498004da0 2024-04-25T12:21:29.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.150+0000 7f54b1425640 1 -- 172.21.15.94:0/673018157 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f549800bcb0 con 0x7f5498004020 2024-04-25T12:21:29.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.150+0000 7f54b1425640 1 -- 172.21.15.94:0/673018157 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f549800beb0 con 0x7f54900036c0 2024-04-25T12:21:29.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.150+0000 7f54b2c28640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5498004da0 0x7f5498005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.150+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 0x7f54980039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.150+0000 7f54b1c26640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5498004020 0x7f5498004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.154+0000 7f54b2427640 1 -- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5498004020 msgr2=0x7f5498004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:29.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.154+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5498004020 0x7f5498004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.154+0000 7f54b2427640 1 -- 172.21.15.94:0/673018157 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5498004da0 msgr2=0x7f5498005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:29.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.154+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5498004da0 0x7f5498005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.154+0000 7f54b2427640 1 -- 172.21.15.94:0/673018157 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5498003530 con 0x7f54900036c0 2024-04-25T12:21:29.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.158+0000 7f54b2427640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 0x7f54980039c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f54a0000ee0 tx=0x7f54a001da70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b7d6f73824cac83 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:29.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.158+0000 7f54b1425640 1 -- 172.21.15.94:0/673018157 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a00b3070 con 0x7f54900036c0 2024-04-25T12:21:29.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.158+0000 7f54b1425640 1 -- 172.21.15.94:0/673018157 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a00a69b0 con 0x7f54900036c0 2024-04-25T12:21:29.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.158+0000 7f54b1425640 1 -- 172.21.15.94:0/673018157 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a000f040 con 0x7f54900036c0 2024-04-25T12:21:29.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.162+0000 7f54b468b640 1 -- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 msgr2=0x7f54980039c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.162+0000 7f54b468b640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 0x7f54980039c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f54a0000ee0 tx=0x7f54a001da70 comp rx=0 tx=0).stop 2024-04-25T12:21:29.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.162+0000 7f54b468b640 1 -- 172.21.15.94:0/673018157 shutdown_connections 2024-04-25T12:21:29.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.162+0000 7f54b468b640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5498004da0 0x7f5498005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.162+0000 7f54b468b640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5498004020 0x7f5498004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.162+0000 7f54b468b640 1 --2- 172.21.15.94:0/673018157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 0x7f54980039c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.162+0000 7f54b468b640 1 -- 172.21.15.94:0/673018157 >> 172.21.15.94:0/673018157 conn(0x7f54ac0676a0 msgr2=0x7f54ac067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:29.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.162+0000 7f54b468b640 1 -- 172.21.15.94:0/673018157 shutdown_connections 2024-04-25T12:21:29.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.162+0000 7f54b468b640 1 -- 172.21.15.94:0/673018157 wait complete. 2024-04-25T12:21:29.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.162+0000 7f54b468b640 1 Processor -- start 2024-04-25T12:21:29.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.162+0000 7f54b468b640 1 -- start start 2024-04-25T12:21:29.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.162+0000 7f54b468b640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 0x7f54ac1ef0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.162+0000 7f54b468b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5498004020 0x7f54ac0cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.162+0000 7f54b468b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5498004da0 0x7f54ac1546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.162+0000 7f54b468b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac158f80 con 0x7f5498004020 2024-04-25T12:21:29.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.162+0000 7f54b468b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac0c8c00 con 0x7f5498004da0 2024-04-25T12:21:29.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.162+0000 7f54b468b640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f54ac0c6630 con 0x7f54900036c0 2024-04-25T12:21:29.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.162+0000 7f54b1c26640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5498004020 0x7f54ac0cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.162+0000 7f54b1c26640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5498004020 0x7f54ac0cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59398/0 (socket says 172.21.15.94:59398) 2024-04-25T12:21:29.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.162+0000 7f54b2427640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 0x7f54ac1ef0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.162+0000 7f54b1c26640 1 -- 172.21.15.94:0/1160120641 learned_addr learned my addr 172.21.15.94:0/1160120641 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:29.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.162+0000 7f54b2c28640 1 --2- 172.21.15.94:0/1160120641 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5498004da0 0x7f54ac1546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.166+0000 7f54b2427640 1 -- 172.21.15.94:0/1160120641 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5498004da0 msgr2=0x7f54ac1546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.166+0000 7f54b2427640 1 --2- 172.21.15.94:0/1160120641 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5498004da0 0x7f54ac1546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.166+0000 7f54b2427640 1 -- 172.21.15.94:0/1160120641 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5498004020 msgr2=0x7f54ac0cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.166+0000 7f54b2427640 1 --2- 172.21.15.94:0/1160120641 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5498004020 0x7f54ac0cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.166+0000 7f54b2427640 1 -- 172.21.15.94:0/1160120641 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ac14d030 con 0x7f54900036c0 2024-04-25T12:21:29.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.166+0000 7f54b2c28640 1 --2- 172.21.15.94:0/1160120641 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5498004da0 0x7f54ac1546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:21:29.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.166+0000 7f54b1c26640 1 --2- 172.21.15.94:0/1160120641 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5498004020 0x7f54ac0cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:21:29.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.166+0000 7f54b2427640 1 --2- 172.21.15.94:0/1160120641 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 0x7f54ac1ef0b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f54a00ad000 tx=0x7f5498005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:29.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.166+0000 7f549effd640 1 -- 172.21.15.94:0/1160120641 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a00bf020 con 0x7f54900036c0 2024-04-25T12:21:29.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.166+0000 7f549effd640 1 -- 172.21.15.94:0/1160120641 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a00ae640 con 0x7f54900036c0 2024-04-25T12:21:29.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.166+0000 7f54b468b640 1 -- 172.21.15.94:0/1160120641 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54ac15be40 con 0x7f54900036c0 2024-04-25T12:21:29.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.166+0000 7f549effd640 1 -- 172.21.15.94:0/1160120641 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a00b3040 con 0x7f54900036c0 2024-04-25T12:21:29.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.166+0000 7f54b468b640 1 -- 172.21.15.94:0/1160120641 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f54ac1e4070 con 0x7f54900036c0 2024-04-25T12:21:29.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.166+0000 7f549effd640 1 -- 172.21.15.94:0/1160120641 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f54a00c2070 con 0x7f54900036c0 2024-04-25T12:21:29.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.166+0000 7f549effd640 1 -- 172.21.15.94:0/1160120641 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f54a00c4aa0 con 0x7f54900036c0 2024-04-25T12:21:29.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.166+0000 7f54b468b640 1 -- 172.21.15.94:0/1160120641 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54ac075df0 con 0x7f54900036c0 2024-04-25T12:21:29.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.170+0000 7f549effd640 1 -- 172.21.15.94:0/1160120641 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f54a00c9020 con 0x7f54900036c0 2024-04-25T12:21:29.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.234+0000 7f54b468b640 1 -- 172.21.15.94:0/1160120641 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f54ac0c9150 con 0x7f54900036c0 2024-04-25T12:21:29.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.242+0000 7f549effd640 1 -- 172.21.15.94:0/1160120641 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f54a00085b0 con 0x7f54900036c0 2024-04-25T12:21:29.247 INFO:teuthology.orchestra.run.smithi094.stderr:adjusted tunables profile to default 2024-04-25T12:21:29.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.242+0000 7f54b468b640 1 -- 172.21.15.94:0/1160120641 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 msgr2=0x7f54ac1ef0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.242+0000 7f54b468b640 1 --2- 172.21.15.94:0/1160120641 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 0x7f54ac1ef0b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f54a00ad000 tx=0x7f5498005840 comp rx=0 tx=0).stop 2024-04-25T12:21:29.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.242+0000 7f54b468b640 1 -- 172.21.15.94:0/1160120641 shutdown_connections 2024-04-25T12:21:29.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.242+0000 7f54b468b640 1 --2- 172.21.15.94:0/1160120641 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5498004da0 0x7f54ac1546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.242+0000 7f54b468b640 1 --2- 172.21.15.94:0/1160120641 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5498004020 0x7f54ac0cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.242+0000 7f54b468b640 1 --2- 172.21.15.94:0/1160120641 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54900036c0 0x7f54ac1ef0b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.242+0000 7f54b468b640 1 -- 172.21.15.94:0/1160120641 >> 172.21.15.94:0/1160120641 conn(0x7f54ac0676a0 msgr2=0x7f54ac14f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:29.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.242+0000 7f54b468b640 1 -- 172.21.15.94:0/1160120641 shutdown_connections 2024-04-25T12:21:29.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:29.242+0000 7f54b468b640 1 -- 172.21.15.94:0/1160120641 wait complete. 2024-04-25T12:21:29.266 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T12:21:29.266 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T12:21:29.266 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:21:29.266 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T12:21:29.277 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:21:29.277 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T12:21:29.331 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:21:29.331 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T12:21:29.349 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T12:21:29.349+0000 7fd613c8a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T12:21:29.368 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T12:21:29.362+0000 7f69abb1c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T12:21:29.379 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:21:29.379 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T12:21:29.432 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T12:21:29.432 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T12:21:29.445 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T12:21:29.445 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T12:21:29.500 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T12:21:29.500 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T12:21:29.556 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T12:21:29.556 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T12:21:29.607 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd new 640a65ef-0734-468a-a8f5-9ed70cf75c1b 0 2024-04-25T12:21:29.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.769+0000 7f2f672e3640 1 Processor -- start 2024-04-25T12:21:29.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.769+0000 7f2f672e3640 1 -- start start 2024-04-25T12:21:29.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.769+0000 7f2f672e3640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f2f601443d0 0x7f2f600c8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.769+0000 7f2f672e3640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2f60070530 0x7f2f6015ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.769+0000 7f2f672e3640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f6015e730 con 0x7f2f6006cee0 2024-04-25T12:21:29.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.769+0000 7f2f672e3640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f2f6015ea10 con 0x7f2f60070530 2024-04-25T12:21:29.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.769+0000 7f2f672e3640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f2f6015ecf0 con 0x7f2f601443d0 2024-04-25T12:21:29.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.769+0000 7f2f6507f640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f2f601443d0 0x7f2f600c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.769+0000 7f2f6507f640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f2f601443d0 0x7f2f600c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56738/0 (socket says 172.21.15.111:56738) 2024-04-25T12:21:29.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.769+0000 7f2f6507f640 1 -- 172.21.15.111:0/827049981 learned_addr learned my addr 172.21.15.111:0/827049981 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T12:21:29.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.769+0000 7f2f6487e640 1 --2- 172.21.15.111:0/827049981 >> v2:172.21.15.94:3300/0 conn(0x7f2f60070530 0x7f2f6015ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.769+0000 7f2f6507f640 1 -- 172.21.15.111:0/827049981 >> v2:172.21.15.94:3300/0 conn(0x7f2f60070530 msgr2=0x7f2f6015ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:29.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.769+0000 7f2f6507f640 1 --2- 172.21.15.111:0/827049981 >> v2:172.21.15.94:3300/0 conn(0x7f2f60070530 0x7f2f6015ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.769+0000 7f2f6507f640 1 -- 172.21.15.111:0/827049981 >> v1:172.21.15.94:6789/0 conn(0x7f2f6006cee0 legacy=0x7f2f60072280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:29.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.769+0000 7f2f6507f640 1 -- 172.21.15.111:0/827049981 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f6015efd0 con 0x7f2f601443d0 2024-04-25T12:21:29.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.773+0000 7f2f6507f640 1 --2- 172.21.15.111:0/827049981 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f601443d0 0x7f2f600c8040 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2f6006d990 tx=0x7f2f5801c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=213cf11f4b01355a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:29.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.773+0000 7f2f57fff640 1 -- 172.21.15.111:0/827049981 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f580ab5f0 con 0x7f2f601443d0 2024-04-25T12:21:29.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.773+0000 7f2f57fff640 1 -- 172.21.15.111:0/827049981 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f580b0070 con 0x7f2f601443d0 2024-04-25T12:21:29.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.773+0000 7f2f57fff640 1 -- 172.21.15.111:0/827049981 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f580ab9b0 con 0x7f2f601443d0 2024-04-25T12:21:29.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.773+0000 7f2f672e3640 1 -- 172.21.15.111:0/827049981 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f601443d0 msgr2=0x7f2f600c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.773+0000 7f2f672e3640 1 --2- 172.21.15.111:0/827049981 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f601443d0 0x7f2f600c8040 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2f6006d990 tx=0x7f2f5801c4e0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.773+0000 7f2f672e3640 1 -- 172.21.15.111:0/827049981 shutdown_connections 2024-04-25T12:21:29.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.773+0000 7f2f672e3640 1 --2- 172.21.15.111:0/827049981 >> v2:172.21.15.94:3300/0 conn(0x7f2f60070530 0x7f2f6015ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.773+0000 7f2f672e3640 1 --2- 172.21.15.111:0/827049981 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f601443d0 0x7f2f600c8040 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.773+0000 7f2f672e3640 1 -- 172.21.15.111:0/827049981 >> 172.21.15.111:0/827049981 conn(0x7f2f600ca540 msgr2=0x7f2f600ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:29.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.773+0000 7f2f672e3640 1 -- 172.21.15.111:0/827049981 shutdown_connections 2024-04-25T12:21:29.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.773+0000 7f2f672e3640 1 -- 172.21.15.111:0/827049981 wait complete. 2024-04-25T12:21:29.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f672e3640 1 Processor -- start 2024-04-25T12:21:29.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f672e3640 1 -- start start 2024-04-25T12:21:29.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f672e3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f6006cee0 0x7f2f60155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f672e3640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f60070530 0x7f2f60153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f672e3640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2f601443d0 0x7f2f60152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f672e3640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2f601684f0 con 0x7f2f6006cee0 2024-04-25T12:21:29.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f672e3640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2f60168370 con 0x7f2f60070530 2024-04-25T12:21:29.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f672e3640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2f60168670 con 0x7f2f601443d0 2024-04-25T12:21:29.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f6487e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f60070530 0x7f2f60153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f6487e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f60070530 0x7f2f60153600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56746/0 (socket says 172.21.15.111:56746) 2024-04-25T12:21:29.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f6487e640 1 -- 172.21.15.111:0/3836321913 learned_addr learned my addr 172.21.15.111:0/3836321913 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T12:21:29.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f65880640 1 --2- 172.21.15.111:0/3836321913 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2f601443d0 0x7f2f60152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f6507f640 1 --2- 172.21.15.111:0/3836321913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f6006cee0 0x7f2f60155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f6487e640 1 -- 172.21.15.111:0/3836321913 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2f601443d0 msgr2=0x7f2f60152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f6487e640 1 --2- 172.21.15.111:0/3836321913 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2f601443d0 0x7f2f60152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f6487e640 1 -- 172.21.15.111:0/3836321913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f6006cee0 msgr2=0x7f2f60155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f6487e640 1 --2- 172.21.15.111:0/3836321913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f6006cee0 0x7f2f60155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f6487e640 1 -- 172.21.15.111:0/3836321913 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f60152bc0 con 0x7f2f60070530 2024-04-25T12:21:29.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f65880640 1 --2- 172.21.15.111:0/3836321913 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2f601443d0 0x7f2f60152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:21:29.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f6507f640 1 --2- 172.21.15.111:0/3836321913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f6006cee0 0x7f2f60155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:21:29.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f6487e640 1 --2- 172.21.15.111:0/3836321913 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f60070530 0x7f2f60153600 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2f5000d630 tx=0x7f2f5000daf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:29.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f55ffb640 1 -- 172.21.15.111:0/3836321913 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f50004240 con 0x7f2f60070530 2024-04-25T12:21:29.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f55ffb640 1 -- 172.21.15.111:0/3836321913 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f500043e0 con 0x7f2f60070530 2024-04-25T12:21:29.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f672e3640 1 -- 172.21.15.111:0/3836321913 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f601566a0 con 0x7f2f60070530 2024-04-25T12:21:29.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f55ffb640 1 -- 172.21.15.111:0/3836321913 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f50003840 con 0x7f2f60070530 2024-04-25T12:21:29.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f672e3640 1 -- 172.21.15.111:0/3836321913 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f6013ef20 con 0x7f2f60070530 2024-04-25T12:21:29.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f55ffb640 1 -- 172.21.15.111:0/3836321913 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2f500039e0 con 0x7f2f60070530 2024-04-25T12:21:29.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f55ffb640 1 -- 172.21.15.111:0/3836321913 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f2f5001d740 con 0x7f2f60070530 2024-04-25T12:21:29.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.777+0000 7f2f672e3640 1 -- 172.21.15.111:0/3836321913 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f60075df0 con 0x7f2f60070530 2024-04-25T12:21:29.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.781+0000 7f2f55ffb640 1 -- 172.21.15.111:0/3836321913 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f2f50012ce0 con 0x7f2f60070530 2024-04-25T12:21:29.808 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T12:21:29.802+0000 7f69abb1c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T12:21:29.849 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T12:21:29.849+0000 7fd613c8a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T12:21:29.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.849+0000 7f2f672e3640 1 -- 172.21.15.111:0/3836321913 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd new", "uuid": "640a65ef-0734-468a-a8f5-9ed70cf75c1b", "id": 0} v 0) -- 0x7f2f601654d0 con 0x7f2f60070530 2024-04-25T12:21:29.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.853+0000 7f2f55ffb640 1 -- 172.21.15.111:0/3836321913 <== mon.1 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "640a65ef-0734-468a-a8f5-9ed70cf75c1b", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f2f50012420 con 0x7f2f60070530 2024-04-25T12:21:29.855 INFO:teuthology.orchestra.run.smithi111.stdout:0 2024-04-25T12:21:29.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.853+0000 7f2f672e3640 1 -- 172.21.15.111:0/3836321913 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f60070530 msgr2=0x7f2f60153600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.853+0000 7f2f672e3640 1 --2- 172.21.15.111:0/3836321913 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f60070530 0x7f2f60153600 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2f5000d630 tx=0x7f2f5000daf0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.853+0000 7f2f672e3640 1 -- 172.21.15.111:0/3836321913 shutdown_connections 2024-04-25T12:21:29.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.853+0000 7f2f672e3640 1 --2- 172.21.15.111:0/3836321913 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2f601443d0 0x7f2f60152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.853+0000 7f2f672e3640 1 --2- 172.21.15.111:0/3836321913 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f60070530 0x7f2f60153600 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.853+0000 7f2f672e3640 1 --2- 172.21.15.111:0/3836321913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f6006cee0 0x7f2f60155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.853+0000 7f2f672e3640 1 -- 172.21.15.111:0/3836321913 >> 172.21.15.111:0/3836321913 conn(0x7f2f600ca540 msgr2=0x7f2f6015c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:29.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.853+0000 7f2f672e3640 1 -- 172.21.15.111:0/3836321913 shutdown_connections 2024-04-25T12:21:29.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.853+0000 7f2f672e3640 1 -- 172.21.15.111:0/3836321913 wait complete. 2024-04-25T12:21:29.872 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd new d6e886e6-c8c1-4761-9a4c-abc6961c7c81 1 2024-04-25T12:21:29.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.981+0000 7f0a9a2d8640 1 Processor -- start 2024-04-25T12:21:29.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.981+0000 7f0a9a2d8640 1 -- start start 2024-04-25T12:21:29.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.981+0000 7f0a9a2d8640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f0a94151f40 0x7f0a94157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.981+0000 7f0a9a2d8640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a94158210 con 0x7f0a9415bf40 2024-04-25T12:21:29.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.981+0000 7f0a9a2d8640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a9406d550 con 0x7f0a9406cff0 2024-04-25T12:21:29.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.981+0000 7f0a9a2d8640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f0a9415bab0 con 0x7f0a94151f40 2024-04-25T12:21:29.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.981+0000 7f0a93fff640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f0a94151f40 0x7f0a94157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.981+0000 7f0a93fff640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f0a94151f40 0x7f0a94157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56756/0 (socket says 172.21.15.111:56756) 2024-04-25T12:21:29.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.981+0000 7f0a93fff640 1 -- 172.21.15.111:0/572717940 learned_addr learned my addr 172.21.15.111:0/572717940 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T12:21:29.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.981+0000 7f0a93fff640 1 -- 172.21.15.111:0/572717940 >> v1:172.21.15.111:6789/0 conn(0x7f0a9406cff0 legacy=0x7f0a940c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.981+0000 7f0a93fff640 1 -- 172.21.15.111:0/572717940 >> v1:172.21.15.94:6789/0 conn(0x7f0a9415bf40 legacy=0x7f0a94162650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:29.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.981+0000 7f0a93fff640 1 -- 172.21.15.111:0/572717940 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9406d830 con 0x7f0a94151f40 2024-04-25T12:21:29.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a93fff640 1 --2- 172.21.15.111:0/572717940 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a94151f40 0x7f0a94157cd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0a94070c80 tx=0x7f0a840213a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91fb449946bec228 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:29.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a937fe640 1 -- 172.21.15.111:0/572717940 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a840b6070 con 0x7f0a94151f40 2024-04-25T12:21:29.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a937fe640 1 -- 172.21.15.111:0/572717940 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a840b1600 con 0x7f0a94151f40 2024-04-25T12:21:29.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a937fe640 1 -- 172.21.15.111:0/572717940 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a840b19d0 con 0x7f0a94151f40 2024-04-25T12:21:29.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a9a2d8640 1 -- 172.21.15.111:0/572717940 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a94151f40 msgr2=0x7f0a94157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a9a2d8640 1 --2- 172.21.15.111:0/572717940 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a94151f40 0x7f0a94157cd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0a94070c80 tx=0x7f0a840213a0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a9a2d8640 1 -- 172.21.15.111:0/572717940 shutdown_connections 2024-04-25T12:21:29.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a9a2d8640 1 --2- 172.21.15.111:0/572717940 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a94151f40 0x7f0a94157cd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a9a2d8640 1 -- 172.21.15.111:0/572717940 >> 172.21.15.111:0/572717940 conn(0x7f0a940ca540 msgr2=0x7f0a940ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:29.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a9a2d8640 1 -- 172.21.15.111:0/572717940 shutdown_connections 2024-04-25T12:21:29.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a9a2d8640 1 -- 172.21.15.111:0/572717940 wait complete. 2024-04-25T12:21:29.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a9a2d8640 1 Processor -- start 2024-04-25T12:21:29.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a9a2d8640 1 -- start start 2024-04-25T12:21:29.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a9a2d8640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a9406cff0 0x7f0a941ede50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a9a2d8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a94151f40 0x7f0a94148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a9a2d8640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0a9415bf40 0x7f0a94148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:29.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a9a2d8640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0a94152320 con 0x7f0a94151f40 2024-04-25T12:21:29.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a9a2d8640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9415b740 con 0x7f0a9406cff0 2024-04-25T12:21:29.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a9a2d8640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f0a940c4670 con 0x7f0a9415bf40 2024-04-25T12:21:29.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a93fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a9406cff0 0x7f0a941ede50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a93fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a9406cff0 0x7f0a941ede50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56768/0 (socket says 172.21.15.111:56768) 2024-04-25T12:21:29.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a93fff640 1 -- 172.21.15.111:0/2528492881 learned_addr learned my addr 172.21.15.111:0/2528492881 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T12:21:29.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a98875640 1 --2- 172.21.15.111:0/2528492881 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0a9415bf40 0x7f0a94148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a8bfff640 1 --2- 172.21.15.111:0/2528492881 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a94151f40 0x7f0a94148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:29.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a98875640 1 -- 172.21.15.111:0/2528492881 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a9406cff0 msgr2=0x7f0a941ede50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a98875640 1 --2- 172.21.15.111:0/2528492881 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a9406cff0 0x7f0a941ede50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a98875640 1 -- 172.21.15.111:0/2528492881 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a94151f40 msgr2=0x7f0a94148140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:29.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a98875640 1 --2- 172.21.15.111:0/2528492881 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a94151f40 0x7f0a94148140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:29.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a98875640 1 -- 172.21.15.111:0/2528492881 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a940ce3e0 con 0x7f0a9415bf40 2024-04-25T12:21:29.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a93fff640 1 --2- 172.21.15.111:0/2528492881 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a9406cff0 0x7f0a941ede50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:21:29.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a98875640 1 --2- 172.21.15.111:0/2528492881 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0a9415bf40 0x7f0a94148680 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00be00 tx=0x7f0a8c00bef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:29.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.985+0000 7f0a917fa640 1 -- 172.21.15.111:0/2528492881 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c003980 con 0x7f0a9415bf40 2024-04-25T12:21:29.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.989+0000 7f0a917fa640 1 -- 172.21.15.111:0/2528492881 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a8c003b20 con 0x7f0a9415bf40 2024-04-25T12:21:29.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.989+0000 7f0a9a2d8640 1 -- 172.21.15.111:0/2528492881 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a940ccd20 con 0x7f0a9415bf40 2024-04-25T12:21:29.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.989+0000 7f0a917fa640 1 -- 172.21.15.111:0/2528492881 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c004020 con 0x7f0a9415bf40 2024-04-25T12:21:29.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.989+0000 7f0a9a2d8640 1 -- 172.21.15.111:0/2528492881 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a940cbf60 con 0x7f0a9415bf40 2024-04-25T12:21:29.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.989+0000 7f0a917fa640 1 -- 172.21.15.111:0/2528492881 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0a8c006d10 con 0x7f0a9415bf40 2024-04-25T12:21:29.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.989+0000 7f0a917fa640 1 -- 172.21.15.111:0/2528492881 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f0a8c014c00 con 0x7f0a9415bf40 2024-04-25T12:21:29.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.989+0000 7f0a9a2d8640 1 -- 172.21.15.111:0/2528492881 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a94075df0 con 0x7f0a9415bf40 2024-04-25T12:21:29.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:29.989+0000 7f0a917fa640 1 -- 172.21.15.111:0/2528492881 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f0a8c0041c0 con 0x7f0a9415bf40 2024-04-25T12:21:29.997 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T12:21:29.994+0000 7f69abb1c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T12:21:30.053 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T12:21:30.049+0000 7fd613c8a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T12:21:30.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.057+0000 7f0a9a2d8640 1 -- 172.21.15.111:0/2528492881 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d6e886e6-c8c1-4761-9a4c-abc6961c7c81", "id": 1} v 0) -- 0x7f0a940c41d0 con 0x7f0a9415bf40 2024-04-25T12:21:30.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.065+0000 7f0a917fa640 1 -- 172.21.15.111:0/2528492881 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d6e886e6-c8c1-4761-9a4c-abc6961c7c81", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f0a8c0043a0 con 0x7f0a9415bf40 2024-04-25T12:21:30.065 INFO:teuthology.orchestra.run.smithi111.stdout:1 2024-04-25T12:21:30.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.065+0000 7f0a9a2d8640 1 -- 172.21.15.111:0/2528492881 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0a9415bf40 msgr2=0x7f0a94148680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.065+0000 7f0a9a2d8640 1 --2- 172.21.15.111:0/2528492881 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0a9415bf40 0x7f0a94148680 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00be00 tx=0x7f0a8c00bef0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.065+0000 7f0a9a2d8640 1 -- 172.21.15.111:0/2528492881 shutdown_connections 2024-04-25T12:21:30.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.065+0000 7f0a9a2d8640 1 --2- 172.21.15.111:0/2528492881 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0a9415bf40 0x7f0a94148680 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.065+0000 7f0a9a2d8640 1 --2- 172.21.15.111:0/2528492881 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a94151f40 0x7f0a94148140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.065+0000 7f0a9a2d8640 1 --2- 172.21.15.111:0/2528492881 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a9406cff0 0x7f0a941ede50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.065+0000 7f0a9a2d8640 1 -- 172.21.15.111:0/2528492881 >> 172.21.15.111:0/2528492881 conn(0x7f0a940ca540 msgr2=0x7f0a94157710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:30.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.065+0000 7f0a9a2d8640 1 -- 172.21.15.111:0/2528492881 shutdown_connections 2024-04-25T12:21:30.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.065+0000 7f0a9a2d8640 1 -- 172.21.15.111:0/2528492881 wait complete. 2024-04-25T12:21:30.081 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd new ba20f409-ed46-43b6-b16d-43dc4622c042 2 2024-04-25T12:21:30.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.193+0000 7f2260026640 1 Processor -- start 2024-04-25T12:21:30.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.193+0000 7f2260026640 1 -- start start 2024-04-25T12:21:30.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.193+0000 7f2260026640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2258152ff0 0x7f22580c5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.193+0000 7f2260026640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f22580c7eb0 0x7f22580c6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.193+0000 7f2260026640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22580cada0 con 0x7f22580ca550 2024-04-25T12:21:30.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.193+0000 7f2260026640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f22580cb080 con 0x7f2258152ff0 2024-04-25T12:21:30.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.193+0000 7f2260026640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f22580c9360 con 0x7f22580c7eb0 2024-04-25T12:21:30.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.193+0000 7f225d5c1640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f22580c7eb0 0x7f22580c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.193+0000 7f225e5c3640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f22580ca550 0x7f22580cb350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:56664/0 (socket says 172.21.15.111:56664) 2024-04-25T12:21:30.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.193+0000 7f225e5c3640 1 -- 172.21.15.111:0/524416862 learned_addr learned my addr 172.21.15.111:0/524416862 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T12:21:30.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.197+0000 7f225ddc2640 1 --2- 172.21.15.111:0/524416862 >> v2:172.21.15.94:3300/0 conn(0x7f2258152ff0 0x7f22580c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.197+0000 7f225d5c1640 1 -- 172.21.15.111:0/524416862 >> v2:172.21.15.94:3300/0 conn(0x7f2258152ff0 msgr2=0x7f22580c5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:30.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.197+0000 7f225d5c1640 1 --2- 172.21.15.111:0/524416862 >> v2:172.21.15.94:3300/0 conn(0x7f2258152ff0 0x7f22580c5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.197+0000 7f225cdc0640 1 -- 172.21.15.111:0/524416862 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4147482667 0 0) 0x7f22580cada0 con 0x7f22580ca550 2024-04-25T12:21:30.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.197+0000 7f225d5c1640 1 -- 172.21.15.111:0/524416862 >> v1:172.21.15.111:6789/0 conn(0x7f22580ca550 legacy=0x7f22580cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.197+0000 7f225d5c1640 1 -- 172.21.15.111:0/524416862 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22580c9640 con 0x7f22580c7eb0 2024-04-25T12:21:30.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.197+0000 7f225d5c1640 1 --2- 172.21.15.111:0/524416862 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f22580c7eb0 0x7f22580c6380 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f22540097c0 tx=0x7f225401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=317e02d6c9e18d37 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:30.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.197+0000 7f225cdc0640 1 -- 172.21.15.111:0/524416862 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22540b5070 con 0x7f22580c7eb0 2024-04-25T12:21:30.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.197+0000 7f225cdc0640 1 -- 172.21.15.111:0/524416862 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22540a8990 con 0x7f22580c7eb0 2024-04-25T12:21:30.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.197+0000 7f225cdc0640 1 -- 172.21.15.111:0/524416862 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22540a8d60 con 0x7f22580c7eb0 2024-04-25T12:21:30.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.197+0000 7f2260026640 1 -- 172.21.15.111:0/524416862 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f22580c7eb0 msgr2=0x7f22580c6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.197+0000 7f2260026640 1 --2- 172.21.15.111:0/524416862 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f22580c7eb0 0x7f22580c6380 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f22540097c0 tx=0x7f225401ec90 comp rx=0 tx=0).stop 2024-04-25T12:21:30.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.197+0000 7f2260026640 1 -- 172.21.15.111:0/524416862 shutdown_connections 2024-04-25T12:21:30.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.197+0000 7f2260026640 1 --2- 172.21.15.111:0/524416862 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f22580c7eb0 0x7f22580c6380 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.197+0000 7f2260026640 1 --2- 172.21.15.111:0/524416862 >> v2:172.21.15.94:3300/0 conn(0x7f2258152ff0 0x7f22580c5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.197+0000 7f2260026640 1 -- 172.21.15.111:0/524416862 >> 172.21.15.111:0/524416862 conn(0x7f22580676a0 msgr2=0x7f2258067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:30.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.197+0000 7f2260026640 1 -- 172.21.15.111:0/524416862 shutdown_connections 2024-04-25T12:21:30.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.197+0000 7f2260026640 1 -- 172.21.15.111:0/524416862 wait complete. 2024-04-25T12:21:30.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f2260026640 1 Processor -- start 2024-04-25T12:21:30.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f2260026640 1 -- start start 2024-04-25T12:21:30.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f2260026640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f22580c7eb0 0x7f22581f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f2260026640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22580ca550 0x7f225815b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f2260026640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2258152ff0 0x7f225814bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f2260026640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f22580caaa0 con 0x7f2258152ff0 2024-04-25T12:21:30.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f2260026640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f22580c5e60 con 0x7f22580ca550 2024-04-25T12:21:30.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f2260026640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f22580c68c0 con 0x7f22580c7eb0 2024-04-25T12:21:30.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f225ddc2640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f22580c7eb0 0x7f22581f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f225d5c1640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22580ca550 0x7f225815b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f225d5c1640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22580ca550 0x7f225815b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56780/0 (socket says 172.21.15.111:56780) 2024-04-25T12:21:30.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f225d5c1640 1 -- 172.21.15.111:0/998166793 learned_addr learned my addr 172.21.15.111:0/998166793 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T12:21:30.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f225ddc2640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f22580c7eb0 0x7f22581f4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:32972/0 (socket says 172.21.15.111:32972) 2024-04-25T12:21:30.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f225e5c3640 1 --2- 172.21.15.111:0/998166793 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2258152ff0 0x7f225814bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f225d5c1640 1 -- 172.21.15.111:0/998166793 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f22580c7eb0 msgr2=0x7f22581f4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f225d5c1640 1 --2- 172.21.15.111:0/998166793 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f22580c7eb0 0x7f22581f4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f225d5c1640 1 -- 172.21.15.111:0/998166793 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2258152ff0 msgr2=0x7f225814bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f225d5c1640 1 --2- 172.21.15.111:0/998166793 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2258152ff0 0x7f225814bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f225d5c1640 1 -- 172.21.15.111:0/998166793 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22581f0c10 con 0x7f22580ca550 2024-04-25T12:21:30.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f225e5c3640 1 --2- 172.21.15.111:0/998166793 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2258152ff0 0x7f225814bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:30.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f225ddc2640 1 --2- 172.21.15.111:0/998166793 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f22580c7eb0 0x7f22581f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:21:30.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f225d5c1640 1 --2- 172.21.15.111:0/998166793 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22580ca550 0x7f225815b630 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f22540097c0 tx=0x7f225401ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:30.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f224e7fc640 1 -- 172.21.15.111:0/998166793 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22540c0070 con 0x7f22580ca550 2024-04-25T12:21:30.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f224e7fc640 1 -- 172.21.15.111:0/998166793 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2254004230 con 0x7f22580ca550 2024-04-25T12:21:30.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f224e7fc640 1 -- 172.21.15.111:0/998166793 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22540b5040 con 0x7f22580ca550 2024-04-25T12:21:30.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f2260026640 1 -- 172.21.15.111:0/998166793 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f225815bee0 con 0x7f22580ca550 2024-04-25T12:21:30.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f2260026640 1 -- 172.21.15.111:0/998166793 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22581f11b0 con 0x7f22580ca550 2024-04-25T12:21:30.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f224e7fc640 1 -- 172.21.15.111:0/998166793 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2254003620 con 0x7f22580ca550 2024-04-25T12:21:30.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f224e7fc640 1 -- 172.21.15.111:0/998166793 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f22540b0a60 con 0x7f22580ca550 2024-04-25T12:21:30.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.201+0000 7f2260026640 1 -- 172.21.15.111:0/998166793 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2258075df0 con 0x7f22580ca550 2024-04-25T12:21:30.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.205+0000 7f224e7fc640 1 -- 172.21.15.111:0/998166793 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f22540c9070 con 0x7f22580ca550 2024-04-25T12:21:30.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.273+0000 7f2260026640 1 -- 172.21.15.111:0/998166793 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ba20f409-ed46-43b6-b16d-43dc4622c042", "id": 2} v 0) -- 0x7f22581512f0 con 0x7f22580ca550 2024-04-25T12:21:30.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.277+0000 7f224e7fc640 1 -- 172.21.15.111:0/998166793 <== mon.1 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ba20f409-ed46-43b6-b16d-43dc4622c042", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f22540187f0 con 0x7f22580ca550 2024-04-25T12:21:30.280 INFO:teuthology.orchestra.run.smithi111.stdout:2 2024-04-25T12:21:30.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.281+0000 7f2260026640 1 -- 172.21.15.111:0/998166793 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22580ca550 msgr2=0x7f225815b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.281+0000 7f2260026640 1 --2- 172.21.15.111:0/998166793 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22580ca550 0x7f225815b630 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f22540097c0 tx=0x7f225401ba30 comp rx=0 tx=0).stop 2024-04-25T12:21:30.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.281+0000 7f2260026640 1 -- 172.21.15.111:0/998166793 shutdown_connections 2024-04-25T12:21:30.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.281+0000 7f2260026640 1 --2- 172.21.15.111:0/998166793 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2258152ff0 0x7f225814bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.281+0000 7f2260026640 1 --2- 172.21.15.111:0/998166793 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22580ca550 0x7f225815b630 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.281+0000 7f2260026640 1 --2- 172.21.15.111:0/998166793 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f22580c7eb0 0x7f22581f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.281+0000 7f2260026640 1 -- 172.21.15.111:0/998166793 >> 172.21.15.111:0/998166793 conn(0x7f22580676a0 msgr2=0x7f2258150990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:30.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.281+0000 7f2260026640 1 -- 172.21.15.111:0/998166793 shutdown_connections 2024-04-25T12:21:30.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.281+0000 7f2260026640 1 -- 172.21.15.111:0/998166793 wait complete. 2024-04-25T12:21:30.301 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd new 85816a2b-3a3f-4ec8-8373-8230d948396f 3 2024-04-25T12:21:30.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.409+0000 7f7914daf640 1 Processor -- start 2024-04-25T12:21:30.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.409+0000 7f7914daf640 1 -- start start 2024-04-25T12:21:30.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.409+0000 7f7914daf640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7910072990 0x7f79100c8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.409+0000 7f7914daf640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f791015e730 con 0x7f7910070530 2024-04-25T12:21:30.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.409+0000 7f7914daf640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f791015ea10 con 0x7f79101443d0 2024-04-25T12:21:30.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.409+0000 7f7914daf640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f791015ecf0 con 0x7f7910072990 2024-04-25T12:21:30.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.409+0000 7f790e59c640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f79101443d0 0x7f791006cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:56676/0 (socket says 172.21.15.111:56676) 2024-04-25T12:21:30.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.409+0000 7f790e59c640 1 -- 172.21.15.111:0/3974554304 learned_addr learned my addr 172.21.15.111:0/3974554304 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T12:21:30.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.409+0000 7f790ed9d640 1 --2- 172.21.15.111:0/3974554304 >> v2:172.21.15.94:3300/0 conn(0x7f7910072990 0x7f79100c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.409+0000 7f790dd9b640 1 -- 172.21.15.111:0/3974554304 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 435554011 0 0) 0x7f791015ea10 con 0x7f79101443d0 2024-04-25T12:21:30.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.409+0000 7f790dd9b640 1 -- 172.21.15.111:0/3974554304 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78fc003530 con 0x7f79101443d0 2024-04-25T12:21:30.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f790dd9b640 1 -- 172.21.15.111:0/3974554304 <== mon.1 v1:172.21.15.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 147649021 0 0) 0x7f78fc003530 con 0x7f79101443d0 2024-04-25T12:21:30.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f790dd9b640 1 -- 172.21.15.111:0/3974554304 >> v2:172.21.15.94:3300/0 conn(0x7f7910072990 msgr2=0x7f79100c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:30.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f790dd9b640 1 --2- 172.21.15.111:0/3974554304 >> v2:172.21.15.94:3300/0 conn(0x7f7910072990 0x7f79100c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f790dd9b640 1 -- 172.21.15.111:0/3974554304 >> v1:172.21.15.94:6789/0 conn(0x7f7910070530 legacy=0x7f7910072280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f790dd9b640 1 -- 172.21.15.111:0/3974554304 --> v1:172.21.15.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f791015efd0 con 0x7f79101443d0 2024-04-25T12:21:30.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f790dd9b640 1 -- 172.21.15.111:0/3974554304 <== mon.1 v1:172.21.15.111:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7f7900001680 con 0x7f79101443d0 2024-04-25T12:21:30.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f790dd9b640 1 -- 172.21.15.111:0/3974554304 >> v1:172.21.15.111:6789/0 conn(0x7f79101443d0 legacy=0x7f791006cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f790dd9b640 1 --2- 172.21.15.111:0/3974554304 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78fc0039c0 0x7f78fc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f790dd9b640 1 --2- 172.21.15.111:0/3974554304 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78fc004810 0x7f78fc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f790dd9b640 1 --2- 172.21.15.111:0/3974554304 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78fc0051d0 0x7f78fc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f790dd9b640 1 -- 172.21.15.111:0/3974554304 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f791015ecf0 con 0x7f78fc0039c0 2024-04-25T12:21:30.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f790dd9b640 1 -- 172.21.15.111:0/3974554304 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc00c070 con 0x7f78fc0051d0 2024-04-25T12:21:30.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f790dd9b640 1 -- 172.21.15.111:0/3974554304 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f78fc00c270 con 0x7f78fc004810 2024-04-25T12:21:30.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f790ed9d640 1 --2- 172.21.15.111:0/3974554304 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78fc0051d0 0x7f78fc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f7907fff640 1 --2- 172.21.15.111:0/3974554304 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78fc004810 0x7f78fc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f790e59c640 1 --2- 172.21.15.111:0/3974554304 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78fc0039c0 0x7f78fc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f790ed9d640 1 -- 172.21.15.111:0/3974554304 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78fc004810 msgr2=0x7f78fc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:30.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f790ed9d640 1 --2- 172.21.15.111:0/3974554304 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78fc004810 0x7f78fc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f790ed9d640 1 -- 172.21.15.111:0/3974554304 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78fc0039c0 msgr2=0x7f78fc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:30.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f790ed9d640 1 --2- 172.21.15.111:0/3974554304 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78fc0039c0 0x7f78fc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f790ed9d640 1 -- 172.21.15.111:0/3974554304 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78fc003530 con 0x7f78fc0051d0 2024-04-25T12:21:30.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f790ed9d640 1 -- 172.21.15.111:0/3974554304 reap_dead start 2024-04-25T12:21:30.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f7907fff640 1 --2- 172.21.15.111:0/3974554304 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78fc004810 0x7f78fc004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:21:30.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f790ed9d640 1 --2- 172.21.15.111:0/3974554304 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78fc0051d0 0x7f78fc00b9d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7908009fc0 tx=0x7f790801cce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b17474a2e35be355 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:30.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f790dd9b640 1 -- 172.21.15.111:0/3974554304 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7908009c10 con 0x7f78fc0051d0 2024-04-25T12:21:30.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f790dd9b640 1 -- 172.21.15.111:0/3974554304 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79080a5c20 con 0x7f78fc0051d0 2024-04-25T12:21:30.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f790dd9b640 1 -- 172.21.15.111:0/3974554304 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79080039a0 con 0x7f78fc0051d0 2024-04-25T12:21:30.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f7914daf640 1 -- 172.21.15.111:0/3974554304 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78fc0051d0 msgr2=0x7f78fc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f7914daf640 1 --2- 172.21.15.111:0/3974554304 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78fc0051d0 0x7f78fc00b9d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7908009fc0 tx=0x7f790801cce0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f7914daf640 1 -- 172.21.15.111:0/3974554304 shutdown_connections 2024-04-25T12:21:30.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f7914daf640 1 --2- 172.21.15.111:0/3974554304 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78fc0051d0 0x7f78fc00b9d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f7914daf640 1 -- 172.21.15.111:0/3974554304 >> 172.21.15.111:0/3974554304 conn(0x7f79100ca540 msgr2=0x7f79100ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:30.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f7914daf640 1 -- 172.21.15.111:0/3974554304 shutdown_connections 2024-04-25T12:21:30.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.413+0000 7f7914daf640 1 -- 172.21.15.111:0/3974554304 wait complete. 2024-04-25T12:21:30.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f7914daf640 1 Processor -- start 2024-04-25T12:21:30.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f7914daf640 1 -- start start 2024-04-25T12:21:30.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f7914daf640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78fc0051d0 0x7f79101522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f7914daf640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79100c49a0 0x7f79100c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f7914daf640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79101527f0 0x7f79100c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f7914daf640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f79100c83d0 con 0x7f79100c49a0 2024-04-25T12:21:30.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f7914daf640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f79100c8250 con 0x7f79101527f0 2024-04-25T12:21:30.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f7914daf640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f7910072260 con 0x7f78fc0051d0 2024-04-25T12:21:30.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f790e59c640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78fc0051d0 0x7f79101522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f790ed9d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79101527f0 0x7f79100c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f790ed9d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79101527f0 0x7f79100c6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56804/0 (socket says 172.21.15.111:56804) 2024-04-25T12:21:30.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f790e59c640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78fc0051d0 0x7f79101522b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:33002/0 (socket says 172.21.15.111:33002) 2024-04-25T12:21:30.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f790ed9d640 1 -- 172.21.15.111:0/785744702 learned_addr learned my addr 172.21.15.111:0/785744702 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T12:21:30.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f7907fff640 1 --2- 172.21.15.111:0/785744702 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79100c49a0 0x7f79100c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f790ed9d640 1 -- 172.21.15.111:0/785744702 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78fc0051d0 msgr2=0x7f79101522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f790ed9d640 1 --2- 172.21.15.111:0/785744702 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78fc0051d0 0x7f79101522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f790ed9d640 1 -- 172.21.15.111:0/785744702 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79100c49a0 msgr2=0x7f79100c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f790ed9d640 1 --2- 172.21.15.111:0/785744702 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79100c49a0 0x7f79100c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f790ed9d640 1 -- 172.21.15.111:0/785744702 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7910152d10 con 0x7f79101527f0 2024-04-25T12:21:30.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f790e59c640 1 --2- 172.21.15.111:0/785744702 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78fc0051d0 0x7f79101522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:21:30.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f790ed9d640 1 --2- 172.21.15.111:0/785744702 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79101527f0 0x7f79100c6c50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f790801c750 tx=0x7f7908009750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:30.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f7906ffd640 1 -- 172.21.15.111:0/785744702 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79080039a0 con 0x7f79101527f0 2024-04-25T12:21:30.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f7906ffd640 1 -- 172.21.15.111:0/785744702 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79080bd070 con 0x7f79101527f0 2024-04-25T12:21:30.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f7914daf640 1 -- 172.21.15.111:0/785744702 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7910158140 con 0x7f79101527f0 2024-04-25T12:21:30.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f7906ffd640 1 -- 172.21.15.111:0/785744702 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7908003d40 con 0x7f79101527f0 2024-04-25T12:21:30.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f7914daf640 1 -- 172.21.15.111:0/785744702 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7910158700 con 0x7f79101527f0 2024-04-25T12:21:30.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f7906ffd640 1 -- 172.21.15.111:0/785744702 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f79080ae930 con 0x7f79101527f0 2024-04-25T12:21:30.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f7906ffd640 1 -- 172.21.15.111:0/785744702 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f7908004670 con 0x7f79101527f0 2024-04-25T12:21:30.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.417+0000 7f7914daf640 1 -- 172.21.15.111:0/785744702 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7910075df0 con 0x7f79101527f0 2024-04-25T12:21:30.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.421+0000 7f7906ffd640 1 -- 172.21.15.111:0/785744702 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f79080169f0 con 0x7f79101527f0 2024-04-25T12:21:30.490 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.489+0000 7f7914daf640 1 -- 172.21.15.111:0/785744702 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd new", "uuid": "85816a2b-3a3f-4ec8-8373-8230d948396f", "id": 3} v 0) -- 0x7f7910070a30 con 0x7f79101527f0 2024-04-25T12:21:30.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.493+0000 7f7906ffd640 1 -- 172.21.15.111:0/785744702 <== mon.1 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "85816a2b-3a3f-4ec8-8373-8230d948396f", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f79080aee00 con 0x7f79101527f0 2024-04-25T12:21:30.496 INFO:teuthology.orchestra.run.smithi111.stdout:3 2024-04-25T12:21:30.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.497+0000 7f7914daf640 1 -- 172.21.15.111:0/785744702 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79101527f0 msgr2=0x7f79100c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.497+0000 7f7914daf640 1 --2- 172.21.15.111:0/785744702 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79101527f0 0x7f79100c6c50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f790801c750 tx=0x7f7908009750 comp rx=0 tx=0).stop 2024-04-25T12:21:30.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.497+0000 7f7914daf640 1 -- 172.21.15.111:0/785744702 shutdown_connections 2024-04-25T12:21:30.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.497+0000 7f7914daf640 1 --2- 172.21.15.111:0/785744702 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79101527f0 0x7f79100c6c50 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.497+0000 7f7914daf640 1 --2- 172.21.15.111:0/785744702 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79100c49a0 0x7f79100c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.497+0000 7f7914daf640 1 --2- 172.21.15.111:0/785744702 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78fc0051d0 0x7f79101522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.497+0000 7f7914daf640 1 -- 172.21.15.111:0/785744702 >> 172.21.15.111:0/785744702 conn(0x7f79100ca540 msgr2=0x7f7910143340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:30.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.497+0000 7f7914daf640 1 -- 172.21.15.111:0/785744702 shutdown_connections 2024-04-25T12:21:30.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.497+0000 7f7914daf640 1 -- 172.21.15.111:0/785744702 wait complete. 2024-04-25T12:21:30.513 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd new b4a953b7-01d6-4623-9324-63135fdaf148 4 2024-04-25T12:21:30.547 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T12:21:30.542+0000 7f69abb1c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T12:21:30.601 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T12:21:30.598+0000 7f69abb1c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T12:21:30.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.625+0000 7fe9e24ba640 1 Processor -- start 2024-04-25T12:21:30.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.625+0000 7fe9e24ba640 1 -- start start 2024-04-25T12:21:30.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.625+0000 7fe9e24ba640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe9dc155310 0x7fe9dc0cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.625+0000 7fe9e24ba640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe9dc0cada0 0x7fe9dc0cb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.625+0000 7fe9e24ba640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9dc1556f0 con 0x7fe9dc06cae0 2024-04-25T12:21:30.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.625+0000 7fe9e24ba640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fe9dc15f2e0 con 0x7fe9dc0cada0 2024-04-25T12:21:30.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.625+0000 7fe9e24ba640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe9dc15e6d0 con 0x7fe9dc155310 2024-04-25T12:21:30.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.625+0000 7fe9dbfff640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe9dc155310 0x7fe9dc0cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.625+0000 7fe9dbfff640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe9dc155310 0x7fe9dc0cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:33012/0 (socket says 172.21.15.111:33012) 2024-04-25T12:21:30.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.625+0000 7fe9dbfff640 1 -- 172.21.15.111:0/1999118344 learned_addr learned my addr 172.21.15.111:0/1999118344 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T12:21:30.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.625+0000 7fe9d3fff640 1 --2- 172.21.15.111:0/1999118344 >> v2:172.21.15.94:3300/0 conn(0x7fe9dc0cada0 0x7fe9dc0cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.625+0000 7fe9dbfff640 1 -- 172.21.15.111:0/1999118344 >> v2:172.21.15.94:3300/0 conn(0x7fe9dc0cada0 msgr2=0x7fe9dc0cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:30.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.625+0000 7fe9dbfff640 1 --2- 172.21.15.111:0/1999118344 >> v2:172.21.15.94:3300/0 conn(0x7fe9dc0cada0 0x7fe9dc0cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.625+0000 7fe9dbfff640 1 -- 172.21.15.111:0/1999118344 >> v1:172.21.15.94:6789/0 conn(0x7fe9dc06cae0 legacy=0x7fe9dc15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:30.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.625+0000 7fe9dbfff640 1 -- 172.21.15.111:0/1999118344 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9dc15e9b0 con 0x7fe9dc155310 2024-04-25T12:21:30.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.625+0000 7fe9d3fff640 1 --2- 172.21.15.111:0/1999118344 >> v2:172.21.15.94:3300/0 conn(0x7fe9dc0cada0 0x7fe9dc0cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:30.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.629+0000 7fe9dbfff640 1 --2- 172.21.15.111:0/1999118344 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe9dc155310 0x7fe9dc0cb350 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc009870 tx=0x7fe9cc01c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26acaf220b89b0cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:30.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.629+0000 7fe9db7fe640 1 -- 172.21.15.111:0/1999118344 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc0b0070 con 0x7fe9dc155310 2024-04-25T12:21:30.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.629+0000 7fe9db7fe640 1 -- 172.21.15.111:0/1999118344 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9cc0ab600 con 0x7fe9dc155310 2024-04-25T12:21:30.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.629+0000 7fe9db7fe640 1 -- 172.21.15.111:0/1999118344 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc0ab9d0 con 0x7fe9dc155310 2024-04-25T12:21:30.632 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T12:21:30.629+0000 7fd613c8a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T12:21:30.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.629+0000 7fe9e24ba640 1 -- 172.21.15.111:0/1999118344 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe9dc155310 msgr2=0x7fe9dc0cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.629+0000 7fe9e24ba640 1 --2- 172.21.15.111:0/1999118344 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe9dc155310 0x7fe9dc0cb350 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc009870 tx=0x7fe9cc01c520 comp rx=0 tx=0).stop 2024-04-25T12:21:30.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.629+0000 7fe9e24ba640 1 -- 172.21.15.111:0/1999118344 shutdown_connections 2024-04-25T12:21:30.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.629+0000 7fe9e24ba640 1 --2- 172.21.15.111:0/1999118344 >> v2:172.21.15.94:3300/0 conn(0x7fe9dc0cada0 0x7fe9dc0cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.629+0000 7fe9e24ba640 1 --2- 172.21.15.111:0/1999118344 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe9dc155310 0x7fe9dc0cb350 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.629+0000 7fe9e24ba640 1 -- 172.21.15.111:0/1999118344 >> 172.21.15.111:0/1999118344 conn(0x7fe9dc0676a0 msgr2=0x7fe9dc067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:30.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.629+0000 7fe9e24ba640 1 -- 172.21.15.111:0/1999118344 shutdown_connections 2024-04-25T12:21:30.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.629+0000 7fe9e24ba640 1 -- 172.21.15.111:0/1999118344 wait complete. 2024-04-25T12:21:30.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9e24ba640 1 Processor -- start 2024-04-25T12:21:30.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9e24ba640 1 -- start start 2024-04-25T12:21:30.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9e24ba640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe9dc06cae0 0x7fe9dc14bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9e24ba640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9dc0cada0 0x7fe9dc155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9e24ba640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9dc155310 0x7fe9dc159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9e24ba640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe9dc1681f0 con 0x7fe9dc0cada0 2024-04-25T12:21:30.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9e24ba640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe9dc168070 con 0x7fe9dc155310 2024-04-25T12:21:30.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9e24ba640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe9dc168370 con 0x7fe9dc06cae0 2024-04-25T12:21:30.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9e0a57640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9dc155310 0x7fe9dc159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9dbfff640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe9dc06cae0 0x7fe9dc14bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9e0a57640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9dc155310 0x7fe9dc159dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56820/0 (socket says 172.21.15.111:56820) 2024-04-25T12:21:30.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9e0a57640 1 -- 172.21.15.111:0/3963496250 learned_addr learned my addr 172.21.15.111:0/3963496250 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T12:21:30.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9d3fff640 1 --2- 172.21.15.111:0/3963496250 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9dc0cada0 0x7fe9dc155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9dbfff640 1 -- 172.21.15.111:0/3963496250 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9dc155310 msgr2=0x7fe9dc159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9dbfff640 1 --2- 172.21.15.111:0/3963496250 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9dc155310 0x7fe9dc159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9dbfff640 1 -- 172.21.15.111:0/3963496250 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9dc0cada0 msgr2=0x7fe9dc155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9dbfff640 1 --2- 172.21.15.111:0/3963496250 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9dc0cada0 0x7fe9dc155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9dbfff640 1 -- 172.21.15.111:0/3963496250 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9dc1f44f0 con 0x7fe9dc06cae0 2024-04-25T12:21:30.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9e0a57640 1 --2- 172.21.15.111:0/3963496250 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9dc155310 0x7fe9dc159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:21:30.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9d3fff640 1 --2- 172.21.15.111:0/3963496250 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9dc0cada0 0x7fe9dc155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:21:30.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9dbfff640 1 --2- 172.21.15.111:0/3963496250 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe9dc06cae0 0x7fe9dc14bbe0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0ab000 tx=0x7fe9cc0192c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:30.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9d97fa640 1 -- 172.21.15.111:0/3963496250 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc0ba070 con 0x7fe9dc06cae0 2024-04-25T12:21:30.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9d97fa640 1 -- 172.21.15.111:0/3963496250 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9cc0b4420 con 0x7fe9dc06cae0 2024-04-25T12:21:30.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9d97fa640 1 -- 172.21.15.111:0/3963496250 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc0b0040 con 0x7fe9dc06cae0 2024-04-25T12:21:30.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9e24ba640 1 -- 172.21.15.111:0/3963496250 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9dc159010 con 0x7fe9dc06cae0 2024-04-25T12:21:30.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9e24ba640 1 -- 172.21.15.111:0/3963496250 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9dc1595d0 con 0x7fe9dc06cae0 2024-04-25T12:21:30.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9d97fa640 1 -- 172.21.15.111:0/3963496250 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe9cc0bd070 con 0x7fe9dc06cae0 2024-04-25T12:21:30.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9d97fa640 1 -- 172.21.15.111:0/3963496250 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fe9cc0be8c0 con 0x7fe9dc06cae0 2024-04-25T12:21:30.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.633+0000 7fe9e24ba640 1 -- 172.21.15.111:0/3963496250 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9dc075df0 con 0x7fe9dc06cae0 2024-04-25T12:21:30.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.637+0000 7fe9d97fa640 1 -- 172.21.15.111:0/3963496250 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fe9cc016110 con 0x7fe9dc06cae0 2024-04-25T12:21:30.654 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T12:21:30.650+0000 7f69abb1c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T12:21:30.688 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T12:21:30.685+0000 7fd613c8a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T12:21:30.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.705+0000 7fe9e24ba640 1 -- 172.21.15.111:0/3963496250 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b4a953b7-01d6-4623-9324-63135fdaf148", "id": 4} v 0) -- 0x7fe9dc06d830 con 0x7fe9dc06cae0 2024-04-25T12:21:30.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.709+0000 7fe9d97fa640 1 -- 172.21.15.111:0/3963496250 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b4a953b7-01d6-4623-9324-63135fdaf148", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fe9cc0be3b0 con 0x7fe9dc06cae0 2024-04-25T12:21:30.712 INFO:teuthology.orchestra.run.smithi111.stdout:4 2024-04-25T12:21:30.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.713+0000 7fe9e24ba640 1 -- 172.21.15.111:0/3963496250 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe9dc06cae0 msgr2=0x7fe9dc14bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.713+0000 7fe9e24ba640 1 --2- 172.21.15.111:0/3963496250 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe9dc06cae0 0x7fe9dc14bbe0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0ab000 tx=0x7fe9cc0192c0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.713+0000 7fe9e24ba640 1 -- 172.21.15.111:0/3963496250 shutdown_connections 2024-04-25T12:21:30.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.713+0000 7fe9e24ba640 1 --2- 172.21.15.111:0/3963496250 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9dc155310 0x7fe9dc159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.713+0000 7fe9e24ba640 1 --2- 172.21.15.111:0/3963496250 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9dc0cada0 0x7fe9dc155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.713+0000 7fe9e24ba640 1 --2- 172.21.15.111:0/3963496250 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe9dc06cae0 0x7fe9dc14bbe0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.713+0000 7fe9e24ba640 1 -- 172.21.15.111:0/3963496250 >> 172.21.15.111:0/3963496250 conn(0x7fe9dc0676a0 msgr2=0x7fe9dc0c98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:30.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.713+0000 7fe9e24ba640 1 -- 172.21.15.111:0/3963496250 shutdown_connections 2024-04-25T12:21:30.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.713+0000 7fe9e24ba640 1 -- 172.21.15.111:0/3963496250 wait complete. 2024-04-25T12:21:30.728 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd new c0acc514-427d-41bf-a965-b8463cebf045 5 2024-04-25T12:21:30.731 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T12:21:30.726+0000 7f69abb1c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T12:21:30.743 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T12:21:30.741+0000 7fd613c8a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T12:21:30.782 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T12:21:30.778+0000 7f69abb1c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T12:21:30.823 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T12:21:30.821+0000 7fd613c8a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T12:21:30.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.841+0000 7fa2070d1640 1 Processor -- start 2024-04-25T12:21:30.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.841+0000 7fa2070d1640 1 -- start start 2024-04-25T12:21:30.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.841+0000 7fa2070d1640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa2000c7eb0 0x7fa2000c5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.841+0000 7fa2070d1640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa2000ca550 0x7fa2000cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.841+0000 7fa2070d1640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2000cada0 con 0x7fa200152ff0 2024-04-25T12:21:30.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.841+0000 7fa2070d1640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fa2000cb080 con 0x7fa2000ca550 2024-04-25T12:21:30.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.841+0000 7fa2070d1640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa2000c9360 con 0x7fa2000c7eb0 2024-04-25T12:21:30.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.841+0000 7fa1fffff640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa2000c7eb0 0x7fa2000c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.841+0000 7fa204e6d640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fa200152ff0 0x7fa2000c6380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:56682/0 (socket says 172.21.15.111:56682) 2024-04-25T12:21:30.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.841+0000 7fa204e6d640 1 -- 172.21.15.111:0/3924227238 learned_addr learned my addr 172.21.15.111:0/3924227238 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T12:21:30.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.845+0000 7fa20566e640 1 --2- 172.21.15.111:0/3924227238 >> v2:172.21.15.94:3300/0 conn(0x7fa2000ca550 0x7fa2000cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.845+0000 7fa1ff7fe640 1 -- 172.21.15.111:0/3924227238 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2419678974 0 0) 0x7fa2000cada0 con 0x7fa200152ff0 2024-04-25T12:21:30.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.845+0000 7fa1fffff640 1 -- 172.21.15.111:0/3924227238 >> v2:172.21.15.94:3300/0 conn(0x7fa2000ca550 msgr2=0x7fa2000cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:30.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.845+0000 7fa1fffff640 1 --2- 172.21.15.111:0/3924227238 >> v2:172.21.15.94:3300/0 conn(0x7fa2000ca550 0x7fa2000cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.845+0000 7fa1fffff640 1 -- 172.21.15.111:0/3924227238 >> v1:172.21.15.111:6789/0 conn(0x7fa200152ff0 legacy=0x7fa2000c6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.845+0000 7fa1fffff640 1 -- 172.21.15.111:0/3924227238 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2000c9640 con 0x7fa2000c7eb0 2024-04-25T12:21:30.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.845+0000 7fa1fffff640 1 --2- 172.21.15.111:0/3924227238 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa2000c7eb0 0x7fa2000c5730 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40097c0 tx=0x7fa1f401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85cad069f548d16c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:30.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.845+0000 7fa1ff7fe640 1 -- 172.21.15.111:0/3924227238 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f40b5070 con 0x7fa2000c7eb0 2024-04-25T12:21:30.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.845+0000 7fa1ff7fe640 1 -- 172.21.15.111:0/3924227238 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f40a8990 con 0x7fa2000c7eb0 2024-04-25T12:21:30.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.845+0000 7fa1ff7fe640 1 -- 172.21.15.111:0/3924227238 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f40a8d60 con 0x7fa2000c7eb0 2024-04-25T12:21:30.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.845+0000 7fa2070d1640 1 -- 172.21.15.111:0/3924227238 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa2000c7eb0 msgr2=0x7fa2000c5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.845+0000 7fa2070d1640 1 --2- 172.21.15.111:0/3924227238 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa2000c7eb0 0x7fa2000c5730 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40097c0 tx=0x7fa1f401ec90 comp rx=0 tx=0).stop 2024-04-25T12:21:30.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.845+0000 7fa2070d1640 1 -- 172.21.15.111:0/3924227238 shutdown_connections 2024-04-25T12:21:30.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.845+0000 7fa2070d1640 1 --2- 172.21.15.111:0/3924227238 >> v2:172.21.15.94:3300/0 conn(0x7fa2000ca550 0x7fa2000cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.845+0000 7fa2070d1640 1 --2- 172.21.15.111:0/3924227238 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa2000c7eb0 0x7fa2000c5730 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.845+0000 7fa2070d1640 1 -- 172.21.15.111:0/3924227238 >> 172.21.15.111:0/3924227238 conn(0x7fa2000676a0 msgr2=0x7fa200067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:30.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.845+0000 7fa2070d1640 1 -- 172.21.15.111:0/3924227238 shutdown_connections 2024-04-25T12:21:30.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.845+0000 7fa2070d1640 1 -- 172.21.15.111:0/3924227238 wait complete. 2024-04-25T12:21:30.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa2070d1640 1 Processor -- start 2024-04-25T12:21:30.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa2070d1640 1 -- start start 2024-04-25T12:21:30.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa2070d1640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa2000c7eb0 0x7fa2001eeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa2070d1640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa2000ca550 0x7fa2000739a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa2070d1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa200152ff0 0x7fa2000cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:30.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa2070d1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa2000caaa0 con 0x7fa200152ff0 2024-04-25T12:21:30.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa2070d1640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa2000c5e60 con 0x7fa2000ca550 2024-04-25T12:21:30.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa2070d1640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa2001533d0 con 0x7fa2000c7eb0 2024-04-25T12:21:30.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa1fffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa2000ca550 0x7fa2000739a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa204e6d640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa2000c7eb0 0x7fa2001eeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa1fffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa2000ca550 0x7fa2000739a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56830/0 (socket says 172.21.15.111:56830) 2024-04-25T12:21:30.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa204e6d640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa2000c7eb0 0x7fa2001eeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:33046/0 (socket says 172.21.15.111:33046) 2024-04-25T12:21:30.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa1fffff640 1 -- 172.21.15.111:0/3834562938 learned_addr learned my addr 172.21.15.111:0/3834562938 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T12:21:30.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa20566e640 1 --2- 172.21.15.111:0/3834562938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa200152ff0 0x7fa2000cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:30.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa204e6d640 1 -- 172.21.15.111:0/3834562938 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa2000ca550 msgr2=0x7fa2000739a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa204e6d640 1 --2- 172.21.15.111:0/3834562938 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa2000ca550 0x7fa2000739a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa204e6d640 1 -- 172.21.15.111:0/3834562938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa200152ff0 msgr2=0x7fa2000cdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa204e6d640 1 --2- 172.21.15.111:0/3834562938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa200152ff0 0x7fa2000cdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa204e6d640 1 -- 172.21.15.111:0/3834562938 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2000cca90 con 0x7fa2000c7eb0 2024-04-25T12:21:30.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa204e6d640 1 --2- 172.21.15.111:0/3834562938 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa2000c7eb0 0x7fa2001eeaf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000c430 tx=0x7fa1f000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:30.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa1fd7fa640 1 -- 172.21.15.111:0/3834562938 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f00074e0 con 0x7fa2000c7eb0 2024-04-25T12:21:30.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa1fd7fa640 1 -- 172.21.15.111:0/3834562938 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f00047f0 con 0x7fa2000c7eb0 2024-04-25T12:21:30.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa1fd7fa640 1 -- 172.21.15.111:0/3834562938 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0004be0 con 0x7fa2000c7eb0 2024-04-25T12:21:30.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa2070d1640 1 -- 172.21.15.111:0/3834562938 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2000cd760 con 0x7fa2000c7eb0 2024-04-25T12:21:30.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa2070d1640 1 -- 172.21.15.111:0/3834562938 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2001ef410 con 0x7fa2000c7eb0 2024-04-25T12:21:30.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa1fd7fa640 1 -- 172.21.15.111:0/3834562938 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa1f0011070 con 0x7fa2000c7eb0 2024-04-25T12:21:30.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa1fd7fa640 1 -- 172.21.15.111:0/3834562938 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fa1f0013940 con 0x7fa2000c7eb0 2024-04-25T12:21:30.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.849+0000 7fa2070d1640 1 -- 172.21.15.111:0/3834562938 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa200075df0 con 0x7fa2000c7eb0 2024-04-25T12:21:30.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.853+0000 7fa1fd7fa640 1 -- 172.21.15.111:0/3834562938 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa1f0013c20 con 0x7fa2000c7eb0 2024-04-25T12:21:30.859 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T12:21:30.854+0000 7f69abb1c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T12:21:30.878 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T12:21:30.877+0000 7fd613c8a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T12:21:30.911 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T12:21:30.906+0000 7f69abb1c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T12:21:30.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.921+0000 7fa2070d1640 1 -- 172.21.15.111:0/3834562938 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c0acc514-427d-41bf-a965-b8463cebf045", "id": 5} v 0) -- 0x7fa2000ca000 con 0x7fa2000c7eb0 2024-04-25T12:21:30.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.929+0000 7fa1fd7fa640 1 -- 172.21.15.111:0/3834562938 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c0acc514-427d-41bf-a965-b8463cebf045", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fa1f00133c0 con 0x7fa2000c7eb0 2024-04-25T12:21:30.931 INFO:teuthology.orchestra.run.smithi111.stdout:5 2024-04-25T12:21:30.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.929+0000 7fa2070d1640 1 -- 172.21.15.111:0/3834562938 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa2000c7eb0 msgr2=0x7fa2001eeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:30.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.929+0000 7fa2070d1640 1 --2- 172.21.15.111:0/3834562938 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa2000c7eb0 0x7fa2001eeaf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000c430 tx=0x7fa1f000c8f0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.929+0000 7fa2070d1640 1 -- 172.21.15.111:0/3834562938 shutdown_connections 2024-04-25T12:21:30.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.929+0000 7fa2070d1640 1 --2- 172.21.15.111:0/3834562938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa200152ff0 0x7fa2000cdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.929+0000 7fa2070d1640 1 --2- 172.21.15.111:0/3834562938 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa2000ca550 0x7fa2000739a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.929+0000 7fa2070d1640 1 --2- 172.21.15.111:0/3834562938 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa2000c7eb0 0x7fa2001eeaf0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:30.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.929+0000 7fa2070d1640 1 -- 172.21.15.111:0/3834562938 >> 172.21.15.111:0/3834562938 conn(0x7fa2000676a0 msgr2=0x7fa200070a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:30.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.929+0000 7fa2070d1640 1 -- 172.21.15.111:0/3834562938 shutdown_connections 2024-04-25T12:21:30.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:30.929+0000 7fa2070d1640 1 -- 172.21.15.111:0/3834562938 wait complete. 2024-04-25T12:21:30.947 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd new 26ff742f-5a57-44a7-a095-f04d6e87f885 6 2024-04-25T12:21:30.958 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T12:21:30.957+0000 7fd613c8a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T12:21:31.013 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T12:21:31.013+0000 7fd613c8a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T12:21:31.060 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T12:21:31.058+0000 7f69abb1c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T12:21:31.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.065+0000 7f432f1cd640 1 Processor -- start 2024-04-25T12:21:31.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.065+0000 7f432f1cd640 1 -- start start 2024-04-25T12:21:31.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.069+0000 7f432f1cd640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f43280750e0 0x7f43281591a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.069+0000 7f432f1cd640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f432806f0e0 con 0x7f43280c6f50 2024-04-25T12:21:31.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.069+0000 7f432f1cd640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4328072660 con 0x7f43280c6b70 2024-04-25T12:21:31.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.069+0000 7f432f1cd640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f4328073270 con 0x7f43280750e0 2024-04-25T12:21:31.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.069+0000 7f432d76a640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f43280750e0 0x7f43281591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:31.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.069+0000 7f432d76a640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f43280750e0 0x7f43281591a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56834/0 (socket says 172.21.15.111:56834) 2024-04-25T12:21:31.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.069+0000 7f432d76a640 1 -- 172.21.15.111:0/3757166567 learned_addr learned my addr 172.21.15.111:0/3757166567 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T12:21:31.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.069+0000 7f432d76a640 1 -- 172.21.15.111:0/3757166567 >> v1:172.21.15.111:6789/0 conn(0x7f43280c6b70 legacy=0x7f432806e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:31.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.069+0000 7f432d76a640 1 -- 172.21.15.111:0/3757166567 >> v1:172.21.15.94:6789/0 conn(0x7f43280c6f50 legacy=0x7f4328152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:31.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.069+0000 7f432d76a640 1 -- 172.21.15.111:0/3757166567 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4328072940 con 0x7f43280750e0 2024-04-25T12:21:31.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.069+0000 7f432d76a640 1 --2- 172.21.15.111:0/3757166567 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f43280750e0 0x7f43281591a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4320009e50 tx=0x7f432001f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=852c57e02fcb5ae5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:31.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.069+0000 7f43277fe640 1 -- 172.21.15.111:0/3757166567 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43200b4070 con 0x7f43280750e0 2024-04-25T12:21:31.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.069+0000 7f43277fe640 1 -- 172.21.15.111:0/3757166567 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43200af400 con 0x7f43280750e0 2024-04-25T12:21:31.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.069+0000 7f43277fe640 1 -- 172.21.15.111:0/3757166567 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43200af7d0 con 0x7f43280750e0 2024-04-25T12:21:31.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432f1cd640 1 -- 172.21.15.111:0/3757166567 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f43280750e0 msgr2=0x7f43281591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:31.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432f1cd640 1 --2- 172.21.15.111:0/3757166567 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f43280750e0 0x7f43281591a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4320009e50 tx=0x7f432001f1e0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432f1cd640 1 -- 172.21.15.111:0/3757166567 shutdown_connections 2024-04-25T12:21:31.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432f1cd640 1 --2- 172.21.15.111:0/3757166567 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f43280750e0 0x7f43281591a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432f1cd640 1 -- 172.21.15.111:0/3757166567 >> 172.21.15.111:0/3757166567 conn(0x7f432806f760 msgr2=0x7f432806fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:31.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432f1cd640 1 -- 172.21.15.111:0/3757166567 shutdown_connections 2024-04-25T12:21:31.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432f1cd640 1 -- 172.21.15.111:0/3757166567 wait complete. 2024-04-25T12:21:31.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432f1cd640 1 Processor -- start 2024-04-25T12:21:31.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432f1cd640 1 -- start start 2024-04-25T12:21:31.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432f1cd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f43280750e0 0x7f43281e32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432f1cd640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f43280c6b70 0x7f43281e5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432f1cd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f43280c6f50 0x7f432814cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432f1cd640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f432806ec80 con 0x7f43280750e0 2024-04-25T12:21:31.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432f1cd640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f4328072f00 con 0x7f43280c6f50 2024-04-25T12:21:31.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432f1cd640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f432806ee00 con 0x7f43280c6b70 2024-04-25T12:21:31.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432d76a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f43280c6f50 0x7f432814cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:31.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432d76a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f43280c6f50 0x7f432814cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56850/0 (socket says 172.21.15.111:56850) 2024-04-25T12:21:31.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f4327fff640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f43280c6b70 0x7f43281e5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:31.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432d76a640 1 -- 172.21.15.111:0/138216481 learned_addr learned my addr 172.21.15.111:0/138216481 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T12:21:31.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432cf69640 1 --2- 172.21.15.111:0/138216481 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f43280750e0 0x7f43281e32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:31.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432d76a640 1 -- 172.21.15.111:0/138216481 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f43280c6b70 msgr2=0x7f43281e5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:31.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432d76a640 1 --2- 172.21.15.111:0/138216481 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f43280c6b70 0x7f43281e5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432d76a640 1 -- 172.21.15.111:0/138216481 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f43280750e0 msgr2=0x7f43281e32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:31.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432d76a640 1 --2- 172.21.15.111:0/138216481 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f43280750e0 0x7f43281e32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432d76a640 1 -- 172.21.15.111:0/138216481 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43280c7690 con 0x7f43280c6f50 2024-04-25T12:21:31.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f4327fff640 1 --2- 172.21.15.111:0/138216481 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f43280c6b70 0x7f43281e5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:21:31.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432d76a640 1 --2- 172.21.15.111:0/138216481 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f43280c6f50 0x7f432814cef0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f43200b2040 tx=0x7f432001bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:31.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f43257fa640 1 -- 172.21.15.111:0/138216481 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43200b4040 con 0x7f43280c6f50 2024-04-25T12:21:31.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f43257fa640 1 -- 172.21.15.111:0/138216481 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43200c0070 con 0x7f43280c6f50 2024-04-25T12:21:31.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f43257fa640 1 -- 172.21.15.111:0/138216481 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4320009510 con 0x7f43280c6f50 2024-04-25T12:21:31.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432f1cd640 1 -- 172.21.15.111:0/138216481 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f432815aac0 con 0x7f43280c6f50 2024-04-25T12:21:31.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f432f1cd640 1 -- 172.21.15.111:0/138216481 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f432815b080 con 0x7f43280c6f50 2024-04-25T12:21:31.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f43257fa640 1 -- 172.21.15.111:0/138216481 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f43200c5460 con 0x7f43280c6f50 2024-04-25T12:21:31.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.073+0000 7f43257fa640 1 -- 172.21.15.111:0/138216481 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f43200bab00 con 0x7f43280c6f50 2024-04-25T12:21:31.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.077+0000 7f432f1cd640 1 -- 172.21.15.111:0/138216481 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4328075df0 con 0x7f43280c6f50 2024-04-25T12:21:31.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.077+0000 7f43257fa640 1 -- 172.21.15.111:0/138216481 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f4320018d40 con 0x7f43280c6f50 2024-04-25T12:21:31.122 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T12:21:31.118+0000 7f69abb1c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T12:21:31.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.153+0000 7f432f1cd640 1 -- 172.21.15.111:0/138216481 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd new", "uuid": "26ff742f-5a57-44a7-a095-f04d6e87f885", "id": 6} v 0) -- 0x7f4328158380 con 0x7f43280c6f50 2024-04-25T12:21:31.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.161+0000 7f43257fa640 1 -- 172.21.15.111:0/138216481 <== mon.1 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "26ff742f-5a57-44a7-a095-f04d6e87f885", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f43200bad00 con 0x7f43280c6f50 2024-04-25T12:21:31.161 INFO:teuthology.orchestra.run.smithi111.stdout:6 2024-04-25T12:21:31.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.161+0000 7f432f1cd640 1 -- 172.21.15.111:0/138216481 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f43280c6f50 msgr2=0x7f432814cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:31.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.161+0000 7f432f1cd640 1 --2- 172.21.15.111:0/138216481 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f43280c6f50 0x7f432814cef0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f43200b2040 tx=0x7f432001bf80 comp rx=0 tx=0).stop 2024-04-25T12:21:31.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.161+0000 7f432f1cd640 1 -- 172.21.15.111:0/138216481 shutdown_connections 2024-04-25T12:21:31.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.161+0000 7f432f1cd640 1 --2- 172.21.15.111:0/138216481 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f43280c6b70 0x7f43281e5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.161+0000 7f432f1cd640 1 --2- 172.21.15.111:0/138216481 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f43280c6f50 0x7f432814cef0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.161+0000 7f432f1cd640 1 --2- 172.21.15.111:0/138216481 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f43280750e0 0x7f43281e32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.161+0000 7f432f1cd640 1 -- 172.21.15.111:0/138216481 >> 172.21.15.111:0/138216481 conn(0x7f432806f760 msgr2=0x7f43280c9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:31.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.161+0000 7f432f1cd640 1 -- 172.21.15.111:0/138216481 shutdown_connections 2024-04-25T12:21:31.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.161+0000 7f432f1cd640 1 -- 172.21.15.111:0/138216481 wait complete. 2024-04-25T12:21:31.177 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd new 9c214cba-693a-4b25-aad7-05a5b0006e40 7 2024-04-25T12:21:31.180 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T12:21:31.177+0000 7fd613c8a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T12:21:31.244 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T12:21:31.241+0000 7fd613c8a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T12:21:31.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.289+0000 7f1c94f26640 1 Processor -- start 2024-04-25T12:21:31.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.289+0000 7f1c94f26640 1 -- start start 2024-04-25T12:21:31.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.293+0000 7f1c94f26640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1c90071530 0x7f1c900c9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.293+0000 7f1c94f26640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1c900c98b0 0x7f1c900cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.293+0000 7f1c94f26640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c900c8080 con 0x7f1c90159cf0 2024-04-25T12:21:31.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.293+0000 7f1c94f26640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f1c900c5d80 con 0x7f1c90071530 2024-04-25T12:21:31.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.293+0000 7f1c94f26640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f1c900c8360 con 0x7f1c900c98b0 2024-04-25T12:21:31.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.293+0000 7f1c8ed9d640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1c900c98b0 0x7f1c900cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:31.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.293+0000 7f1c8ed9d640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1c900c98b0 0x7f1c900cb1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:33074/0 (socket says 172.21.15.111:33074) 2024-04-25T12:21:31.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.293+0000 7f1c8ed9d640 1 -- 172.21.15.111:0/2525301082 learned_addr learned my addr 172.21.15.111:0/2525301082 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T12:21:31.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.293+0000 7f1c87fff640 1 --2- 172.21.15.111:0/2525301082 >> v2:172.21.15.94:3300/0 conn(0x7f1c90071530 0x7f1c900c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:31.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.293+0000 7f1c8ed9d640 1 -- 172.21.15.111:0/2525301082 >> v2:172.21.15.94:3300/0 conn(0x7f1c90071530 msgr2=0x7f1c900c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:31.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.293+0000 7f1c8ed9d640 1 --2- 172.21.15.111:0/2525301082 >> v2:172.21.15.94:3300/0 conn(0x7f1c90071530 0x7f1c900c9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.293+0000 7f1c8ed9d640 1 -- 172.21.15.111:0/2525301082 >> v1:172.21.15.94:6789/0 conn(0x7f1c90159cf0 legacy=0x7f1c900c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:31.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.293+0000 7f1c8ed9d640 1 -- 172.21.15.111:0/2525301082 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c900c8640 con 0x7f1c900c98b0 2024-04-25T12:21:31.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.293+0000 7f1c8ed9d640 1 --2- 172.21.15.111:0/2525301082 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1c900c98b0 0x7f1c900cb1e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1c900c5f00 tx=0x7f1c8801f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d54a0e890cdbb9df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:31.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.293+0000 7f1c8dd9b640 1 -- 172.21.15.111:0/2525301082 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c880b4070 con 0x7f1c900c98b0 2024-04-25T12:21:31.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.293+0000 7f1c8dd9b640 1 -- 172.21.15.111:0/2525301082 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c880af400 con 0x7f1c900c98b0 2024-04-25T12:21:31.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.293+0000 7f1c8dd9b640 1 -- 172.21.15.111:0/2525301082 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c880af7d0 con 0x7f1c900c98b0 2024-04-25T12:21:31.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c94f26640 1 -- 172.21.15.111:0/2525301082 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1c900c98b0 msgr2=0x7f1c900cb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:31.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c94f26640 1 --2- 172.21.15.111:0/2525301082 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1c900c98b0 0x7f1c900cb1e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1c900c5f00 tx=0x7f1c8801f1c0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c94f26640 1 -- 172.21.15.111:0/2525301082 shutdown_connections 2024-04-25T12:21:31.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c94f26640 1 --2- 172.21.15.111:0/2525301082 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1c900c98b0 0x7f1c900cb1e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c94f26640 1 --2- 172.21.15.111:0/2525301082 >> v2:172.21.15.94:3300/0 conn(0x7f1c90071530 0x7f1c900c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c94f26640 1 -- 172.21.15.111:0/2525301082 >> 172.21.15.111:0/2525301082 conn(0x7f1c900676a0 msgr2=0x7f1c90067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:31.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c94f26640 1 -- 172.21.15.111:0/2525301082 shutdown_connections 2024-04-25T12:21:31.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c94f26640 1 -- 172.21.15.111:0/2525301082 wait complete. 2024-04-25T12:21:31.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c94f26640 1 Processor -- start 2024-04-25T12:21:31.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c94f26640 1 -- start start 2024-04-25T12:21:31.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c94f26640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1c90071530 0x7f1c9015a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c94f26640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1c900c98b0 0x7f1c901523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c94f26640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1c90159cf0 0x7f1c9013fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c94f26640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1c900c6920 con 0x7f1c90159cf0 2024-04-25T12:21:31.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c94f26640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1c900c8c00 con 0x7f1c90071530 2024-04-25T12:21:31.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c94f26640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f1c90071950 con 0x7f1c900c98b0 2024-04-25T12:21:31.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c87fff640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1c900c98b0 0x7f1c901523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:31.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c8e59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1c90071530 0x7f1c9015a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:31.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c87fff640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1c900c98b0 0x7f1c901523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:33078/0 (socket says 172.21.15.111:33078) 2024-04-25T12:21:31.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c87fff640 1 -- 172.21.15.111:0/2234538549 learned_addr learned my addr 172.21.15.111:0/2234538549 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T12:21:31.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c8ed9d640 1 --2- 172.21.15.111:0/2234538549 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1c90159cf0 0x7f1c9013fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:31.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c87fff640 1 -- 172.21.15.111:0/2234538549 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1c90071530 msgr2=0x7f1c9015a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:31.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c87fff640 1 --2- 172.21.15.111:0/2234538549 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1c90071530 0x7f1c9015a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c87fff640 1 -- 172.21.15.111:0/2234538549 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1c90159cf0 msgr2=0x7f1c9013fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:31.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c87fff640 1 --2- 172.21.15.111:0/2234538549 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1c90159cf0 0x7f1c9013fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c87fff640 1 -- 172.21.15.111:0/2234538549 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c901e2430 con 0x7f1c900c98b0 2024-04-25T12:21:31.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c8e59c640 1 --2- 172.21.15.111:0/2234538549 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1c90071530 0x7f1c9015a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:21:31.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c87fff640 1 --2- 172.21.15.111:0/2234538549 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1c900c98b0 0x7f1c901523d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1c7800c7f0 tx=0x7f1c7800ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:31.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c86ffd640 1 -- 172.21.15.111:0/2234538549 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c78015070 con 0x7f1c900c98b0 2024-04-25T12:21:31.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c86ffd640 1 -- 172.21.15.111:0/2234538549 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c78007820 con 0x7f1c900c98b0 2024-04-25T12:21:31.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c94f26640 1 -- 172.21.15.111:0/2234538549 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c901e26d0 con 0x7f1c900c98b0 2024-04-25T12:21:31.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c86ffd640 1 -- 172.21.15.111:0/2234538549 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c78007c10 con 0x7f1c900c98b0 2024-04-25T12:21:31.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c94f26640 1 -- 172.21.15.111:0/2234538549 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c901e2c90 con 0x7f1c900c98b0 2024-04-25T12:21:31.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c86ffd640 1 -- 172.21.15.111:0/2234538549 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1c78018070 con 0x7f1c900c98b0 2024-04-25T12:21:31.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.297+0000 7f1c86ffd640 1 -- 172.21.15.111:0/2234538549 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f1c78011a50 con 0x7f1c900c98b0 2024-04-25T12:21:31.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.301+0000 7f1c94f26640 1 -- 172.21.15.111:0/2234538549 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c90075df0 con 0x7f1c900c98b0 2024-04-25T12:21:31.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.301+0000 7f1c86ffd640 1 -- 172.21.15.111:0/2234538549 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f1c78007db0 con 0x7f1c900c98b0 2024-04-25T12:21:31.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.369+0000 7f1c94f26640 1 -- 172.21.15.111:0/2234538549 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9c214cba-693a-4b25-aad7-05a5b0006e40", "id": 7} v 0) -- 0x7f1c900c9150 con 0x7f1c900c98b0 2024-04-25T12:21:31.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.377+0000 7f1c86ffd640 1 -- 172.21.15.111:0/2234538549 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9c214cba-693a-4b25-aad7-05a5b0006e40", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f1c780040f0 con 0x7f1c900c98b0 2024-04-25T12:21:31.378 INFO:teuthology.orchestra.run.smithi111.stdout:7 2024-04-25T12:21:31.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.377+0000 7f1c94f26640 1 -- 172.21.15.111:0/2234538549 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1c900c98b0 msgr2=0x7f1c901523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:31.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.377+0000 7f1c94f26640 1 --2- 172.21.15.111:0/2234538549 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1c900c98b0 0x7f1c901523d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1c7800c7f0 tx=0x7f1c7800ccb0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.377+0000 7f1c94f26640 1 -- 172.21.15.111:0/2234538549 shutdown_connections 2024-04-25T12:21:31.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.377+0000 7f1c94f26640 1 --2- 172.21.15.111:0/2234538549 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1c900c98b0 0x7f1c901523d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.377+0000 7f1c94f26640 1 --2- 172.21.15.111:0/2234538549 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1c90159cf0 0x7f1c9013fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.377+0000 7f1c94f26640 1 --2- 172.21.15.111:0/2234538549 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1c90071530 0x7f1c9015a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.377+0000 7f1c94f26640 1 -- 172.21.15.111:0/2234538549 >> 172.21.15.111:0/2234538549 conn(0x7f1c900676a0 msgr2=0x7f1c90152fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:31.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.377+0000 7f1c94f26640 1 -- 172.21.15.111:0/2234538549 shutdown_connections 2024-04-25T12:21:31.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T12:21:31.377+0000 7f1c94f26640 1 -- 172.21.15.111:0/2234538549 wait complete. 2024-04-25T12:21:31.394 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T12:21:31.394 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T12:21:31.396 INFO:tasks.ceph.osd.0:Started 2024-04-25T12:21:31.396 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T12:21:31.397 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T12:21:31.399 INFO:tasks.ceph.osd.1:Started 2024-04-25T12:21:31.399 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T12:21:31.399 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T12:21:31.401 INFO:tasks.ceph.osd.2:Started 2024-04-25T12:21:31.401 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T12:21:31.402 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T12:21:31.404 INFO:tasks.ceph.osd.3:Started 2024-04-25T12:21:31.404 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T12:21:31.404 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T12:21:31.438 INFO:tasks.ceph.osd.4:Started 2024-04-25T12:21:31.438 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T12:21:31.438 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T12:21:31.439 INFO:tasks.ceph.osd.5:Started 2024-04-25T12:21:31.440 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T12:21:31.440 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-25T12:21:31.441 INFO:tasks.ceph.osd.6:Started 2024-04-25T12:21:31.441 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T12:21:31.442 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-25T12:21:31.443 INFO:tasks.ceph.osd.7:Started 2024-04-25T12:21:31.444 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:21:31.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.586+0000 7fd42cd50640 1 Processor -- start 2024-04-25T12:21:31.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.586+0000 7fd42cd50640 1 -- start start 2024-04-25T12:21:31.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.586+0000 7fd42cd50640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd428158880 0x7fd4280676a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.586+0000 7fd42cd50640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd42806e720 0x7fd4280b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.586+0000 7fd42cd50640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd42806ec60 con 0x7fd428073d50 2024-04-25T12:21:31.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.586+0000 7fd42cd50640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fd4280b0540 con 0x7fd428158880 2024-04-25T12:21:31.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.586+0000 7fd42cd50640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd4280afa00 con 0x7fd42806e720 2024-04-25T12:21:31.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.586+0000 7fd42659c640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd428158880 0x7fd4280676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:31.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.586+0000 7fd425d9b640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd42806e720 0x7fd4280b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:31.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.586+0000 7fd425d9b640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd42806e720 0x7fd4280b1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.94:57766/0 (socket says 172.21.15.94:57766) 2024-04-25T12:21:31.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.586+0000 7fd42659c640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd428158880 0x7fd4280676a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.94:47476/0 (socket says 172.21.15.94:47476) 2024-04-25T12:21:31.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.586+0000 7fd425d9b640 1 -- 172.21.15.94:0/3099703894 learned_addr learned my addr 172.21.15.94:0/3099703894 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:31.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.590+0000 7fd425d9b640 1 -- 172.21.15.94:0/3099703894 >> v2:172.21.15.111:3300/0 conn(0x7fd428158880 msgr2=0x7fd4280676a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:31.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.590+0000 7fd425d9b640 1 --2- 172.21.15.94:0/3099703894 >> v2:172.21.15.111:3300/0 conn(0x7fd428158880 0x7fd4280676a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.590+0000 7fd425d9b640 1 -- 172.21.15.94:0/3099703894 >> v1:172.21.15.111:6789/0 conn(0x7fd428073d50 legacy=0x7fd42815b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:31.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.590+0000 7fd425d9b640 1 -- 172.21.15.94:0/3099703894 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd42815b130 con 0x7fd42806e720 2024-04-25T12:21:31.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.590+0000 7fd425d9b640 1 --2- 172.21.15.94:0/3099703894 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd42806e720 0x7fd4280b1a10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd418009870 tx=0x7fd41801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=356b431f545b3fb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:31.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.590+0000 7fd42559a640 1 -- 172.21.15.94:0/3099703894 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4180ab650 con 0x7fd42806e720 2024-04-25T12:21:31.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.590+0000 7fd42559a640 1 -- 172.21.15.94:0/3099703894 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4180b0070 con 0x7fd42806e720 2024-04-25T12:21:31.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.590+0000 7fd42559a640 1 -- 172.21.15.94:0/3099703894 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4180aba10 con 0x7fd42806e720 2024-04-25T12:21:31.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.590+0000 7fd42cd50640 1 -- 172.21.15.94:0/3099703894 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd42806e720 msgr2=0x7fd4280b1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:31.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.590+0000 7fd42cd50640 1 --2- 172.21.15.94:0/3099703894 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd42806e720 0x7fd4280b1a10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd418009870 tx=0x7fd41801c560 comp rx=0 tx=0).stop 2024-04-25T12:21:31.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.590+0000 7fd42cd50640 1 -- 172.21.15.94:0/3099703894 shutdown_connections 2024-04-25T12:21:31.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.590+0000 7fd42cd50640 1 --2- 172.21.15.94:0/3099703894 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd42806e720 0x7fd4280b1a10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.590+0000 7fd42cd50640 1 --2- 172.21.15.94:0/3099703894 >> v2:172.21.15.111:3300/0 conn(0x7fd428158880 0x7fd4280676a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.590+0000 7fd42cd50640 1 -- 172.21.15.94:0/3099703894 >> 172.21.15.94:0/3099703894 conn(0x7fd42806f280 msgr2=0x7fd42806f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:31.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.590+0000 7fd42cd50640 1 -- 172.21.15.94:0/3099703894 shutdown_connections 2024-04-25T12:21:31.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.590+0000 7fd42cd50640 1 -- 172.21.15.94:0/3099703894 wait complete. 2024-04-25T12:21:31.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd42cd50640 1 Processor -- start 2024-04-25T12:21:31.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd42cd50640 1 -- start start 2024-04-25T12:21:31.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd42cd50640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd42806e720 0x7fd4281f5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd42cd50640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd428073d50 0x7fd428072b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd42cd50640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd428158880 0x7fd4280c4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:31.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd42cd50640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd4281683b0 con 0x7fd42806e720 2024-04-25T12:21:31.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd42cd50640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd428168230 con 0x7fd428073d50 2024-04-25T12:21:31.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd42cd50640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd428168530 con 0x7fd428158880 2024-04-25T12:21:31.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd42659c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd42806e720 0x7fd4281f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:31.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd42659c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd42806e720 0x7fd4281f5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59444/0 (socket says 172.21.15.94:59444) 2024-04-25T12:21:31.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd42659c640 1 -- 172.21.15.94:0/2627254225 learned_addr learned my addr 172.21.15.94:0/2627254225 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:31.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd426d9d640 1 --2- 172.21.15.94:0/2627254225 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd428158880 0x7fd4280c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:31.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd425d9b640 1 --2- 172.21.15.94:0/2627254225 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd428073d50 0x7fd428072b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:31.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd42659c640 1 -- 172.21.15.94:0/2627254225 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd428158880 msgr2=0x7fd4280c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:31.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd42659c640 1 --2- 172.21.15.94:0/2627254225 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd428158880 0x7fd4280c4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd42659c640 1 -- 172.21.15.94:0/2627254225 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd428073d50 msgr2=0x7fd428072b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:31.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd42659c640 1 --2- 172.21.15.94:0/2627254225 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd428073d50 0x7fd428072b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd42659c640 1 -- 172.21.15.94:0/2627254225 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4280c6800 con 0x7fd42806e720 2024-04-25T12:21:31.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd42659c640 1 --2- 172.21.15.94:0/2627254225 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd42806e720 0x7fd4281f5480 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd41c00e930 tx=0x7fd41c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:31.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd416ffd640 1 -- 172.21.15.94:0/2627254225 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c017070 con 0x7fd42806e720 2024-04-25T12:21:31.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd416ffd640 1 -- 172.21.15.94:0/2627254225 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd41c00ca00 con 0x7fd42806e720 2024-04-25T12:21:31.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd42cd50640 1 -- 172.21.15.94:0/2627254225 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd428150170 con 0x7fd42806e720 2024-04-25T12:21:31.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd416ffd640 1 -- 172.21.15.94:0/2627254225 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c00cdb0 con 0x7fd42806e720 2024-04-25T12:21:31.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd42cd50640 1 -- 172.21.15.94:0/2627254225 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4280c6d50 con 0x7fd42806e720 2024-04-25T12:21:31.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd416ffd640 1 -- 172.21.15.94:0/2627254225 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd41c01a070 con 0x7fd42806e720 2024-04-25T12:21:31.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd416ffd640 1 -- 172.21.15.94:0/2627254225 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fd41c01cbc0 con 0x7fd42806e720 2024-04-25T12:21:31.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.594+0000 7fd42cd50640 1 -- 172.21.15.94:0/2627254225 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4280c4240 con 0x7fd42806e720 2024-04-25T12:21:31.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.598+0000 7fd416ffd640 1 -- 172.21.15.94:0/2627254225 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd428150170 con 0x7fd42806e720 2024-04-25T12:21:31.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.650+0000 7fd42cd50640 1 -- 172.21.15.94:0/2627254225 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd428075df0 con 0x7fd42806e720 2024-04-25T12:21:31.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.654+0000 7fd416ffd640 1 -- 172.21.15.94:0/2627254225 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fd41c01c4f0 con 0x7fd42806e720 2024-04-25T12:21:31.657 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:21:31.657 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":10,"fsid":"7059a9e2-aec4-4b84-b942-caf531e15da3","created":"2024-04-25T12:21:29.118508+0000","modified":"2024-04-25T12:21:31.372905+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T12:21:31.372905+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"640a65ef-0734-468a-a8f5-9ed70cf75c1b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d6e886e6-c8c1-4761-9a4c-abc6961c7c81","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ba20f409-ed46-43b6-b16d-43dc4622c042","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"85816a2b-3a3f-4ec8-8373-8230d948396f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b4a953b7-01d6-4623-9324-63135fdaf148","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c0acc514-427d-41bf-a965-b8463cebf045","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"26ff742f-5a57-44a7-a095-f04d6e87f885","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9c214cba-693a-4b25-aad7-05a5b0006e40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:21:31.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.654+0000 7fd42cd50640 1 -- 172.21.15.94:0/2627254225 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd42806e720 msgr2=0x7fd4281f5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:31.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.654+0000 7fd42cd50640 1 --2- 172.21.15.94:0/2627254225 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd42806e720 0x7fd4281f5480 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd41c00e930 tx=0x7fd41c00edf0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.654+0000 7fd42cd50640 1 -- 172.21.15.94:0/2627254225 shutdown_connections 2024-04-25T12:21:31.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.654+0000 7fd42cd50640 1 --2- 172.21.15.94:0/2627254225 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd428158880 0x7fd4280c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.654+0000 7fd42cd50640 1 --2- 172.21.15.94:0/2627254225 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd428073d50 0x7fd428072b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.654+0000 7fd42cd50640 1 --2- 172.21.15.94:0/2627254225 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd42806e720 0x7fd4281f5480 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:31.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.654+0000 7fd42cd50640 1 -- 172.21.15.94:0/2627254225 >> 172.21.15.94:0/2627254225 conn(0x7fd42806f280 msgr2=0x7fd42815a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:31.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.654+0000 7fd42cd50640 1 -- 172.21.15.94:0/2627254225 shutdown_connections 2024-04-25T12:21:31.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:31.654+0000 7fd42cd50640 1 -- 172.21.15.94:0/2627254225 wait complete. 2024-04-25T12:21:31.672 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T12:21:31.673 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T12:21:31.782 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-04-25T12:21:31.778+0000 7f45e2f2d7c0 -1 Falling back to public interface 2024-04-25T12:21:31.794 INFO:tasks.ceph.mgr.y.smithi094.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T12:21:31.794 INFO:tasks.ceph.mgr.y.smithi094.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T12:21:31.794 INFO:tasks.ceph.mgr.y.smithi094.stderr: from numpy import show_config as show_numpy_config 2024-04-25T12:21:31.798 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-04-25T12:21:31.794+0000 7f61713f07c0 -1 Falling back to public interface 2024-04-25T12:21:31.841 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T12:21:31.838+0000 7f69abb1c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T12:21:31.910 INFO:tasks.ceph.mgr.x.smithi111.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T12:21:31.910 INFO:tasks.ceph.mgr.x.smithi111.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T12:21:31.910 INFO:tasks.ceph.mgr.x.smithi111.stderr: from numpy import show_config as show_numpy_config 2024-04-25T12:21:31.956 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T12:21:31.953+0000 7fd613c8a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T12:21:31.987 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T12:21:31.982+0000 7f69abb1c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T12:21:32.050 INFO:tasks.ceph.osd.5.smithi111.stderr:2024-04-25T12:21:32.049+0000 7f2771a627c0 -1 Falling back to public interface 2024-04-25T12:21:32.051 INFO:tasks.ceph.osd.7.smithi111.stderr:2024-04-25T12:21:32.049+0000 7fcdf19bc7c0 -1 Falling back to public interface 2024-04-25T12:21:32.051 INFO:tasks.ceph.osd.5.smithi111.stderr:2024-04-25T12:21:32.049+0000 7f2770a22640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-04-25T12:21:32.051 INFO:tasks.ceph.osd.4.smithi111.stderr:2024-04-25T12:21:32.049+0000 7f2bffaea7c0 -1 Falling back to public interface 2024-04-25T12:21:32.053 INFO:tasks.ceph.osd.5.smithi111.stderr:2024-04-25T12:21:32.053+0000 7f2770a22640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6817/0: (98) Address already in use 2024-04-25T12:21:32.057 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-04-25T12:21:32.057+0000 7f1fcd4817c0 -1 Falling back to public interface 2024-04-25T12:21:32.058 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-25T12:21:32.054+0000 7f15a1c2e7c0 -1 Falling back to public interface 2024-04-25T12:21:32.059 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-04-25T12:21:32.054+0000 7f6761dfc7c0 -1 Falling back to public interface 2024-04-25T12:21:32.110 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T12:21:32.109+0000 7fd613c8a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T12:21:32.162 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T12:21:32.158+0000 7f69abb1c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T12:21:32.225 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T12:21:32.222+0000 7f69abb1c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T12:21:32.282 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T12:21:32.281+0000 7fd613c8a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T12:21:32.350 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T12:21:32.349+0000 7fd613c8a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T12:21:32.358 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T12:21:32.354+0000 7f69abb1c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T12:21:32.477 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T12:21:32.485 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T12:21:32.481+0000 7fd613c8a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T12:21:32.584 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.578+0000 7fb2665ef640 1 Processor -- start 2024-04-25T12:21:32.585 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.582+0000 7fb2665ef640 1 -- start start 2024-04-25T12:21:32.586 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.582+0000 7fb2665ef640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb26015f2d0 0x7fb26015bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:32.586 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.582+0000 7fb2665ef640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb26015e6e0 con 0x7fb2600708b0 2024-04-25T12:21:32.586 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.582+0000 7fb2665ef640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb26006b9e0 con 0x7fb260155300 2024-04-25T12:21:32.586 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.582+0000 7fb2665ef640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fb26006bcc0 con 0x7fb26015f2d0 2024-04-25T12:21:32.587 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.582+0000 7fb264b8c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb26015f2d0 0x7fb26015bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:32.587 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.582+0000 7fb25f7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fb2600708b0 0x7fb26015ebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:47444/0 (socket says 172.21.15.94:47444) 2024-04-25T12:21:32.587 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.582+0000 7fb25f7fe640 1 -- 172.21.15.94:0/3357358011 learned_addr learned my addr 172.21.15.94:0/3357358011 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:21:32.587 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.582+0000 7fb264b8c640 1 -- 172.21.15.94:0/3357358011 >> v1:172.21.15.111:6789/0 conn(0x7fb260155300 legacy=0x7fb2600c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:32.587 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.582+0000 7fb264b8c640 1 -- 172.21.15.94:0/3357358011 >> v1:172.21.15.94:6789/0 conn(0x7fb2600708b0 legacy=0x7fb26015ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:32.587 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.582+0000 7fb264b8c640 1 -- 172.21.15.94:0/3357358011 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26006bfa0 con 0x7fb26015f2d0 2024-04-25T12:21:32.588 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.582+0000 7fb264b8c640 1 --2- 172.21.15.94:0/3357358011 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb26015f2d0 0x7fb26015bad0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb258009d90 tx=0x7fb25801f120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134ad814e0358a83 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:32.588 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.582+0000 7fb25effd640 1 -- 172.21.15.94:0/3357358011 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2580b4070 con 0x7fb26015f2d0 2024-04-25T12:21:32.588 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.582+0000 7fb25effd640 1 -- 172.21.15.94:0/3357358011 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2580af600 con 0x7fb26015f2d0 2024-04-25T12:21:32.589 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.582+0000 7fb25effd640 1 -- 172.21.15.94:0/3357358011 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2580af9d0 con 0x7fb26015f2d0 2024-04-25T12:21:32.589 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb2665ef640 1 -- 172.21.15.94:0/3357358011 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb26015f2d0 msgr2=0x7fb26015bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:32.589 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb2665ef640 1 --2- 172.21.15.94:0/3357358011 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb26015f2d0 0x7fb26015bad0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb258009d90 tx=0x7fb25801f120 comp rx=0 tx=0).stop 2024-04-25T12:21:32.589 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb2665ef640 1 -- 172.21.15.94:0/3357358011 shutdown_connections 2024-04-25T12:21:32.590 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb2665ef640 1 --2- 172.21.15.94:0/3357358011 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb26015f2d0 0x7fb26015bad0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:32.590 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb2665ef640 1 -- 172.21.15.94:0/3357358011 >> 172.21.15.94:0/3357358011 conn(0x7fb26006caf0 msgr2=0x7fb26006cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:32.590 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb2665ef640 1 -- 172.21.15.94:0/3357358011 shutdown_connections 2024-04-25T12:21:32.590 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb2665ef640 1 -- 172.21.15.94:0/3357358011 wait complete. 2024-04-25T12:21:32.590 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb2665ef640 1 Processor -- start 2024-04-25T12:21:32.590 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb2665ef640 1 -- start start 2024-04-25T12:21:32.593 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb2665ef640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2600708b0 0x7fb2601466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:32.593 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb2665ef640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb260155300 0x7fb2601422f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:32.593 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb2665ef640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb26015f2d0 0x7fb260149600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:32.593 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb2665ef640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb2601556e0 con 0x7fb2600708b0 2024-04-25T12:21:32.593 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb2665ef640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb26006c560 con 0x7fb260155300 2024-04-25T12:21:32.594 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb2665ef640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fb2600c9b60 con 0x7fb26015f2d0 2024-04-25T12:21:32.594 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb25ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2600708b0 0x7fb2601466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:32.594 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb25ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2600708b0 0x7fb2601466a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37866/0 (socket says 172.21.15.94:37866) 2024-04-25T12:21:32.594 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb25ffff640 1 -- 172.21.15.94:0/2870098279 learned_addr learned my addr 172.21.15.94:0/2870098279 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:32.594 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb25f7fe640 1 --2- 172.21.15.94:0/2870098279 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb260155300 0x7fb2601422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:32.594 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb25ffff640 1 -- 172.21.15.94:0/2870098279 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb26015f2d0 msgr2=0x7fb260149600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:32.594 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb25ffff640 1 --2- 172.21.15.94:0/2870098279 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb26015f2d0 0x7fb260149600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:32.594 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb25ffff640 1 -- 172.21.15.94:0/2870098279 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb260155300 msgr2=0x7fb2601422f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:32.594 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb25ffff640 1 --2- 172.21.15.94:0/2870098279 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb260155300 0x7fb2601422f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:32.594 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb25ffff640 1 -- 172.21.15.94:0/2870098279 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb260146be0 con 0x7fb2600708b0 2024-04-25T12:21:32.594 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb25f7fe640 1 --2- 172.21.15.94:0/2870098279 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb260155300 0x7fb2601422f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:32.594 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb25ffff640 1 --2- 172.21.15.94:0/2870098279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2600708b0 0x7fb2601466a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb25000c450 tx=0x7fb25000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:32.594 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb25cff9640 1 -- 172.21.15.94:0/2870098279 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb250011790 con 0x7fb2600708b0 2024-04-25T12:21:32.595 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb25cff9640 1 -- 172.21.15.94:0/2870098279 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb250017070 con 0x7fb2600708b0 2024-04-25T12:21:32.595 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb2665ef640 1 -- 172.21.15.94:0/2870098279 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb260142830 con 0x7fb2600708b0 2024-04-25T12:21:32.595 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb25cff9640 1 -- 172.21.15.94:0/2870098279 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb250011b90 con 0x7fb2600708b0 2024-04-25T12:21:32.595 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb2665ef640 1 -- 172.21.15.94:0/2870098279 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb26015c590 con 0x7fb2600708b0 2024-04-25T12:21:32.595 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb25cff9640 1 -- 172.21.15.94:0/2870098279 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb250011d30 con 0x7fb2600708b0 2024-04-25T12:21:32.595 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.586+0000 7fb25cff9640 1 -- 172.21.15.94:0/2870098279 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fb250012cd0 con 0x7fb2600708b0 2024-04-25T12:21:32.595 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.590+0000 7fb2665ef640 1 -- 172.21.15.94:0/2870098279 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2600763e0 con 0x7fb2600708b0 2024-04-25T12:21:32.595 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.590+0000 7fb25cff9640 1 -- 172.21.15.94:0/2870098279 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb2500126d0 con 0x7fb2600708b0 2024-04-25T12:21:32.652 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.646+0000 7fb2665ef640 1 -- 172.21.15.94:0/2870098279 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb260073ef0 con 0x7fb2600708b0 2024-04-25T12:21:32.652 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.646+0000 7fb25cff9640 1 -- 172.21.15.94:0/2870098279 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fb250012970 con 0x7fb2600708b0 2024-04-25T12:21:32.653 INFO:teuthology.misc.health.smithi094.stdout: 2024-04-25T12:21:32.653 INFO:teuthology.misc.health.smithi094.stdout:{"epoch":10,"fsid":"7059a9e2-aec4-4b84-b942-caf531e15da3","created":"2024-04-25T12:21:29.118508+0000","modified":"2024-04-25T12:21:31.372905+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T12:21:31.372905+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"640a65ef-0734-468a-a8f5-9ed70cf75c1b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d6e886e6-c8c1-4761-9a4c-abc6961c7c81","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ba20f409-ed46-43b6-b16d-43dc4622c042","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"85816a2b-3a3f-4ec8-8373-8230d948396f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b4a953b7-01d6-4623-9324-63135fdaf148","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c0acc514-427d-41bf-a965-b8463cebf045","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"26ff742f-5a57-44a7-a095-f04d6e87f885","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9c214cba-693a-4b25-aad7-05a5b0006e40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:21:32.654 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.650+0000 7fb2665ef640 1 -- 172.21.15.94:0/2870098279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2600708b0 msgr2=0x7fb2601466a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:32.654 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.650+0000 7fb2665ef640 1 --2- 172.21.15.94:0/2870098279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2600708b0 0x7fb2601466a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb25000c450 tx=0x7fb25000c910 comp rx=0 tx=0).stop 2024-04-25T12:21:32.654 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.650+0000 7fb2665ef640 1 -- 172.21.15.94:0/2870098279 shutdown_connections 2024-04-25T12:21:32.654 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.650+0000 7fb2665ef640 1 --2- 172.21.15.94:0/2870098279 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb26015f2d0 0x7fb260149600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:32.654 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.650+0000 7fb2665ef640 1 --2- 172.21.15.94:0/2870098279 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb260155300 0x7fb2601422f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:32.654 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.650+0000 7fb2665ef640 1 --2- 172.21.15.94:0/2870098279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2600708b0 0x7fb2601466a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:32.654 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.650+0000 7fb2665ef640 1 -- 172.21.15.94:0/2870098279 >> 172.21.15.94:0/2870098279 conn(0x7fb26006caf0 msgr2=0x7fb26006ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:32.654 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.650+0000 7fb2665ef640 1 -- 172.21.15.94:0/2870098279 shutdown_connections 2024-04-25T12:21:32.654 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:32.650+0000 7fb2665ef640 1 -- 172.21.15.94:0/2870098279 wait complete. 2024-04-25T12:21:32.667 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T12:21:33.024 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T12:21:33.018+0000 7f69abb1c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T12:21:33.100 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T12:21:33.094+0000 7f69abb1c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T12:21:33.115 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T12:21:33.113+0000 7fd613c8a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T12:21:33.191 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T12:21:33.189+0000 7fd613c8a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T12:21:33.282 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T12:21:33.278+0000 7f69abb1c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T12:21:33.356 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T12:21:33.350+0000 7f69abb1c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T12:21:33.374 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T12:21:33.373+0000 7fd613c8a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T12:21:33.447 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T12:21:33.445+0000 7fd613c8a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T12:21:33.646 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T12:21:33.642+0000 7f69abb1c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T12:21:33.707 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T12:21:33.702+0000 7f69abb1c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T12:21:33.739 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T12:21:33.737+0000 7fd613c8a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T12:21:33.805 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T12:21:33.805+0000 7fd613c8a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T12:21:34.752 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T12:21:34.746+0000 7f6952f69640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T12:21:34.753 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-04-25T12:21:34.750+0000 7f6952f69640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T12:21:35.624 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-04-25T12:21:35.618+0000 7f45e2f2d7c0 -1 osd.2 0 log_to_monitors true 2024-04-25T12:21:35.700 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-04-25T12:21:35.694+0000 7f61713f07c0 -1 osd.0 0 log_to_monitors true 2024-04-25T12:21:35.846 INFO:tasks.ceph.osd.5.smithi111.stderr:2024-04-25T12:21:35.844+0000 7f2771a627c0 -1 osd.5 0 log_to_monitors true 2024-04-25T12:21:35.857 INFO:tasks.ceph.osd.7.smithi111.stderr:2024-04-25T12:21:35.856+0000 7fcdf19bc7c0 -1 osd.7 0 log_to_monitors true 2024-04-25T12:21:35.876 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-25T12:21:35.870+0000 7f15a1c2e7c0 -1 osd.1 0 log_to_monitors true 2024-04-25T12:21:35.938 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-04-25T12:21:35.936+0000 7f1fcd4817c0 -1 osd.6 0 log_to_monitors true 2024-04-25T12:21:35.950 INFO:tasks.ceph.osd.4.smithi111.stderr:2024-04-25T12:21:35.948+0000 7f2bffaea7c0 -1 osd.4 0 log_to_monitors true 2024-04-25T12:21:36.070 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-04-25T12:21:36.066+0000 7f6761dfc7c0 -1 osd.3 0 log_to_monitors true 2024-04-25T12:21:37.783 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-04-25T12:21:37.778+0000 7f616d399640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T12:21:37.787 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-04-25T12:21:37.782+0000 7f45deed6640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T12:21:37.843 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-04-25T12:21:37.838+0000 7f45d6d0a640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T12:21:37.855 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-04-25T12:21:37.850+0000 7f61651cd640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T12:21:38.772 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-25T12:21:38.766+0000 7f159dbd7640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T12:21:38.773 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-04-25T12:21:38.770+0000 7f675dda5640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T12:21:38.810 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-04-25T12:21:38.806+0000 7f6755bd9640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T12:21:38.810 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-25T12:21:38.806+0000 7f1595a0b640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T12:21:39.473 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T12:21:39.593 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f99783f9640 1 Processor -- start 2024-04-25T12:21:39.593 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f99783f9640 1 -- start start 2024-04-25T12:21:39.594 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f99783f9640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f99700737c0 0x7f9970141db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:39.594 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f99783f9640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99700c3ac0 con 0x7f99700733e0 2024-04-25T12:21:39.594 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f99783f9640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f997015c440 con 0x7f99700c66e0 2024-04-25T12:21:39.595 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f99783f9640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f99700c3d60 con 0x7f99700737c0 2024-04-25T12:21:39.595 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9976195640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f99700733e0 0x7f997006ef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:47458/0 (socket says 172.21.15.94:47458) 2024-04-25T12:21:39.595 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9976195640 1 -- 172.21.15.94:0/1292611914 learned_addr learned my addr 172.21.15.94:0/1292611914 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:21:39.595 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9975193640 1 -- 172.21.15.94:0/1292611914 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 197763881 0 0) 0x7f99700c3ac0 con 0x7f99700733e0 2024-04-25T12:21:39.595 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9975994640 1 --2- 172.21.15.94:0/1292611914 >> v2:172.21.15.111:3300/0 conn(0x7f99700737c0 0x7f9970141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:39.595 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9975193640 1 -- 172.21.15.94:0/1292611914 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9958003530 con 0x7f99700733e0 2024-04-25T12:21:39.596 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9975193640 1 -- 172.21.15.94:0/1292611914 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2899219679 0 0) 0x7f9958003530 con 0x7f99700733e0 2024-04-25T12:21:39.596 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9975193640 1 -- 172.21.15.94:0/1292611914 >> v2:172.21.15.111:3300/0 conn(0x7f99700737c0 msgr2=0x7f9970141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:39.597 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9975193640 1 --2- 172.21.15.94:0/1292611914 >> v2:172.21.15.111:3300/0 conn(0x7f99700737c0 0x7f9970141db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.597 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9975193640 1 -- 172.21.15.94:0/1292611914 >> v1:172.21.15.111:6789/0 conn(0x7f99700c66e0 legacy=0x7f997015c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:39.597 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9975193640 1 -- 172.21.15.94:0/1292611914 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99700c4040 con 0x7f99700733e0 2024-04-25T12:21:39.597 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9975193640 1 -- 172.21.15.94:0/1292611914 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7f9960001680 con 0x7f99700733e0 2024-04-25T12:21:39.597 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9975193640 1 -- 172.21.15.94:0/1292611914 >> v1:172.21.15.94:6789/0 conn(0x7f99700733e0 legacy=0x7f997006ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:39.597 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9975193640 1 --2- 172.21.15.94:0/1292611914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99580039c0 0x7f9958003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:39.597 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9975193640 1 --2- 172.21.15.94:0/1292611914 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9958004810 0x7f9958004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:39.597 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9975193640 1 --2- 172.21.15.94:0/1292611914 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99580051d0 0x7f995800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:39.597 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9975193640 1 -- 172.21.15.94:0/1292611914 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f99700c3d60 con 0x7f99580039c0 2024-04-25T12:21:39.597 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9975193640 1 -- 172.21.15.94:0/1292611914 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f995800c080 con 0x7f99580051d0 2024-04-25T12:21:39.597 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9975193640 1 -- 172.21.15.94:0/1292611914 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f995800c280 con 0x7f9958004810 2024-04-25T12:21:39.597 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9976195640 1 --2- 172.21.15.94:0/1292611914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99580039c0 0x7f9958003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:39.598 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9976996640 1 --2- 172.21.15.94:0/1292611914 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99580051d0 0x7f995800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:39.598 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9975994640 1 --2- 172.21.15.94:0/1292611914 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9958004810 0x7f9958004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:39.598 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9976195640 1 -- 172.21.15.94:0/1292611914 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9958004810 msgr2=0x7f9958004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:39.598 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9976195640 1 --2- 172.21.15.94:0/1292611914 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9958004810 0x7f9958004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.598 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9976195640 1 -- 172.21.15.94:0/1292611914 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99580051d0 msgr2=0x7f995800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:39.598 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9976195640 1 --2- 172.21.15.94:0/1292611914 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99580051d0 0x7f995800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.598 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9976195640 1 -- 172.21.15.94:0/1292611914 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9958003530 con 0x7f99580039c0 2024-04-25T12:21:39.598 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.589+0000 7f9976996640 1 -- 172.21.15.94:0/1292611914 reap_dead start 2024-04-25T12:21:39.600 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f9976195640 1 --2- 172.21.15.94:0/1292611914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99580039c0 0x7f9958003de0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f996000c240 tx=0x7f996001f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da808e0af1f2b1e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:39.600 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f9975193640 1 -- 172.21.15.94:0/1292611914 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9960007d20 con 0x7f99580039c0 2024-04-25T12:21:39.600 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f9975193640 1 -- 172.21.15.94:0/1292611914 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9960005ae0 con 0x7f99580039c0 2024-04-25T12:21:39.600 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f9975193640 1 -- 172.21.15.94:0/1292611914 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9960007070 con 0x7f99580039c0 2024-04-25T12:21:39.600 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f99783f9640 1 -- 172.21.15.94:0/1292611914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99580039c0 msgr2=0x7f9958003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:39.600 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f99783f9640 1 --2- 172.21.15.94:0/1292611914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99580039c0 0x7f9958003de0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f996000c240 tx=0x7f996001f3f0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.600 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f99783f9640 1 -- 172.21.15.94:0/1292611914 shutdown_connections 2024-04-25T12:21:39.600 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f99783f9640 1 --2- 172.21.15.94:0/1292611914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99580039c0 0x7f9958003de0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.600 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f99783f9640 1 -- 172.21.15.94:0/1292611914 >> 172.21.15.94:0/1292611914 conn(0x7f99700cc520 msgr2=0x7f99700cc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:39.600 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f99783f9640 1 -- 172.21.15.94:0/1292611914 shutdown_connections 2024-04-25T12:21:39.600 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f99783f9640 1 -- 172.21.15.94:0/1292611914 wait complete. 2024-04-25T12:21:39.600 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f99783f9640 1 Processor -- start 2024-04-25T12:21:39.600 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f99783f9640 1 -- start start 2024-04-25T12:21:39.603 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f99783f9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99580039c0 0x7f997013d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:39.603 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f99783f9640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99700cb170 0x7f99701f2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:39.603 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f99783f9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99701f2e70 0x7f99701ef1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:39.603 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f99783f9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f99700c7100 con 0x7f99580039c0 2024-04-25T12:21:39.603 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f99783f9640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f99700c4600 con 0x7f99701f2e70 2024-04-25T12:21:39.603 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f99783f9640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f997006ef80 con 0x7f99700cb170 2024-04-25T12:21:39.603 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f9976195640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99580039c0 0x7f997013d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:39.604 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f9976195640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99580039c0 0x7f997013d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37974/0 (socket says 172.21.15.94:37974) 2024-04-25T12:21:39.604 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f9976195640 1 -- 172.21.15.94:0/895562431 learned_addr learned my addr 172.21.15.94:0/895562431 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:39.604 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f9975994640 1 --2- 172.21.15.94:0/895562431 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99700cb170 0x7f99701f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:39.604 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f9976996640 1 --2- 172.21.15.94:0/895562431 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99701f2e70 0x7f99701ef1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:39.604 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f9976195640 1 -- 172.21.15.94:0/895562431 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99700cb170 msgr2=0x7f99701f2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:39.605 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f9976195640 1 --2- 172.21.15.94:0/895562431 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99700cb170 0x7f99701f2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.605 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f9976195640 1 -- 172.21.15.94:0/895562431 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99701f2e70 msgr2=0x7f99701ef1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:39.605 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f9976195640 1 --2- 172.21.15.94:0/895562431 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99701f2e70 0x7f99701ef1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.605 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f9976195640 1 -- 172.21.15.94:0/895562431 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99701405d0 con 0x7f99580039c0 2024-04-25T12:21:39.605 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f9975994640 1 --2- 172.21.15.94:0/895562431 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99700cb170 0x7f99701f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:21:39.605 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f9976996640 1 --2- 172.21.15.94:0/895562431 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99701f2e70 0x7f99701ef1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:21:39.606 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.593+0000 7f9976195640 1 --2- 172.21.15.94:0/895562431 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99580039c0 0x7f997013d1c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9960001980 tx=0x7f9958005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:39.606 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.597+0000 7f996effd640 1 -- 172.21.15.94:0/895562431 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99600047f0 con 0x7f99580039c0 2024-04-25T12:21:39.606 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.597+0000 7f996effd640 1 -- 172.21.15.94:0/895562431 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9960004990 con 0x7f99580039c0 2024-04-25T12:21:39.606 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.597+0000 7f99783f9640 1 -- 172.21.15.94:0/895562431 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9970140890 con 0x7f99580039c0 2024-04-25T12:21:39.606 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.597+0000 7f996effd640 1 -- 172.21.15.94:0/895562431 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9960004d80 con 0x7f99580039c0 2024-04-25T12:21:39.606 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.597+0000 7f99783f9640 1 -- 172.21.15.94:0/895562431 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9970140e50 con 0x7f99580039c0 2024-04-25T12:21:39.606 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.597+0000 7f99783f9640 1 -- 172.21.15.94:0/895562431 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99700763e0 con 0x7f99580039c0 2024-04-25T12:21:39.607 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.597+0000 7f996effd640 1 -- 172.21.15.94:0/895562431 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7f99600b8030 con 0x7f99580039c0 2024-04-25T12:21:39.607 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.597+0000 7f996effd640 1 --2- 172.21.15.94:0/895562431 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f995c0682f0 0x7f995c06a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:39.607 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.597+0000 7f996effd640 1 -- 172.21.15.94:0/895562431 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3351+0+0 (secure 0 0 0) 0x7f9960122df0 con 0x7f99580039c0 2024-04-25T12:21:39.607 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.597+0000 7f9975994640 1 --2- 172.21.15.94:0/895562431 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f995c0682f0 0x7f995c06a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:39.607 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.597+0000 7f9975994640 1 --2- 172.21.15.94:0/895562431 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f995c0682f0 0x7f995c06a7b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9970157780 tx=0x7f996400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:39.607 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.601+0000 7f996effd640 1 -- 172.21.15.94:0/895562431 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9960019100 con 0x7f99580039c0 2024-04-25T12:21:39.763 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.757+0000 7f99783f9640 1 -- 172.21.15.94:0/895562431 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9970153620 con 0x7f99580039c0 2024-04-25T12:21:39.765 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.757+0000 7f996effd640 1 -- 172.21.15.94:0/895562431 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8977 (secure 0 0 0) 0x7f99600f3d30 con 0x7f99580039c0 2024-04-25T12:21:39.765 INFO:teuthology.misc.health.smithi094.stdout: 2024-04-25T12:21:39.765 INFO:teuthology.misc.health.smithi094.stdout:{"epoch":14,"fsid":"7059a9e2-aec4-4b84-b942-caf531e15da3","created":"2024-04-25T12:21:29.118508+0000","modified":"2024-04-25T12:21:38.822771+0000","last_up_change":"2024-04-25T12:21:38.822771+0000","last_in_change":"2024-04-25T12:21:31.372905+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"640a65ef-0734-468a-a8f5-9ed70cf75c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6809","nonce":2553247564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6811","nonce":2553247564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6815","nonce":2553247564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6813","nonce":2553247564}]},"public_addr":"172.21.15.94:6809/2553247564","cluster_addr":"172.21.15.94:6811/2553247564","heartbeat_back_addr":"172.21.15.94:6815/2553247564","heartbeat_front_addr":"172.21.15.94:6813/2553247564","state":["exists","up"]},{"osd":1,"uuid":"d6e886e6-c8c1-4761-9a4c-abc6961c7c81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6818","nonce":2492806478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6822","nonce":2492806478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6830","nonce":2492806478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6826","nonce":2492806478}]},"public_addr":"172.21.15.94:6818/2492806478","cluster_addr":"172.21.15.94:6822/2492806478","heartbeat_back_addr":"172.21.15.94:6830/2492806478","heartbeat_front_addr":"172.21.15.94:6826/2492806478","state":["exists","up"]},{"osd":2,"uuid":"ba20f409-ed46-43b6-b16d-43dc4622c042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6801","nonce":1485061290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6803","nonce":1485061290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6807","nonce":1485061290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6805","nonce":1485061290}]},"public_addr":"172.21.15.94:6801/1485061290","cluster_addr":"172.21.15.94:6803/1485061290","heartbeat_back_addr":"172.21.15.94:6807/1485061290","heartbeat_front_addr":"172.21.15.94:6805/1485061290","state":["exists","up"]},{"osd":3,"uuid":"85816a2b-3a3f-4ec8-8373-8230d948396f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6819","nonce":1548488434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6823","nonce":1548488434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6829","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6831","nonce":1548488434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6827","nonce":1548488434}]},"public_addr":"172.21.15.94:6819/1548488434","cluster_addr":"172.21.15.94:6823/1548488434","heartbeat_back_addr":"172.21.15.94:6831/1548488434","heartbeat_front_addr":"172.21.15.94:6827/1548488434","state":["exists","up"]},{"osd":4,"uuid":"b4a953b7-01d6-4623-9324-63135fdaf148","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c0acc514-427d-41bf-a965-b8463cebf045","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"26ff742f-5a57-44a7-a095-f04d6e87f885","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9c214cba-693a-4b25-aad7-05a5b0006e40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:21:39.767 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.761+0000 7f99783f9640 1 -- 172.21.15.94:0/895562431 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f995c0682f0 msgr2=0x7f995c06a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:39.767 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.761+0000 7f99783f9640 1 --2- 172.21.15.94:0/895562431 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f995c0682f0 0x7f995c06a7b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9970157780 tx=0x7f996400b040 comp rx=0 tx=0).stop 2024-04-25T12:21:39.767 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.761+0000 7f99783f9640 1 -- 172.21.15.94:0/895562431 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99580039c0 msgr2=0x7f997013d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:39.767 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.761+0000 7f99783f9640 1 --2- 172.21.15.94:0/895562431 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99580039c0 0x7f997013d1c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9960001980 tx=0x7f9958005840 comp rx=0 tx=0).stop 2024-04-25T12:21:39.767 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.761+0000 7f99783f9640 1 -- 172.21.15.94:0/895562431 shutdown_connections 2024-04-25T12:21:39.767 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.761+0000 7f99783f9640 1 --2- 172.21.15.94:0/895562431 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f995c0682f0 0x7f995c06a7b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.768 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.761+0000 7f99783f9640 1 --2- 172.21.15.94:0/895562431 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99700cb170 0x7f99701f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.768 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.761+0000 7f99783f9640 1 --2- 172.21.15.94:0/895562431 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99701f2e70 0x7f99701ef1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.768 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.761+0000 7f99783f9640 1 --2- 172.21.15.94:0/895562431 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99580039c0 0x7f997013d1c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:39.768 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.761+0000 7f99783f9640 1 -- 172.21.15.94:0/895562431 >> 172.21.15.94:0/895562431 conn(0x7f99700cc520 msgr2=0x7f9970158080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:39.768 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.761+0000 7f99783f9640 1 -- 172.21.15.94:0/895562431 shutdown_connections 2024-04-25T12:21:39.768 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:39.761+0000 7f99783f9640 1 -- 172.21.15.94:0/895562431 wait complete. 2024-04-25T12:21:39.783 DEBUG:teuthology.misc:4 of 8 OSDs are up 2024-04-25T12:21:39.887 INFO:tasks.ceph.osd.7.smithi111.stderr:2024-04-25T12:21:39.884+0000 7fcded965640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T12:21:39.913 INFO:tasks.ceph.osd.4.smithi111.stderr:2024-04-25T12:21:39.912+0000 7f2bfba93640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T12:21:39.914 INFO:tasks.ceph.osd.7.smithi111.stderr:2024-04-25T12:21:39.912+0000 7fcde5799640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T12:21:39.954 INFO:tasks.ceph.osd.4.smithi111.stderr:2024-04-25T12:21:39.952+0000 7f2bf38c7640 -1 osd.4 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T12:21:39.970 INFO:tasks.ceph.osd.5.smithi111.stderr:2024-04-25T12:21:39.968+0000 7f276da0b640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T12:21:39.991 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-04-25T12:21:39.988+0000 7f1fc942a640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T12:21:40.010 INFO:tasks.ceph.osd.5.smithi111.stderr:2024-04-25T12:21:40.008+0000 7f276583f640 -1 osd.5 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T12:21:40.022 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-04-25T12:21:40.020+0000 7f1fc125e640 -1 osd.6 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T12:21:46.589 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T12:21:46.709 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedc5614640 1 Processor -- start 2024-04-25T12:21:46.710 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedc5614640 1 -- start start 2024-04-25T12:21:46.710 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedc5614640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fedc0152240 0x7fedc015b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:46.710 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedc5614640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedc00721c0 con 0x7fedc0151e60 2024-04-25T12:21:46.710 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedc5614640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedc00704a0 con 0x7fedc0072e80 2024-04-25T12:21:46.711 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedc5614640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fedc0073ec0 con 0x7fedc0152240 2024-04-25T12:21:46.711 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedbeffd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fedc0151e60 0x7fedc0073390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:48008/0 (socket says 172.21.15.94:48008) 2024-04-25T12:21:46.711 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedbeffd640 1 -- 172.21.15.94:0/3496466232 learned_addr learned my addr 172.21.15.94:0/3496466232 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:21:46.713 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedb7fff640 1 --2- 172.21.15.94:0/3496466232 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fedc0152240 0x7fedc015b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:46.713 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedbe7fc640 1 -- 172.21.15.94:0/3496466232 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 820657278 0 0) 0x7fedc00721c0 con 0x7fedc0151e60 2024-04-25T12:21:46.713 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedbe7fc640 1 -- 172.21.15.94:0/3496466232 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedac003530 con 0x7fedc0151e60 2024-04-25T12:21:46.713 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedbe7fc640 1 -- 172.21.15.94:0/3496466232 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 198714601 0 0) 0x7fedac003530 con 0x7fedc0151e60 2024-04-25T12:21:46.713 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedbe7fc640 1 -- 172.21.15.94:0/3496466232 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fedc0152240 msgr2=0x7fedc015b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:46.713 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedbe7fc640 1 --2- 172.21.15.94:0/3496466232 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fedc0152240 0x7fedc015b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:46.713 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedbe7fc640 1 -- 172.21.15.94:0/3496466232 >> v1:172.21.15.111:6789/0 conn(0x7fedc0072e80 legacy=0x7fedc0162620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:46.713 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedbe7fc640 1 -- 172.21.15.94:0/3496466232 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc006dba0 con 0x7fedc0151e60 2024-04-25T12:21:46.714 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedbe7fc640 1 -- 172.21.15.94:0/3496466232 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7fedb0001680 con 0x7fedc0151e60 2024-04-25T12:21:46.714 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedbe7fc640 1 -- 172.21.15.94:0/3496466232 >> v1:172.21.15.94:6789/0 conn(0x7fedc0151e60 legacy=0x7fedc0073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:46.714 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedbe7fc640 1 --2- 172.21.15.94:0/3496466232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedac0039f0 0x7fedac003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:46.714 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedbe7fc640 1 --2- 172.21.15.94:0/3496466232 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fedac004810 0x7fedac004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:46.714 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedbe7fc640 1 --2- 172.21.15.94:0/3496466232 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fedac005190 0x7fedac00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:46.714 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedbe7fc640 1 -- 172.21.15.94:0/3496466232 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fedc0073ec0 con 0x7fedac005190 2024-04-25T12:21:46.714 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedbe7fc640 1 -- 172.21.15.94:0/3496466232 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fedac00bf10 con 0x7fedac0039f0 2024-04-25T12:21:46.714 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedbe7fc640 1 -- 172.21.15.94:0/3496466232 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fedac00c090 con 0x7fedac004810 2024-04-25T12:21:46.714 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedbf7fe640 1 --2- 172.21.15.94:0/3496466232 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fedac005190 0x7fedac00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:46.714 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedb7fff640 1 --2- 172.21.15.94:0/3496466232 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fedac004810 0x7fedac004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:46.714 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedbeffd640 1 --2- 172.21.15.94:0/3496466232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedac0039f0 0x7fedac003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:46.714 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedbf7fe640 1 -- 172.21.15.94:0/3496466232 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fedac004810 msgr2=0x7fedac004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:46.714 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedbf7fe640 1 --2- 172.21.15.94:0/3496466232 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fedac004810 0x7fedac004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:46.715 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedbf7fe640 1 -- 172.21.15.94:0/3496466232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedac0039f0 msgr2=0x7fedac003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:46.715 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedbf7fe640 1 --2- 172.21.15.94:0/3496466232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedac0039f0 0x7fedac003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:46.715 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.705+0000 7fedbf7fe640 1 -- 172.21.15.94:0/3496466232 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedac003530 con 0x7fedac005190 2024-04-25T12:21:46.721 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedbf7fe640 1 --2- 172.21.15.94:0/3496466232 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fedac005190 0x7fedac00b9d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fedb8001e40 tx=0x7fedb801c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489112ee36a093d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:46.722 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedbe7fc640 1 -- 172.21.15.94:0/3496466232 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb8001a90 con 0x7fedac005190 2024-04-25T12:21:46.722 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedbe7fc640 1 -- 172.21.15.94:0/3496466232 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedb8003b80 con 0x7fedac005190 2024-04-25T12:21:46.722 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedbe7fc640 1 -- 172.21.15.94:0/3496466232 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb8005080 con 0x7fedac005190 2024-04-25T12:21:46.722 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedc5614640 1 -- 172.21.15.94:0/3496466232 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fedac005190 msgr2=0x7fedac00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:46.723 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedc5614640 1 --2- 172.21.15.94:0/3496466232 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fedac005190 0x7fedac00b9d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fedb8001e40 tx=0x7fedb801c700 comp rx=0 tx=0).stop 2024-04-25T12:21:46.723 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedbf7fe640 1 -- 172.21.15.94:0/3496466232 reap_dead start 2024-04-25T12:21:46.723 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedc5614640 1 -- 172.21.15.94:0/3496466232 shutdown_connections 2024-04-25T12:21:46.723 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedc5614640 1 -- 172.21.15.94:0/3496466232 >> 172.21.15.94:0/3496466232 conn(0x7fedc006f980 msgr2=0x7fedc006fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:46.723 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedc5614640 1 -- 172.21.15.94:0/3496466232 shutdown_connections 2024-04-25T12:21:46.723 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedc5614640 1 -- 172.21.15.94:0/3496466232 wait complete. 2024-04-25T12:21:46.723 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedc5614640 1 Processor -- start 2024-04-25T12:21:46.723 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedc5614640 1 -- start start 2024-04-25T12:21:46.723 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedc5614640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fedc0145d50 0x7fedc01f11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:46.724 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedc5614640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedc01f3d90 0x7fedc00c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:46.724 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedc5614640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fedc0146130 0x7fedc01f43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:46.724 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedc5614640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fedc0074160 con 0x7fedc0145d50 2024-04-25T12:21:46.724 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedc5614640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fedc0070740 con 0x7fedc01f3d90 2024-04-25T12:21:46.724 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedc5614640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fedc00742e0 con 0x7fedc0146130 2024-04-25T12:21:46.724 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedbeffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fedc0145d50 0x7fedc01f11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:46.724 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedbeffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fedc0145d50 0x7fedc01f11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58284/0 (socket says 172.21.15.94:58284) 2024-04-25T12:21:46.724 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedbeffd640 1 -- 172.21.15.94:0/3762375276 learned_addr learned my addr 172.21.15.94:0/3762375276 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:46.724 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedbf7fe640 1 --2- 172.21.15.94:0/3762375276 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fedc0146130 0x7fedc01f43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:46.724 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedb7fff640 1 --2- 172.21.15.94:0/3762375276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedc01f3d90 0x7fedc00c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:46.724 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedbeffd640 1 -- 172.21.15.94:0/3762375276 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fedc0146130 msgr2=0x7fedc01f43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:46.724 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedbeffd640 1 --2- 172.21.15.94:0/3762375276 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fedc0146130 0x7fedc01f43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:46.724 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedbeffd640 1 -- 172.21.15.94:0/3762375276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedc01f3d90 msgr2=0x7fedc00c5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:46.724 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.709+0000 7fedbeffd640 1 --2- 172.21.15.94:0/3762375276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedc01f3d90 0x7fedc00c5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:46.725 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.713+0000 7fedbeffd640 1 -- 172.21.15.94:0/3762375276 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc01f1730 con 0x7fedc0145d50 2024-04-25T12:21:46.725 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.713+0000 7fedbeffd640 1 --2- 172.21.15.94:0/3762375276 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fedc0145d50 0x7fedc01f11f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fedb000eaf0 tx=0x7fedb0001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:46.725 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.713+0000 7fedb77fe640 1 -- 172.21.15.94:0/3762375276 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb000c870 con 0x7fedc0145d50 2024-04-25T12:21:46.725 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.713+0000 7fedb77fe640 1 -- 172.21.15.94:0/3762375276 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedb0018070 con 0x7fedc0145d50 2024-04-25T12:21:46.725 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.713+0000 7fedb77fe640 1 -- 172.21.15.94:0/3762375276 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb000cc70 con 0x7fedc0145d50 2024-04-25T12:21:46.725 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.713+0000 7fedc5614640 1 -- 172.21.15.94:0/3762375276 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedc0152a70 con 0x7fedc0145d50 2024-04-25T12:21:46.725 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.713+0000 7fedc5614640 1 -- 172.21.15.94:0/3762375276 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedc0153030 con 0x7fedc0145d50 2024-04-25T12:21:46.725 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.713+0000 7fedc5614640 1 -- 172.21.15.94:0/3762375276 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedc00763e0 con 0x7fedc0145d50 2024-04-25T12:21:46.725 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.713+0000 7fedb77fe640 1 -- 172.21.15.94:0/3762375276 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fedb001d460 con 0x7fedc0145d50 2024-04-25T12:21:46.725 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.713+0000 7fedb77fe640 1 --2- 172.21.15.94:0/3762375276 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7feda00683b0 0x7feda006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:46.726 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.713+0000 7fedb7fff640 1 --2- 172.21.15.94:0/3762375276 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7feda00683b0 0x7feda006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:46.726 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.713+0000 7fedb77fe640 1 -- 172.21.15.94:0/3762375276 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fedb00865b0 con 0x7fedc0145d50 2024-04-25T12:21:46.726 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.713+0000 7fedb7fff640 1 --2- 172.21.15.94:0/3762375276 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7feda00683b0 0x7feda006a870 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fedc0146760 tx=0x7feda8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:46.760 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.753+0000 7fedb77fe640 1 -- 172.21.15.94:0/3762375276 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fedb0056ec0 con 0x7fedc0145d50 2024-04-25T12:21:46.922 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.917+0000 7fedc5614640 1 -- 172.21.15.94:0/3762375276 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fedc006ff20 con 0x7fedc0145d50 2024-04-25T12:21:46.924 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.917+0000 7fedb77fe640 1 -- 172.21.15.94:0/3762375276 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12885 (secure 0 0 0) 0x7fedb00567c0 con 0x7fedc0145d50 2024-04-25T12:21:46.924 INFO:teuthology.misc.health.smithi094.stdout: 2024-04-25T12:21:46.924 INFO:teuthology.misc.health.smithi094.stdout:{"epoch":18,"fsid":"7059a9e2-aec4-4b84-b942-caf531e15da3","created":"2024-04-25T12:21:29.118508+0000","modified":"2024-04-25T12:21:42.941025+0000","last_up_change":"2024-04-25T12:21:40.912605+0000","last_in_change":"2024-04-25T12:21:31.372905+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:39.781011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"640a65ef-0734-468a-a8f5-9ed70cf75c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6809","nonce":2553247564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6811","nonce":2553247564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6815","nonce":2553247564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6813","nonce":2553247564}]},"public_addr":"172.21.15.94:6809/2553247564","cluster_addr":"172.21.15.94:6811/2553247564","heartbeat_back_addr":"172.21.15.94:6815/2553247564","heartbeat_front_addr":"172.21.15.94:6813/2553247564","state":["exists","up"]},{"osd":1,"uuid":"d6e886e6-c8c1-4761-9a4c-abc6961c7c81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6818","nonce":2492806478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6822","nonce":2492806478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6830","nonce":2492806478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6826","nonce":2492806478}]},"public_addr":"172.21.15.94:6818/2492806478","cluster_addr":"172.21.15.94:6822/2492806478","heartbeat_back_addr":"172.21.15.94:6830/2492806478","heartbeat_front_addr":"172.21.15.94:6826/2492806478","state":["exists","up"]},{"osd":2,"uuid":"ba20f409-ed46-43b6-b16d-43dc4622c042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6801","nonce":1485061290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6803","nonce":1485061290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6807","nonce":1485061290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6805","nonce":1485061290}]},"public_addr":"172.21.15.94:6801/1485061290","cluster_addr":"172.21.15.94:6803/1485061290","heartbeat_back_addr":"172.21.15.94:6807/1485061290","heartbeat_front_addr":"172.21.15.94:6805/1485061290","state":["exists","up"]},{"osd":3,"uuid":"85816a2b-3a3f-4ec8-8373-8230d948396f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6819","nonce":1548488434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6823","nonce":1548488434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6829","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6831","nonce":1548488434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6827","nonce":1548488434}]},"public_addr":"172.21.15.94:6819/1548488434","cluster_addr":"172.21.15.94:6823/1548488434","heartbeat_back_addr":"172.21.15.94:6831/1548488434","heartbeat_front_addr":"172.21.15.94:6827/1548488434","state":["exists","up"]},{"osd":4,"uuid":"b4a953b7-01d6-4623-9324-63135fdaf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6811","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6814","nonce":4070977083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6817","nonce":4070977083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6823","nonce":4070977083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6819","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6821","nonce":4070977083}]},"public_addr":"172.21.15.111:6814/4070977083","cluster_addr":"172.21.15.111:6817/4070977083","heartbeat_back_addr":"172.21.15.111:6823/4070977083","heartbeat_front_addr":"172.21.15.111:6821/4070977083","state":["exists","up"]},{"osd":5,"uuid":"c0acc514-427d-41bf-a965-b8463cebf045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6803","nonce":1054925605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6809","nonce":1054925605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6820","nonce":1054925605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6815","nonce":1054925605}]},"public_addr":"172.21.15.111:6803/1054925605","cluster_addr":"172.21.15.111:6809/1054925605","heartbeat_back_addr":"172.21.15.111:6820/1054925605","heartbeat_front_addr":"172.21.15.111:6815/1054925605","state":["exists","up"]},{"osd":6,"uuid":"26ff742f-5a57-44a7-a095-f04d6e87f885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6825","nonce":3619235078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6827","nonce":3619235078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6831","nonce":3619235078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6829","nonce":3619235078}]},"public_addr":"172.21.15.111:6825/3619235078","cluster_addr":"172.21.15.111:6827/3619235078","heartbeat_back_addr":"172.21.15.111:6831/3619235078","heartbeat_front_addr":"172.21.15.111:6829/3619235078","state":["exists","up"]},{"osd":7,"uuid":"9c214cba-693a-4b25-aad7-05a5b0006e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6801","nonce":558758517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6805","nonce":558758517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6813","nonce":558758517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6807","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6808","nonce":558758517}]},"public_addr":"172.21.15.111:6801/558758517","cluster_addr":"172.21.15.111:6805/558758517","heartbeat_back_addr":"172.21.15.111:6813/558758517","heartbeat_front_addr":"172.21.15.111:6808/558758517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.664958+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.853375+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.654455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:37.033852+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.968691+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.856013+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.913496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.848565+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:21:46.927 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.921+0000 7fedc5614640 1 -- 172.21.15.94:0/3762375276 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7feda00683b0 msgr2=0x7feda006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:46.927 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.921+0000 7fedc5614640 1 --2- 172.21.15.94:0/3762375276 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7feda00683b0 0x7feda006a870 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fedc0146760 tx=0x7feda8008040 comp rx=0 tx=0).stop 2024-04-25T12:21:46.927 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.921+0000 7fedc5614640 1 -- 172.21.15.94:0/3762375276 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fedc0145d50 msgr2=0x7fedc01f11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:46.927 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.921+0000 7fedc5614640 1 --2- 172.21.15.94:0/3762375276 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fedc0145d50 0x7fedc01f11f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fedb000eaf0 tx=0x7fedb0001710 comp rx=0 tx=0).stop 2024-04-25T12:21:46.927 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.921+0000 7fedc5614640 1 -- 172.21.15.94:0/3762375276 shutdown_connections 2024-04-25T12:21:46.927 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.921+0000 7fedc5614640 1 --2- 172.21.15.94:0/3762375276 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7feda00683b0 0x7feda006a870 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:46.927 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.921+0000 7fedc5614640 1 --2- 172.21.15.94:0/3762375276 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fedc0146130 0x7fedc01f43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:46.927 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.921+0000 7fedc5614640 1 --2- 172.21.15.94:0/3762375276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedc01f3d90 0x7fedc00c5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:46.927 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.921+0000 7fedc5614640 1 --2- 172.21.15.94:0/3762375276 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fedc0145d50 0x7fedc01f11f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:46.927 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.921+0000 7fedc5614640 1 -- 172.21.15.94:0/3762375276 >> 172.21.15.94:0/3762375276 conn(0x7fedc006f980 msgr2=0x7fedc0148140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:46.927 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.921+0000 7fedc5614640 1 -- 172.21.15.94:0/3762375276 shutdown_connections 2024-04-25T12:21:46.927 INFO:teuthology.misc.health.smithi094.stderr:2024-04-25T12:21:46.921+0000 7fedc5614640 1 -- 172.21.15.94:0/3762375276 wait complete. 2024-04-25T12:21:46.942 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T12:21:46.942 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T12:21:46.942 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T12:21:46.942 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T12:21:46.944 INFO:tasks.ceph.mds.a:Started 2024-04-25T12:21:46.944 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T12:21:46.944 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T12:21:46.946 INFO:tasks.ceph.mds.c:Started 2024-04-25T12:21:46.947 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-25T12:21:46.947 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-04-25T12:21:46.948 INFO:tasks.ceph.mds.e:Started 2024-04-25T12:21:46.949 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T12:21:46.949 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T12:21:46.951 INFO:tasks.ceph.mds.b:Started 2024-04-25T12:21:46.952 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T12:21:46.952 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T12:21:46.954 INFO:tasks.ceph.mds.d:Started 2024-04-25T12:21:46.954 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-25T12:21:46.955 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-04-25T12:21:46.957 INFO:tasks.ceph.mds.f:Started 2024-04-25T12:21:46.957 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T12:21:46.958 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:21:47.021 INFO:tasks.ceph.mds.a.smithi094.stdout:starting mds.a at 2024-04-25T12:21:47.021 INFO:tasks.ceph.mds.c.smithi094.stdout:starting mds.c at 2024-04-25T12:21:47.022 INFO:tasks.ceph.mds.e.smithi094.stdout:starting mds.e at 2024-04-25T12:21:47.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.065+0000 7fab827a0640 1 Processor -- start 2024-04-25T12:21:47.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.065+0000 7fab827a0640 1 -- start start 2024-04-25T12:21:47.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.065+0000 7fab827a0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fab7c152ff0 0x7fab7c0c5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:47.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.065+0000 7fab827a0640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fab7c0ca550 0x7fab7c0cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:47.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.065+0000 7fab827a0640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab7c0cada0 con 0x7fab7c0c7eb0 2024-04-25T12:21:47.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.065+0000 7fab827a0640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fab7c0cb080 con 0x7fab7c152ff0 2024-04-25T12:21:47.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.065+0000 7fab827a0640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fab7c0c9360 con 0x7fab7c0ca550 2024-04-25T12:21:47.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.065+0000 7fab7bfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fab7c152ff0 0x7fab7c0c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:47.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.065+0000 7fab7b7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fab7c0c7eb0 0x7fab7c0c6380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:48028/0 (socket says 172.21.15.94:48028) 2024-04-25T12:21:47.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.065+0000 7fab7bfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fab7c152ff0 0x7fab7c0c5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58344/0 (socket says 172.21.15.94:58344) 2024-04-25T12:21:47.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.065+0000 7fab7b7fe640 1 -- 172.21.15.94:0/1645190954 learned_addr learned my addr 172.21.15.94:0/1645190954 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:21:47.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.065+0000 7fab80d3d640 1 --2- 172.21.15.94:0/1645190954 >> v2:172.21.15.111:3300/0 conn(0x7fab7c0ca550 0x7fab7c0cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:47.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.065+0000 7fab7bfff640 1 -- 172.21.15.94:0/1645190954 >> v2:172.21.15.111:3300/0 conn(0x7fab7c0ca550 msgr2=0x7fab7c0cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:47.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.065+0000 7fab7bfff640 1 --2- 172.21.15.94:0/1645190954 >> v2:172.21.15.111:3300/0 conn(0x7fab7c0ca550 0x7fab7c0cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.065+0000 7fab7bfff640 1 -- 172.21.15.94:0/1645190954 >> v1:172.21.15.94:6789/0 conn(0x7fab7c0c7eb0 legacy=0x7fab7c0c6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:47.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.065+0000 7fab7bfff640 1 -- 172.21.15.94:0/1645190954 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab7c0c9640 con 0x7fab7c152ff0 2024-04-25T12:21:47.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.065+0000 7fab7affd640 1 -- 172.21.15.94:0/1645190954 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3314015705 0 0) 0x7fab7c0cada0 con 0x7fab7c0c7eb0 2024-04-25T12:21:47.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.069+0000 7fab7bfff640 1 --2- 172.21.15.94:0/1645190954 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab7c152ff0 0x7fab7c0c5730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fab7c0c5c70 tx=0x7fab7001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d2e7470352eae9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:47.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.069+0000 7fab7affd640 1 -- 172.21.15.94:0/1645190954 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab700b5070 con 0x7fab7c152ff0 2024-04-25T12:21:47.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.069+0000 7fab7affd640 1 -- 172.21.15.94:0/1645190954 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab700a8970 con 0x7fab7c152ff0 2024-04-25T12:21:47.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.069+0000 7fab7affd640 1 -- 172.21.15.94:0/1645190954 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab700a8d40 con 0x7fab7c152ff0 2024-04-25T12:21:47.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.069+0000 7fab827a0640 1 -- 172.21.15.94:0/1645190954 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab7c152ff0 msgr2=0x7fab7c0c5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:47.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.069+0000 7fab827a0640 1 --2- 172.21.15.94:0/1645190954 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab7c152ff0 0x7fab7c0c5730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fab7c0c5c70 tx=0x7fab7001ec70 comp rx=0 tx=0).stop 2024-04-25T12:21:47.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.069+0000 7fab827a0640 1 -- 172.21.15.94:0/1645190954 shutdown_connections 2024-04-25T12:21:47.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.069+0000 7fab827a0640 1 --2- 172.21.15.94:0/1645190954 >> v2:172.21.15.111:3300/0 conn(0x7fab7c0ca550 0x7fab7c0cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.069+0000 7fab827a0640 1 --2- 172.21.15.94:0/1645190954 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab7c152ff0 0x7fab7c0c5730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.069+0000 7fab827a0640 1 -- 172.21.15.94:0/1645190954 >> 172.21.15.94:0/1645190954 conn(0x7fab7c0676a0 msgr2=0x7fab7c067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:47.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.069+0000 7fab827a0640 1 -- 172.21.15.94:0/1645190954 shutdown_connections 2024-04-25T12:21:47.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.069+0000 7fab827a0640 1 -- 172.21.15.94:0/1645190954 wait complete. 2024-04-25T12:21:47.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.069+0000 7fab827a0640 1 Processor -- start 2024-04-25T12:21:47.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.069+0000 7fab827a0640 1 -- start start 2024-04-25T12:21:47.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab827a0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab7c0c7eb0 0x7fab7c06df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:47.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab827a0640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fab7c0ca550 0x7fab7c1e7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:47.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab827a0640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab7c152ff0 0x7fab7c14c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:47.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab827a0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c0caaa0 con 0x7fab7c0c7eb0 2024-04-25T12:21:47.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab827a0640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c0c5e60 con 0x7fab7c152ff0 2024-04-25T12:21:47.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab827a0640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fab7c1533d0 con 0x7fab7c0ca550 2024-04-25T12:21:47.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab7bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab7c0c7eb0 0x7fab7c06df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:47.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab7bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab7c0c7eb0 0x7fab7c06df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58348/0 (socket says 172.21.15.94:58348) 2024-04-25T12:21:47.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab7bfff640 1 -- 172.21.15.94:0/2247674298 learned_addr learned my addr 172.21.15.94:0/2247674298 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:47.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab7bfff640 1 -- 172.21.15.94:0/2247674298 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fab7c0ca550 msgr2=0x7fab7c1e7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:47.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab7b7fe640 1 --2- 172.21.15.94:0/2247674298 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fab7c0ca550 0x7fab7c1e7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:47.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab7bfff640 1 --2- 172.21.15.94:0/2247674298 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fab7c0ca550 0x7fab7c1e7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab80d3d640 1 --2- 172.21.15.94:0/2247674298 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab7c152ff0 0x7fab7c14c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:47.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab7bfff640 1 -- 172.21.15.94:0/2247674298 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab7c152ff0 msgr2=0x7fab7c14c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:47.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab7bfff640 1 --2- 172.21.15.94:0/2247674298 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab7c152ff0 0x7fab7c14c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab7bfff640 1 -- 172.21.15.94:0/2247674298 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab7c06e440 con 0x7fab7c0c7eb0 2024-04-25T12:21:47.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab7bfff640 1 --2- 172.21.15.94:0/2247674298 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab7c0c7eb0 0x7fab7c06df00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fab700b3040 tx=0x7fab7001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:47.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab78ff9640 1 -- 172.21.15.94:0/2247674298 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab700bf070 con 0x7fab7c0c7eb0 2024-04-25T12:21:47.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab78ff9640 1 -- 172.21.15.94:0/2247674298 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab700b07c0 con 0x7fab7c0c7eb0 2024-04-25T12:21:47.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab827a0640 1 -- 172.21.15.94:0/2247674298 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab7c1e8330 con 0x7fab7c0c7eb0 2024-04-25T12:21:47.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab78ff9640 1 -- 172.21.15.94:0/2247674298 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab700b5040 con 0x7fab7c0c7eb0 2024-04-25T12:21:47.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab827a0640 1 -- 172.21.15.94:0/2247674298 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab7c06ce60 con 0x7fab7c0c7eb0 2024-04-25T12:21:47.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab827a0640 1 -- 172.21.15.94:0/2247674298 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab7c075df0 con 0x7fab7c0c7eb0 2024-04-25T12:21:47.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab78ff9640 1 -- 172.21.15.94:0/2247674298 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fab700c2070 con 0x7fab7c0c7eb0 2024-04-25T12:21:47.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab78ff9640 1 --2- 172.21.15.94:0/2247674298 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fab68068380 0x7fab6806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:47.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab78ff9640 1 -- 172.21.15.94:0/2247674298 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fab70122f80 con 0x7fab7c0c7eb0 2024-04-25T12:21:47.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab7b7fe640 1 --2- 172.21.15.94:0/2247674298 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fab68068380 0x7fab6806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:47.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.073+0000 7fab7b7fe640 1 --2- 172.21.15.94:0/2247674298 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fab68068380 0x7fab6806a840 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fab7c071d00 tx=0x7fab6c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:47.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.077+0000 7fab78ff9640 1 -- 172.21.15.94:0/2247674298 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fab700187d0 con 0x7fab7c0c7eb0 2024-04-25T12:21:47.148 INFO:tasks.ceph.mds.d.smithi111.stdout:starting mds.d at 2024-04-25T12:21:47.154 INFO:tasks.ceph.mds.f.smithi111.stdout:starting mds.f at 2024-04-25T12:21:47.160 INFO:tasks.ceph.mds.b.smithi111.stdout:starting mds.b at 2024-04-25T12:21:47.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.233+0000 7fab827a0640 1 -- 172.21.15.94:0/2247674298 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fab7c150890 con 0x7fab7c0c7eb0 2024-04-25T12:21:47.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.233+0000 7fab78ff9640 1 -- 172.21.15.94:0/2247674298 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12885 (secure 0 0 0) 0x7fab700f3920 con 0x7fab7c0c7eb0 2024-04-25T12:21:47.239 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:21:47.239 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":18,"fsid":"7059a9e2-aec4-4b84-b942-caf531e15da3","created":"2024-04-25T12:21:29.118508+0000","modified":"2024-04-25T12:21:42.941025+0000","last_up_change":"2024-04-25T12:21:40.912605+0000","last_in_change":"2024-04-25T12:21:31.372905+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:39.781011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"640a65ef-0734-468a-a8f5-9ed70cf75c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6809","nonce":2553247564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6811","nonce":2553247564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6815","nonce":2553247564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6813","nonce":2553247564}]},"public_addr":"172.21.15.94:6809/2553247564","cluster_addr":"172.21.15.94:6811/2553247564","heartbeat_back_addr":"172.21.15.94:6815/2553247564","heartbeat_front_addr":"172.21.15.94:6813/2553247564","state":["exists","up"]},{"osd":1,"uuid":"d6e886e6-c8c1-4761-9a4c-abc6961c7c81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6818","nonce":2492806478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6822","nonce":2492806478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6830","nonce":2492806478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6826","nonce":2492806478}]},"public_addr":"172.21.15.94:6818/2492806478","cluster_addr":"172.21.15.94:6822/2492806478","heartbeat_back_addr":"172.21.15.94:6830/2492806478","heartbeat_front_addr":"172.21.15.94:6826/2492806478","state":["exists","up"]},{"osd":2,"uuid":"ba20f409-ed46-43b6-b16d-43dc4622c042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6801","nonce":1485061290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6803","nonce":1485061290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6807","nonce":1485061290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6805","nonce":1485061290}]},"public_addr":"172.21.15.94:6801/1485061290","cluster_addr":"172.21.15.94:6803/1485061290","heartbeat_back_addr":"172.21.15.94:6807/1485061290","heartbeat_front_addr":"172.21.15.94:6805/1485061290","state":["exists","up"]},{"osd":3,"uuid":"85816a2b-3a3f-4ec8-8373-8230d948396f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6819","nonce":1548488434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6823","nonce":1548488434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6829","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6831","nonce":1548488434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6827","nonce":1548488434}]},"public_addr":"172.21.15.94:6819/1548488434","cluster_addr":"172.21.15.94:6823/1548488434","heartbeat_back_addr":"172.21.15.94:6831/1548488434","heartbeat_front_addr":"172.21.15.94:6827/1548488434","state":["exists","up"]},{"osd":4,"uuid":"b4a953b7-01d6-4623-9324-63135fdaf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6811","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6814","nonce":4070977083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6817","nonce":4070977083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6823","nonce":4070977083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6819","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6821","nonce":4070977083}]},"public_addr":"172.21.15.111:6814/4070977083","cluster_addr":"172.21.15.111:6817/4070977083","heartbeat_back_addr":"172.21.15.111:6823/4070977083","heartbeat_front_addr":"172.21.15.111:6821/4070977083","state":["exists","up"]},{"osd":5,"uuid":"c0acc514-427d-41bf-a965-b8463cebf045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6803","nonce":1054925605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6809","nonce":1054925605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6820","nonce":1054925605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6815","nonce":1054925605}]},"public_addr":"172.21.15.111:6803/1054925605","cluster_addr":"172.21.15.111:6809/1054925605","heartbeat_back_addr":"172.21.15.111:6820/1054925605","heartbeat_front_addr":"172.21.15.111:6815/1054925605","state":["exists","up"]},{"osd":6,"uuid":"26ff742f-5a57-44a7-a095-f04d6e87f885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6825","nonce":3619235078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6827","nonce":3619235078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6831","nonce":3619235078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6829","nonce":3619235078}]},"public_addr":"172.21.15.111:6825/3619235078","cluster_addr":"172.21.15.111:6827/3619235078","heartbeat_back_addr":"172.21.15.111:6831/3619235078","heartbeat_front_addr":"172.21.15.111:6829/3619235078","state":["exists","up"]},{"osd":7,"uuid":"9c214cba-693a-4b25-aad7-05a5b0006e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6801","nonce":558758517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6805","nonce":558758517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6813","nonce":558758517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6807","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6808","nonce":558758517}]},"public_addr":"172.21.15.111:6801/558758517","cluster_addr":"172.21.15.111:6805/558758517","heartbeat_back_addr":"172.21.15.111:6813/558758517","heartbeat_front_addr":"172.21.15.111:6808/558758517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.664958+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.853375+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.654455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:37.033852+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.968691+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.856013+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.913496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.848565+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:21:47.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.233+0000 7fab827a0640 1 -- 172.21.15.94:0/2247674298 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fab68068380 msgr2=0x7fab6806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:47.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.233+0000 7fab827a0640 1 --2- 172.21.15.94:0/2247674298 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fab68068380 0x7fab6806a840 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fab7c071d00 tx=0x7fab6c009040 comp rx=0 tx=0).stop 2024-04-25T12:21:47.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.233+0000 7fab827a0640 1 -- 172.21.15.94:0/2247674298 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab7c0c7eb0 msgr2=0x7fab7c06df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:47.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.233+0000 7fab827a0640 1 --2- 172.21.15.94:0/2247674298 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab7c0c7eb0 0x7fab7c06df00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fab700b3040 tx=0x7fab7001ba10 comp rx=0 tx=0).stop 2024-04-25T12:21:47.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.233+0000 7fab827a0640 1 -- 172.21.15.94:0/2247674298 shutdown_connections 2024-04-25T12:21:47.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.233+0000 7fab827a0640 1 --2- 172.21.15.94:0/2247674298 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fab68068380 0x7fab6806a840 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.233+0000 7fab827a0640 1 --2- 172.21.15.94:0/2247674298 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fab7c0ca550 0x7fab7c1e7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.233+0000 7fab827a0640 1 --2- 172.21.15.94:0/2247674298 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab7c152ff0 0x7fab7c14c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.233+0000 7fab827a0640 1 --2- 172.21.15.94:0/2247674298 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab7c0c7eb0 0x7fab7c06df00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.233+0000 7fab827a0640 1 -- 172.21.15.94:0/2247674298 >> 172.21.15.94:0/2247674298 conn(0x7fab7c0676a0 msgr2=0x7fab7c0c8300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:47.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.237+0000 7fab827a0640 1 -- 172.21.15.94:0/2247674298 shutdown_connections 2024-04-25T12:21:47.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.237+0000 7fab827a0640 1 -- 172.21.15.94:0/2247674298 wait complete. 2024-04-25T12:21:47.256 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T12:21:39.781011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T12:21:47.257 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T12:21:47.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.369+0000 7f7b5c7cb640 1 Processor -- start 2024-04-25T12:21:47.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.369+0000 7f7b5c7cb640 1 -- start start 2024-04-25T12:21:47.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b5c7cb640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f7b54074100 0x7f7b5406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:47.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b5c7cb640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b540c5d70 con 0x7f7b5414ffa0 2024-04-25T12:21:47.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b5c7cb640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b540c6050 con 0x7f7b5414fbc0 2024-04-25T12:21:47.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b5c7cb640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f7b540c6330 con 0x7f7b54074100 2024-04-25T12:21:47.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b59d66640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f7b5414ffa0 0x7f7b540c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:48040/0 (socket says 172.21.15.94:48040) 2024-04-25T12:21:47.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b59d66640 1 -- 172.21.15.94:0/365267323 learned_addr learned my addr 172.21.15.94:0/365267323 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:21:47.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b59565640 1 -- 172.21.15.94:0/365267323 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2251081803 0 0) 0x7f7b540c5d70 con 0x7f7b5414ffa0 2024-04-25T12:21:47.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b59565640 1 -- 172.21.15.94:0/365267323 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b40003530 con 0x7f7b5414ffa0 2024-04-25T12:21:47.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b5ad68640 1 --2- 172.21.15.94:0/365267323 >> v2:172.21.15.111:3300/0 conn(0x7f7b54074100 0x7f7b5406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:47.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b59565640 1 -- 172.21.15.94:0/365267323 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1824398491 0 0) 0x7f7b40003530 con 0x7f7b5414ffa0 2024-04-25T12:21:47.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b59565640 1 -- 172.21.15.94:0/365267323 >> v2:172.21.15.111:3300/0 conn(0x7f7b54074100 msgr2=0x7f7b5406f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:47.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b59565640 1 --2- 172.21.15.94:0/365267323 >> v2:172.21.15.111:3300/0 conn(0x7f7b54074100 0x7f7b5406f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b59565640 1 -- 172.21.15.94:0/365267323 >> v1:172.21.15.111:6789/0 conn(0x7f7b5414fbc0 legacy=0x7f7b540c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:47.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b59565640 1 -- 172.21.15.94:0/365267323 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b540c6610 con 0x7f7b5414ffa0 2024-04-25T12:21:47.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b59565640 1 -- 172.21.15.94:0/365267323 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7f7b44001680 con 0x7f7b5414ffa0 2024-04-25T12:21:47.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b59565640 1 -- 172.21.15.94:0/365267323 >> v1:172.21.15.94:6789/0 conn(0x7f7b5414ffa0 legacy=0x7f7b540c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:47.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b59565640 1 --2- 172.21.15.94:0/365267323 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b40003a40 0x7f7b40003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:47.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b59565640 1 --2- 172.21.15.94:0/365267323 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7b40004810 0x7f7b40004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:47.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b59565640 1 --2- 172.21.15.94:0/365267323 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b400051d0 0x7f7b4000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:47.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b59565640 1 -- 172.21.15.94:0/365267323 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7b540c6330 con 0x7f7b400051d0 2024-04-25T12:21:47.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b59565640 1 -- 172.21.15.94:0/365267323 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4000c100 con 0x7f7b40003a40 2024-04-25T12:21:47.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b59565640 1 -- 172.21.15.94:0/365267323 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f7b4000c300 con 0x7f7b40004810 2024-04-25T12:21:47.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b5ad68640 1 --2- 172.21.15.94:0/365267323 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b400051d0 0x7f7b4000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:47.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b5a567640 1 --2- 172.21.15.94:0/365267323 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b40003a40 0x7f7b40003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:47.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b59d66640 1 --2- 172.21.15.94:0/365267323 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7b40004810 0x7f7b40004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:47.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b5ad68640 1 -- 172.21.15.94:0/365267323 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7b40004810 msgr2=0x7f7b40004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:47.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b5ad68640 1 --2- 172.21.15.94:0/365267323 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7b40004810 0x7f7b40004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b5ad68640 1 -- 172.21.15.94:0/365267323 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b40003a40 msgr2=0x7f7b40003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:47.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b5ad68640 1 --2- 172.21.15.94:0/365267323 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b40003a40 0x7f7b40003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b5ad68640 1 -- 172.21.15.94:0/365267323 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b40003530 con 0x7f7b400051d0 2024-04-25T12:21:47.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b5a567640 1 --2- 172.21.15.94:0/365267323 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b40003a40 0x7f7b40003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:47.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.373+0000 7f7b5ad68640 1 -- 172.21.15.94:0/365267323 reap_dead start 2024-04-25T12:21:47.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b5ad68640 1 --2- 172.21.15.94:0/365267323 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b400051d0 0x7f7b4000b9d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7b5415a080 tx=0x7f7b4c01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482ef424e48355b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:47.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b59565640 1 -- 172.21.15.94:0/365267323 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c0b2070 con 0x7f7b400051d0 2024-04-25T12:21:47.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b59565640 1 -- 172.21.15.94:0/365267323 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b4c0a5d10 con 0x7f7b400051d0 2024-04-25T12:21:47.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b59565640 1 -- 172.21.15.94:0/365267323 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c009bf0 con 0x7f7b400051d0 2024-04-25T12:21:47.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b5c7cb640 1 -- 172.21.15.94:0/365267323 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b400051d0 msgr2=0x7f7b4000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:47.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b5c7cb640 1 --2- 172.21.15.94:0/365267323 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b400051d0 0x7f7b4000b9d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7b5415a080 tx=0x7f7b4c01cc40 comp rx=0 tx=0).stop 2024-04-25T12:21:47.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b5c7cb640 1 -- 172.21.15.94:0/365267323 shutdown_connections 2024-04-25T12:21:47.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b5c7cb640 1 --2- 172.21.15.94:0/365267323 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b400051d0 0x7f7b4000b9d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b5c7cb640 1 -- 172.21.15.94:0/365267323 >> 172.21.15.94:0/365267323 conn(0x7f7b5406b9d0 msgr2=0x7f7b5406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:47.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b5c7cb640 1 -- 172.21.15.94:0/365267323 shutdown_connections 2024-04-25T12:21:47.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b5c7cb640 1 -- 172.21.15.94:0/365267323 wait complete. 2024-04-25T12:21:47.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b5c7cb640 1 Processor -- start 2024-04-25T12:21:47.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b5c7cb640 1 -- start start 2024-04-25T12:21:47.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b5c7cb640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b400051d0 0x7f7b54158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:47.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b5c7cb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b541f1eb0 0x7f7b541ef350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:47.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b5c7cb640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7b54154d50 0x7f7b5415c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:47.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b5c7cb640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7b54074530 con 0x7f7b541f1eb0 2024-04-25T12:21:47.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b5c7cb640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7b540c5bf0 con 0x7f7b400051d0 2024-04-25T12:21:47.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b5c7cb640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f7b540681d0 con 0x7f7b54154d50 2024-04-25T12:21:47.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b59d66640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b541f1eb0 0x7f7b541ef350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:47.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b59d66640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b541f1eb0 0x7f7b541ef350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58380/0 (socket says 172.21.15.94:58380) 2024-04-25T12:21:47.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b59d66640 1 -- 172.21.15.94:0/1083847162 learned_addr learned my addr 172.21.15.94:0/1083847162 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:47.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b5ad68640 1 --2- 172.21.15.94:0/1083847162 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7b54154d50 0x7f7b5415c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:47.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b5a567640 1 --2- 172.21.15.94:0/1083847162 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b400051d0 0x7f7b54158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:47.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b59d66640 1 -- 172.21.15.94:0/1083847162 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7b54154d50 msgr2=0x7f7b5415c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:47.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b59d66640 1 --2- 172.21.15.94:0/1083847162 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7b54154d50 0x7f7b5415c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b59d66640 1 -- 172.21.15.94:0/1083847162 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b400051d0 msgr2=0x7f7b54158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:47.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b59d66640 1 --2- 172.21.15.94:0/1083847162 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b400051d0 0x7f7b54158930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b59d66640 1 -- 172.21.15.94:0/1083847162 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b541ef890 con 0x7f7b541f1eb0 2024-04-25T12:21:47.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b59d66640 1 --2- 172.21.15.94:0/1083847162 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b541f1eb0 0x7f7b541ef350 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400d770 tx=0x7f7b4400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:47.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b4affd640 1 -- 172.21.15.94:0/1083847162 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b44019070 con 0x7f7b541f1eb0 2024-04-25T12:21:47.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b4affd640 1 -- 172.21.15.94:0/1083847162 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b440072d0 con 0x7f7b541f1eb0 2024-04-25T12:21:47.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b5c7cb640 1 -- 172.21.15.94:0/1083847162 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b54159000 con 0x7f7b541f1eb0 2024-04-25T12:21:47.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b4affd640 1 -- 172.21.15.94:0/1083847162 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b44007680 con 0x7f7b541f1eb0 2024-04-25T12:21:47.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.377+0000 7f7b5c7cb640 1 -- 172.21.15.94:0/1083847162 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b541595c0 con 0x7f7b541f1eb0 2024-04-25T12:21:47.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.381+0000 7f7b5c7cb640 1 -- 172.21.15.94:0/1083847162 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b54075df0 con 0x7f7b541f1eb0 2024-04-25T12:21:47.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.381+0000 7f7b4affd640 1 -- 172.21.15.94:0/1083847162 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7b440047f0 con 0x7f7b541f1eb0 2024-04-25T12:21:47.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.381+0000 7f7b4affd640 1 --2- 172.21.15.94:0/1083847162 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7b380683b0 0x7f7b3806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:47.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.381+0000 7f7b4affd640 1 -- 172.21.15.94:0/1083847162 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f7b44085fb0 con 0x7f7b541f1eb0 2024-04-25T12:21:47.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.381+0000 7f7b5a567640 1 --2- 172.21.15.94:0/1083847162 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7b380683b0 0x7f7b3806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:47.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.381+0000 7f7b5a567640 1 --2- 172.21.15.94:0/1083847162 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7b380683b0 0x7f7b3806a870 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7b50001760 tx=0x7f7b50009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:47.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.385+0000 7f7b4affd640 1 -- 172.21.15.94:0/1083847162 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7b44056830 con 0x7f7b541f1eb0 2024-04-25T12:21:47.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.541+0000 7f7b5c7cb640 1 -- 172.21.15.94:0/1083847162 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7b540c7df0 con 0x7f7b541f1eb0 2024-04-25T12:21:47.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.541+0000 7f7b4affd640 1 -- 172.21.15.94:0/1083847162 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) ==== 93+0+10 (secure 0 0 0) 0x7f7b44056130 con 0x7f7b541f1eb0 2024-04-25T12:21:47.548 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2024-04-25T12:21:47.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.545+0000 7f7b5c7cb640 1 -- 172.21.15.94:0/1083847162 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7b380683b0 msgr2=0x7f7b3806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:47.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.545+0000 7f7b5c7cb640 1 --2- 172.21.15.94:0/1083847162 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7b380683b0 0x7f7b3806a870 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7b50001760 tx=0x7f7b50009040 comp rx=0 tx=0).stop 2024-04-25T12:21:47.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.545+0000 7f7b5c7cb640 1 -- 172.21.15.94:0/1083847162 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b541f1eb0 msgr2=0x7f7b541ef350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:47.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.545+0000 7f7b5c7cb640 1 --2- 172.21.15.94:0/1083847162 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b541f1eb0 0x7f7b541ef350 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400d770 tx=0x7f7b4400dc30 comp rx=0 tx=0).stop 2024-04-25T12:21:47.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.545+0000 7f7b5c7cb640 1 -- 172.21.15.94:0/1083847162 shutdown_connections 2024-04-25T12:21:47.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.545+0000 7f7b5c7cb640 1 --2- 172.21.15.94:0/1083847162 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7b380683b0 0x7f7b3806a870 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.545+0000 7f7b5c7cb640 1 --2- 172.21.15.94:0/1083847162 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7b54154d50 0x7f7b5415c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.545+0000 7f7b5c7cb640 1 --2- 172.21.15.94:0/1083847162 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7b541f1eb0 0x7f7b541ef350 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.545+0000 7f7b5c7cb640 1 --2- 172.21.15.94:0/1083847162 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b400051d0 0x7f7b54158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.545+0000 7f7b5c7cb640 1 -- 172.21.15.94:0/1083847162 >> 172.21.15.94:0/1083847162 conn(0x7f7b5406b9d0 msgr2=0x7f7b540729f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:47.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.545+0000 7f7b5c7cb640 1 -- 172.21.15.94:0/1083847162 shutdown_connections 2024-04-25T12:21:47.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.545+0000 7f7b5c7cb640 1 -- 172.21.15.94:0/1083847162 wait complete. 2024-04-25T12:21:47.565 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:21:47.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f5614977640 1 Processor -- start 2024-04-25T12:21:47.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f5614977640 1 -- start start 2024-04-25T12:21:47.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f5614977640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5610152ee0 0x7f561006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:47.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f5614977640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f56100c6ca0 0x7f56100c7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:47.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f5614977640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56100c4b40 con 0x7f56100c88a0 2024-04-25T12:21:47.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f5614977640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f5610070490 con 0x7f56100c6ca0 2024-04-25T12:21:47.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f5614977640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f56100c5430 con 0x7f5610152ee0 2024-04-25T12:21:47.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560dd9b640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f56100c88a0 0x7f561006cf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:48048/0 (socket says 172.21.15.94:48048) 2024-04-25T12:21:47.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560dd9b640 1 -- 172.21.15.94:0/1581357010 learned_addr learned my addr 172.21.15.94:0/1581357010 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:21:47.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560e59c640 1 --2- 172.21.15.94:0/1581357010 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5610152ee0 0x7f561006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:47.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560ed9d640 1 --2- 172.21.15.94:0/1581357010 >> v2:172.21.15.111:3300/0 conn(0x7f56100c6ca0 0x7f56100c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:47.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560d59a640 1 -- 172.21.15.94:0/1581357010 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 915399682 0 0) 0x7f56100c4b40 con 0x7f56100c88a0 2024-04-25T12:21:47.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560d59a640 1 -- 172.21.15.94:0/1581357010 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55f8003530 con 0x7f56100c88a0 2024-04-25T12:21:47.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560d59a640 1 -- 172.21.15.94:0/1581357010 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3058618846 0 0) 0x7f55f8003530 con 0x7f56100c88a0 2024-04-25T12:21:47.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560d59a640 1 -- 172.21.15.94:0/1581357010 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5610152ee0 msgr2=0x7f561006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:47.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560d59a640 1 --2- 172.21.15.94:0/1581357010 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5610152ee0 0x7f561006ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560d59a640 1 -- 172.21.15.94:0/1581357010 >> v2:172.21.15.111:3300/0 conn(0x7f56100c6ca0 msgr2=0x7f56100c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:47.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560d59a640 1 --2- 172.21.15.94:0/1581357010 >> v2:172.21.15.111:3300/0 conn(0x7f56100c6ca0 0x7f56100c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560d59a640 1 -- 172.21.15.94:0/1581357010 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56100c7650 con 0x7f56100c88a0 2024-04-25T12:21:47.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560d59a640 1 -- 172.21.15.94:0/1581357010 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7f5604001680 con 0x7f56100c88a0 2024-04-25T12:21:47.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560d59a640 1 -- 172.21.15.94:0/1581357010 >> v1:172.21.15.94:6789/0 conn(0x7f56100c88a0 legacy=0x7f561006cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:47.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560d59a640 1 --2- 172.21.15.94:0/1581357010 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f55f80039c0 0x7f55f8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:47.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560d59a640 1 --2- 172.21.15.94:0/1581357010 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55f8004810 0x7f55f8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:47.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560d59a640 1 --2- 172.21.15.94:0/1581357010 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5610152ee0 0x7f55f80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:47.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560d59a640 1 -- 172.21.15.94:0/1581357010 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5610070490 con 0x7f55f8004810 2024-04-25T12:21:47.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560d59a640 1 -- 172.21.15.94:0/1581357010 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f56100c5430 con 0x7f55f80039c0 2024-04-25T12:21:47.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560d59a640 1 -- 172.21.15.94:0/1581357010 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f55f800ba00 con 0x7f5610152ee0 2024-04-25T12:21:47.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560dd9b640 1 --2- 172.21.15.94:0/1581357010 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55f8004810 0x7f55f8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:47.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560dd9b640 1 -- 172.21.15.94:0/1581357010 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5610152ee0 msgr2=0x7f55f80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:47.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560ed9d640 1 --2- 172.21.15.94:0/1581357010 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5610152ee0 0x7f55f80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:47.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560e59c640 1 --2- 172.21.15.94:0/1581357010 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f55f80039c0 0x7f55f8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:47.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560dd9b640 1 --2- 172.21.15.94:0/1581357010 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5610152ee0 0x7f55f80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560dd9b640 1 -- 172.21.15.94:0/1581357010 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f55f80039c0 msgr2=0x7f55f8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:47.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560dd9b640 1 --2- 172.21.15.94:0/1581357010 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f55f80039c0 0x7f55f8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560dd9b640 1 -- 172.21.15.94:0/1581357010 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f8003530 con 0x7f55f8004810 2024-04-25T12:21:47.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560ed9d640 1 --2- 172.21.15.94:0/1581357010 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5610152ee0 0x7f55f80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:47.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.665+0000 7f560e59c640 1 --2- 172.21.15.94:0/1581357010 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f55f80039c0 0x7f55f8003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:47.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.669+0000 7f560dd9b640 1 --2- 172.21.15.94:0/1581357010 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55f8004810 0x7f55f8004c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f560400c190 tx=0x7f560401cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d54b2beb20fece server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:47.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.669+0000 7f560d59a640 1 -- 172.21.15.94:0/1581357010 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5604007c70 con 0x7f55f8004810 2024-04-25T12:21:47.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.669+0000 7f560d59a640 1 -- 172.21.15.94:0/1581357010 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56040a9020 con 0x7f55f8004810 2024-04-25T12:21:47.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.669+0000 7f560d59a640 1 -- 172.21.15.94:0/1581357010 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5604005b00 con 0x7f55f8004810 2024-04-25T12:21:47.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.669+0000 7f5614977640 1 -- 172.21.15.94:0/1581357010 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55f8004810 msgr2=0x7f55f8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:47.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.669+0000 7f5614977640 1 --2- 172.21.15.94:0/1581357010 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55f8004810 0x7f55f8004c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f560400c190 tx=0x7f560401cbe0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.669+0000 7f560ed9d640 1 -- 172.21.15.94:0/1581357010 reap_dead start 2024-04-25T12:21:47.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.669+0000 7f5614977640 1 -- 172.21.15.94:0/1581357010 shutdown_connections 2024-04-25T12:21:47.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.669+0000 7f5614977640 1 -- 172.21.15.94:0/1581357010 >> 172.21.15.94:0/1581357010 conn(0x7f56100ca540 msgr2=0x7f56100ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:47.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.669+0000 7f5614977640 1 -- 172.21.15.94:0/1581357010 shutdown_connections 2024-04-25T12:21:47.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.669+0000 7f5614977640 1 -- 172.21.15.94:0/1581357010 wait complete. 2024-04-25T12:21:47.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.669+0000 7f5614977640 1 Processor -- start 2024-04-25T12:21:47.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.669+0000 7f5614977640 1 -- start start 2024-04-25T12:21:47.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.669+0000 7f5614977640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f55f8004810 0x7f56101e5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:47.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.669+0000 7f5614977640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5610148370 0x7f5610146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:47.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.669+0000 7f5614977640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56101487f0 0x7f56101467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:47.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.669+0000 7f5614977640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f56100c4de0 con 0x7f5610148370 2024-04-25T12:21:47.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.669+0000 7f5614977640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5610070990 con 0x7f55f8004810 2024-04-25T12:21:47.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.669+0000 7f5614977640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f56100c50c0 con 0x7f56101487f0 2024-04-25T12:21:47.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.669+0000 7f560dd9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5610148370 0x7f5610146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:47.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.669+0000 7f560dd9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5610148370 0x7f5610146270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58386/0 (socket says 172.21.15.94:58386) 2024-04-25T12:21:47.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.669+0000 7f560dd9b640 1 -- 172.21.15.94:0/1626046980 learned_addr learned my addr 172.21.15.94:0/1626046980 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:47.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.673+0000 7f560e59c640 1 --2- 172.21.15.94:0/1626046980 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f55f8004810 0x7f56101e5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:47.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.673+0000 7f560dd9b640 1 -- 172.21.15.94:0/1626046980 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56101487f0 msgr2=0x7f56101467b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:47.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.673+0000 7f560ed9d640 1 --2- 172.21.15.94:0/1626046980 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56101487f0 0x7f56101467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:47.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.673+0000 7f560dd9b640 1 --2- 172.21.15.94:0/1626046980 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56101487f0 0x7f56101467b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.673+0000 7f560dd9b640 1 -- 172.21.15.94:0/1626046980 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f55f8004810 msgr2=0x7f56101e5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:47.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.673+0000 7f560dd9b640 1 --2- 172.21.15.94:0/1626046980 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f55f8004810 0x7f56101e5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.673+0000 7f560dd9b640 1 -- 172.21.15.94:0/1626046980 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5610145dc0 con 0x7f5610148370 2024-04-25T12:21:47.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.673+0000 7f560e59c640 1 --2- 172.21.15.94:0/1626046980 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f55f8004810 0x7f56101e5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:47.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.673+0000 7f560dd9b640 1 --2- 172.21.15.94:0/1626046980 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5610148370 0x7f5610146270 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5604007040 tx=0x7f55f8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:47.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.673+0000 7f55feffd640 1 -- 172.21.15.94:0/1626046980 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5604007c70 con 0x7f5610148370 2024-04-25T12:21:47.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.673+0000 7f55feffd640 1 -- 172.21.15.94:0/1626046980 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56040a5c10 con 0x7f5610148370 2024-04-25T12:21:47.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.673+0000 7f5614977640 1 -- 172.21.15.94:0/1626046980 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f561006d7b0 con 0x7f5610148370 2024-04-25T12:21:47.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.673+0000 7f55feffd640 1 -- 172.21.15.94:0/1626046980 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5604001bb0 con 0x7f5610148370 2024-04-25T12:21:47.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.673+0000 7f5614977640 1 -- 172.21.15.94:0/1626046980 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56101f3cf0 con 0x7f5610148370 2024-04-25T12:21:47.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.673+0000 7f5614977640 1 -- 172.21.15.94:0/1626046980 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5610075df0 con 0x7f5610148370 2024-04-25T12:21:47.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.673+0000 7f55feffd640 1 -- 172.21.15.94:0/1626046980 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f56040070d0 con 0x7f5610148370 2024-04-25T12:21:47.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.673+0000 7f55feffd640 1 --2- 172.21.15.94:0/1626046980 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f55f00683b0 0x7f55f006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:47.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.673+0000 7f55feffd640 1 -- 172.21.15.94:0/1626046980 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f56041203d0 con 0x7f5610148370 2024-04-25T12:21:47.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.673+0000 7f560e59c640 1 --2- 172.21.15.94:0/1626046980 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f55f00683b0 0x7f55f006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:47.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.673+0000 7f560e59c640 1 --2- 172.21.15.94:0/1626046980 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f55f00683b0 0x7f55f006a870 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5610151520 tx=0x7f5600008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:47.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.677+0000 7f55feffd640 1 -- 172.21.15.94:0/1626046980 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f56040168f0 con 0x7f5610148370 2024-04-25T12:21:47.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.873+0000 7f5614977640 1 -- 172.21.15.94:0/1626046980 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f561014cdb0 con 0x7f5610148370 2024-04-25T12:21:47.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.873+0000 7f55feffd640 1 -- 172.21.15.94:0/1626046980 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f56040f0ce0 con 0x7f5610148370 2024-04-25T12:21:47.880 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:21:47.880 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/1182495659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1182495659},{"type":"v1","addr":"172.21.15.94:6837","nonce":1182495659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T12:21:47.880 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 2 2024-04-25T12:21:47.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.877+0000 7f5614977640 1 -- 172.21.15.94:0/1626046980 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f55f00683b0 msgr2=0x7f55f006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:47.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.877+0000 7f5614977640 1 --2- 172.21.15.94:0/1626046980 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f55f00683b0 0x7f55f006a870 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5610151520 tx=0x7f5600008040 comp rx=0 tx=0).stop 2024-04-25T12:21:47.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.877+0000 7f5614977640 1 -- 172.21.15.94:0/1626046980 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5610148370 msgr2=0x7f5610146270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:47.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.877+0000 7f5614977640 1 --2- 172.21.15.94:0/1626046980 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5610148370 0x7f5610146270 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5604007040 tx=0x7f55f8005840 comp rx=0 tx=0).stop 2024-04-25T12:21:47.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.877+0000 7f5614977640 1 -- 172.21.15.94:0/1626046980 shutdown_connections 2024-04-25T12:21:47.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.877+0000 7f5614977640 1 --2- 172.21.15.94:0/1626046980 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f55f00683b0 0x7f55f006a870 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.877+0000 7f5614977640 1 --2- 172.21.15.94:0/1626046980 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56101487f0 0x7f56101467b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.877+0000 7f5614977640 1 --2- 172.21.15.94:0/1626046980 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5610148370 0x7f5610146270 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.877+0000 7f5614977640 1 --2- 172.21.15.94:0/1626046980 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f55f8004810 0x7f56101e5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:47.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.877+0000 7f5614977640 1 -- 172.21.15.94:0/1626046980 >> 172.21.15.94:0/1626046980 conn(0x7f56100ca540 msgr2=0x7f5610150050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:47.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.877+0000 7f5614977640 1 -- 172.21.15.94:0/1626046980 shutdown_connections 2024-04-25T12:21:47.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:47.877+0000 7f5614977640 1 -- 172.21.15.94:0/1626046980 wait complete. 2024-04-25T12:21:49.435 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:21:49.438 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:21:49.898 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:21:50.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.025+0000 7f2184372640 1 Processor -- start 2024-04-25T12:21:50.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.025+0000 7f2184372640 1 -- start start 2024-04-25T12:21:50.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.025+0000 7f2184372640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f217c14fbc0 0x7f217c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.025+0000 7f2184372640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f217c074100 0x7f217c0c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.025+0000 7f2184372640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f217c0c5d70 con 0x7f217c14ffa0 2024-04-25T12:21:50.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.025+0000 7f2184372640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f217c0c6050 con 0x7f217c14fbc0 2024-04-25T12:21:50.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.025+0000 7f2184372640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f217c0c6330 con 0x7f217c074100 2024-04-25T12:21:50.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.025+0000 7f218210e640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f217c14fbc0 0x7f217c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.025+0000 7f218290f640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f217c074100 0x7f217c0c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.025+0000 7f218210e640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f217c14fbc0 0x7f217c06f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.94:53398/0 (socket says 172.21.15.94:53398) 2024-04-25T12:21:50.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.025+0000 7f218290f640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f217c074100 0x7f217c0c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.94:44502/0 (socket says 172.21.15.94:44502) 2024-04-25T12:21:50.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.025+0000 7f218210e640 1 -- 172.21.15.94:0/1075226866 learned_addr learned my addr 172.21.15.94:0/1075226866 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:50.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.025+0000 7f218190d640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f217c14ffa0 0x7f217c0c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.94:37586/0 (socket says 172.21.15.94:37586) 2024-04-25T12:21:50.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.025+0000 7f218210e640 1 -- 172.21.15.94:0/1075226866 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f217c074100 msgr2=0x7f217c0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:50.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.025+0000 7f218210e640 1 --2- 172.21.15.94:0/1075226866 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f217c074100 0x7f217c0c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.025+0000 7f218210e640 1 -- 172.21.15.94:0/1075226866 >> v1:172.21.15.111:6789/0 conn(0x7f217c14ffa0 legacy=0x7f217c0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:50.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.025+0000 7f218210e640 1 -- 172.21.15.94:0/1075226866 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f217c0c6610 con 0x7f217c14fbc0 2024-04-25T12:21:50.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.029+0000 7f218210e640 1 --2- 172.21.15.94:0/1075226866 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f217c14fbc0 0x7f217c06f700 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2178009870 tx=0x7f217801c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8eb46e6d94ac5213 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:50.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.029+0000 7f218110c640 1 -- 172.21.15.94:0/1075226866 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21780a9640 con 0x7f217c14fbc0 2024-04-25T12:21:50.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.029+0000 7f218110c640 1 -- 172.21.15.94:0/1075226866 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21780a97e0 con 0x7f217c14fbc0 2024-04-25T12:21:50.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.029+0000 7f218110c640 1 -- 172.21.15.94:0/1075226866 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21780a9bb0 con 0x7f217c14fbc0 2024-04-25T12:21:50.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.029+0000 7f2184372640 1 -- 172.21.15.94:0/1075226866 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f217c14fbc0 msgr2=0x7f217c06f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:50.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.029+0000 7f2184372640 1 --2- 172.21.15.94:0/1075226866 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f217c14fbc0 0x7f217c06f700 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2178009870 tx=0x7f217801c560 comp rx=0 tx=0).stop 2024-04-25T12:21:50.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.029+0000 7f2184372640 1 -- 172.21.15.94:0/1075226866 shutdown_connections 2024-04-25T12:21:50.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.029+0000 7f2184372640 1 --2- 172.21.15.94:0/1075226866 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f217c074100 0x7f217c0c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.029+0000 7f2184372640 1 --2- 172.21.15.94:0/1075226866 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f217c14fbc0 0x7f217c06f700 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.029+0000 7f2184372640 1 -- 172.21.15.94:0/1075226866 >> 172.21.15.94:0/1075226866 conn(0x7f217c06b9d0 msgr2=0x7f217c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:50.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.029+0000 7f2184372640 1 -- 172.21.15.94:0/1075226866 shutdown_connections 2024-04-25T12:21:50.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.029+0000 7f2184372640 1 -- 172.21.15.94:0/1075226866 wait complete. 2024-04-25T12:21:50.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.029+0000 7f2184372640 1 Processor -- start 2024-04-25T12:21:50.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.029+0000 7f2184372640 1 -- start start 2024-04-25T12:21:50.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f2184372640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f217c074100 0x7f217c1463e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f2184372640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f217c14fbc0 0x7f217c14b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f2184372640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f217c14ffa0 0x7f217c15b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f2184372640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f217c0c8ab0 con 0x7f217c14fbc0 2024-04-25T12:21:50.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f2184372640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f217c0c8930 con 0x7f217c074100 2024-04-25T12:21:50.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f2184372640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f217c166090 con 0x7f217c14ffa0 2024-04-25T12:21:50.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f218190d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f217c14fbc0 0x7f217c14b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f218190d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f217c14fbc0 0x7f217c14b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58394/0 (socket says 172.21.15.94:58394) 2024-04-25T12:21:50.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f218190d640 1 -- 172.21.15.94:0/2014793445 learned_addr learned my addr 172.21.15.94:0/2014793445 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:50.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f218210e640 1 --2- 172.21.15.94:0/2014793445 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f217c074100 0x7f217c1463e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f218290f640 1 --2- 172.21.15.94:0/2014793445 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f217c14ffa0 0x7f217c15b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f218190d640 1 -- 172.21.15.94:0/2014793445 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f217c14ffa0 msgr2=0x7f217c15b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:50.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f218190d640 1 --2- 172.21.15.94:0/2014793445 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f217c14ffa0 0x7f217c15b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f218190d640 1 -- 172.21.15.94:0/2014793445 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f217c074100 msgr2=0x7f217c1463e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:50.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f218190d640 1 --2- 172.21.15.94:0/2014793445 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f217c074100 0x7f217c1463e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f218190d640 1 -- 172.21.15.94:0/2014793445 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f217c1f4350 con 0x7f217c14fbc0 2024-04-25T12:21:50.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f218190d640 1 --2- 172.21.15.94:0/2014793445 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f217c14fbc0 0x7f217c14b5f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f216c00c3a0 tx=0x7f216c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:50.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f2172ffd640 1 -- 172.21.15.94:0/2014793445 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c0074e0 con 0x7f217c14fbc0 2024-04-25T12:21:50.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f2172ffd640 1 -- 172.21.15.94:0/2014793445 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f216c007680 con 0x7f217c14fbc0 2024-04-25T12:21:50.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f2172ffd640 1 -- 172.21.15.94:0/2014793445 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c004a30 con 0x7f217c14fbc0 2024-04-25T12:21:50.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f2184372640 1 -- 172.21.15.94:0/2014793445 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f217c0cad30 con 0x7f217c14fbc0 2024-04-25T12:21:50.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f2184372640 1 -- 172.21.15.94:0/2014793445 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f217c1f48f0 con 0x7f217c14fbc0 2024-04-25T12:21:50.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f2184372640 1 -- 172.21.15.94:0/2014793445 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f217c075df0 con 0x7f217c14fbc0 2024-04-25T12:21:50.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f2172ffd640 1 -- 172.21.15.94:0/2014793445 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f216c01a020 con 0x7f217c14fbc0 2024-04-25T12:21:50.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f2172ffd640 1 --2- 172.21.15.94:0/2014793445 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2160068380 0x7f216006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f2172ffd640 1 -- 172.21.15.94:0/2014793445 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f216c085d10 con 0x7f217c14fbc0 2024-04-25T12:21:50.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f218210e640 1 --2- 172.21.15.94:0/2014793445 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2160068380 0x7f216006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.033+0000 7f218210e640 1 --2- 172.21.15.94:0/2014793445 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2160068380 0x7f216006a840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f21780ae000 tx=0x7f21780b3040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:50.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.037+0000 7f2172ffd640 1 -- 172.21.15.94:0/2014793445 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f216c0566b0 con 0x7f217c14fbc0 2024-04-25T12:21:50.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.225+0000 7f2184372640 1 -- 172.21.15.94:0/2014793445 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f217c0caf90 con 0x7f217c14fbc0 2024-04-25T12:21:50.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.229+0000 7f2172ffd640 1 -- 172.21.15.94:0/2014793445 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5521 (secure 0 0 0) 0x7f216c055fb0 con 0x7f217c14fbc0 2024-04-25T12:21:50.234 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:21:50.234 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6838/1468945344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6835","nonce":1468945344},{"type":"v1","addr":"172.21.15.94:6838","nonce":1468945344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4223,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6839/3773379365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":3773379365},{"type":"v1","addr":"172.21.15.94:6839","nonce":3773379365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6835/3463503555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3463503555},{"type":"v1","addr":"172.21.15.111:6835","nonce":3463503555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/1182495659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1182495659},{"type":"v1","addr":"172.21.15.94:6837","nonce":1182495659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6833/2332499082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":2332499082},{"type":"v1","addr":"172.21.15.111:6833","nonce":2332499082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6837/3560813143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":3560813143},{"type":"v1","addr":"172.21.15.111:6837","nonce":3560813143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T12:21:50.235 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 3 2024-04-25T12:21:50.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.229+0000 7f2184372640 1 -- 172.21.15.94:0/2014793445 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2160068380 msgr2=0x7f216006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:50.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.229+0000 7f2184372640 1 --2- 172.21.15.94:0/2014793445 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2160068380 0x7f216006a840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f21780ae000 tx=0x7f21780b3040 comp rx=0 tx=0).stop 2024-04-25T12:21:50.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.229+0000 7f2184372640 1 -- 172.21.15.94:0/2014793445 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f217c14fbc0 msgr2=0x7f217c14b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:50.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.229+0000 7f2184372640 1 --2- 172.21.15.94:0/2014793445 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f217c14fbc0 0x7f217c14b5f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f216c00c3a0 tx=0x7f216c00c860 comp rx=0 tx=0).stop 2024-04-25T12:21:50.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.229+0000 7f2184372640 1 -- 172.21.15.94:0/2014793445 shutdown_connections 2024-04-25T12:21:50.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.229+0000 7f2184372640 1 --2- 172.21.15.94:0/2014793445 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2160068380 0x7f216006a840 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.229+0000 7f2184372640 1 --2- 172.21.15.94:0/2014793445 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f217c14ffa0 0x7f217c15b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.229+0000 7f2184372640 1 --2- 172.21.15.94:0/2014793445 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f217c14fbc0 0x7f217c14b5f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.229+0000 7f2184372640 1 --2- 172.21.15.94:0/2014793445 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f217c074100 0x7f217c1463e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.229+0000 7f2184372640 1 -- 172.21.15.94:0/2014793445 >> 172.21.15.94:0/2014793445 conn(0x7f217c06b9d0 msgr2=0x7f217c06ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:50.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.229+0000 7f2184372640 1 -- 172.21.15.94:0/2014793445 shutdown_connections 2024-04-25T12:21:50.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.229+0000 7f2184372640 1 -- 172.21.15.94:0/2014793445 wait complete. 2024-04-25T12:21:50.251 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:21:50.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.361+0000 7f1c914ea640 1 Processor -- start 2024-04-25T12:21:50.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.361+0000 7f1c914ea640 1 -- start start 2024-04-25T12:21:50.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.361+0000 7f1c914ea640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1c8c0c8630 0x7f1c8c151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.361+0000 7f1c914ea640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1c8c0c8a70 0x7f1c8c152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.361+0000 7f1c914ea640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c8c15b740 con 0x7f1c8c0c8250 2024-04-25T12:21:50.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.361+0000 7f1c914ea640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f1c8c0c6490 con 0x7f1c8c0c8a70 2024-04-25T12:21:50.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.361+0000 7f1c914ea640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f1c8c1525c0 con 0x7f1c8c0c8630 2024-04-25T12:21:50.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.365+0000 7f1c8b7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1c8c0c8a70 0x7f1c8c152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.365+0000 7f1c8affd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f1c8c0c8250 0x7f1c8c0c39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:48056/0 (socket says 172.21.15.94:48056) 2024-04-25T12:21:50.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.365+0000 7f1c8b7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1c8c0c8a70 0x7f1c8c152080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58404/0 (socket says 172.21.15.94:58404) 2024-04-25T12:21:50.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.365+0000 7f1c8affd640 1 -- 172.21.15.94:0/2886037530 learned_addr learned my addr 172.21.15.94:0/2886037530 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:21:50.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.365+0000 7f1c8a7fc640 1 --2- 172.21.15.94:0/2886037530 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1c8c0c8630 0x7f1c8c151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.365+0000 7f1c8b7fe640 1 -- 172.21.15.94:0/2886037530 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1c8c0c8630 msgr2=0x7f1c8c151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:50.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.365+0000 7f1c8b7fe640 1 --2- 172.21.15.94:0/2886037530 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1c8c0c8630 0x7f1c8c151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.365+0000 7f1c8b7fe640 1 -- 172.21.15.94:0/2886037530 >> v1:172.21.15.94:6789/0 conn(0x7f1c8c0c8250 legacy=0x7f1c8c0c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:50.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.365+0000 7f1c8b7fe640 1 -- 172.21.15.94:0/2886037530 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c8c0c40f0 con 0x7f1c8c0c8a70 2024-04-25T12:21:50.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.365+0000 7f1c89ffb640 1 -- 172.21.15.94:0/2886037530 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1783037338 0 0) 0x7f1c8c15b740 con 0x7f1c8c0c8250 2024-04-25T12:21:50.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.365+0000 7f1c8b7fe640 1 --2- 172.21.15.94:0/2886037530 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1c8c0c8a70 0x7f1c8c152080 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1c84009dc0 tx=0x7f1c8401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b56a2687c4c5af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:50.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.365+0000 7f1c89ffb640 1 -- 172.21.15.94:0/2886037530 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c840b2070 con 0x7f1c8c0c8a70 2024-04-25T12:21:50.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.365+0000 7f1c89ffb640 1 -- 172.21.15.94:0/2886037530 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c840a5780 con 0x7f1c8c0c8a70 2024-04-25T12:21:50.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.365+0000 7f1c89ffb640 1 -- 172.21.15.94:0/2886037530 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c840a5b50 con 0x7f1c8c0c8a70 2024-04-25T12:21:50.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.365+0000 7f1c914ea640 1 -- 172.21.15.94:0/2886037530 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1c8c0c8a70 msgr2=0x7f1c8c152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:50.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.365+0000 7f1c914ea640 1 --2- 172.21.15.94:0/2886037530 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1c8c0c8a70 0x7f1c8c152080 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1c84009dc0 tx=0x7f1c8401c8c0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.365+0000 7f1c914ea640 1 -- 172.21.15.94:0/2886037530 shutdown_connections 2024-04-25T12:21:50.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.365+0000 7f1c914ea640 1 --2- 172.21.15.94:0/2886037530 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1c8c0c8a70 0x7f1c8c152080 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.365+0000 7f1c914ea640 1 --2- 172.21.15.94:0/2886037530 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1c8c0c8630 0x7f1c8c151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.365+0000 7f1c914ea640 1 -- 172.21.15.94:0/2886037530 >> 172.21.15.94:0/2886037530 conn(0x7f1c8c06b9d0 msgr2=0x7f1c8c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:50.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.365+0000 7f1c914ea640 1 -- 172.21.15.94:0/2886037530 shutdown_connections 2024-04-25T12:21:50.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.365+0000 7f1c914ea640 1 -- 172.21.15.94:0/2886037530 wait complete. 2024-04-25T12:21:50.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.369+0000 7f1c914ea640 1 Processor -- start 2024-04-25T12:21:50.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.369+0000 7f1c914ea640 1 -- start start 2024-04-25T12:21:50.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.369+0000 7f1c914ea640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1c8c0c8250 0x7f1c8c147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.369+0000 7f1c914ea640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1c8c0c8630 0x7f1c8c1f7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.369+0000 7f1c914ea640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1c8c0c8a70 0x7f1c8c160f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.369+0000 7f1c914ea640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8c15b400 con 0x7f1c8c0c8a70 2024-04-25T12:21:50.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.369+0000 7f1c914ea640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8c0721a0 con 0x7f1c8c0c8630 2024-04-25T12:21:50.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.369+0000 7f1c914ea640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f1c8c0c6920 con 0x7f1c8c0c8250 2024-04-25T12:21:50.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.369+0000 7f1c8b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1c8c0c8a70 0x7f1c8c160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.369+0000 7f1c8b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1c8c0c8a70 0x7f1c8c160f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58416/0 (socket says 172.21.15.94:58416) 2024-04-25T12:21:50.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.369+0000 7f1c8b7fe640 1 -- 172.21.15.94:0/930656322 learned_addr learned my addr 172.21.15.94:0/930656322 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:50.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.369+0000 7f1c8affd640 1 --2- 172.21.15.94:0/930656322 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1c8c0c8250 0x7f1c8c147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.369+0000 7f1c8a7fc640 1 --2- 172.21.15.94:0/930656322 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1c8c0c8630 0x7f1c8c1f7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.369+0000 7f1c8b7fe640 1 -- 172.21.15.94:0/930656322 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1c8c0c8250 msgr2=0x7f1c8c147710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:50.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.369+0000 7f1c8b7fe640 1 --2- 172.21.15.94:0/930656322 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1c8c0c8250 0x7f1c8c147710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.369+0000 7f1c8b7fe640 1 -- 172.21.15.94:0/930656322 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1c8c0c8630 msgr2=0x7f1c8c1f7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:50.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.369+0000 7f1c8b7fe640 1 --2- 172.21.15.94:0/930656322 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1c8c0c8630 0x7f1c8c1f7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.369+0000 7f1c8b7fe640 1 -- 172.21.15.94:0/930656322 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c8c143880 con 0x7f1c8c0c8a70 2024-04-25T12:21:50.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.369+0000 7f1c8b7fe640 1 --2- 172.21.15.94:0/930656322 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1c8c0c8a70 0x7f1c8c160f30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1c8401a4f0 tx=0x7f1c84019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:50.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.369+0000 7f1c737fe640 1 -- 172.21.15.94:0/930656322 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c840b2050 con 0x7f1c8c0c8a70 2024-04-25T12:21:50.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.369+0000 7f1c737fe640 1 -- 172.21.15.94:0/930656322 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c840be070 con 0x7f1c8c0c8a70 2024-04-25T12:21:50.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.369+0000 7f1c914ea640 1 -- 172.21.15.94:0/930656322 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c8c145b00 con 0x7f1c8c0c8a70 2024-04-25T12:21:50.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.369+0000 7f1c737fe640 1 -- 172.21.15.94:0/930656322 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c840ad870 con 0x7f1c8c0c8a70 2024-04-25T12:21:50.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.369+0000 7f1c914ea640 1 -- 172.21.15.94:0/930656322 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c8c1460c0 con 0x7f1c8c0c8a70 2024-04-25T12:21:50.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.369+0000 7f1c914ea640 1 -- 172.21.15.94:0/930656322 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c8c075df0 con 0x7f1c8c0c8a70 2024-04-25T12:21:50.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.369+0000 7f1c737fe640 1 -- 172.21.15.94:0/930656322 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1c840ada10 con 0x7f1c8c0c8a70 2024-04-25T12:21:50.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.373+0000 7f1c737fe640 1 --2- 172.21.15.94:0/930656322 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f1c78068380 0x7f1c7806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.373+0000 7f1c737fe640 1 -- 172.21.15.94:0/930656322 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f1c841216e0 con 0x7f1c8c0c8a70 2024-04-25T12:21:50.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.373+0000 7f1c8affd640 1 --2- 172.21.15.94:0/930656322 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f1c78068380 0x7f1c7806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.373+0000 7f1c8affd640 1 --2- 172.21.15.94:0/930656322 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f1c78068380 0x7f1c7806a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c000f70 tx=0x7f1c7c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:50.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.377+0000 7f1c737fe640 1 -- 172.21.15.94:0/930656322 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1c84016540 con 0x7f1c8c0c8a70 2024-04-25T12:21:50.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.537+0000 7f1c914ea640 1 -- 172.21.15.94:0/930656322 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c8c071e50 con 0x7f1c8c0c8a70 2024-04-25T12:21:50.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.541+0000 7f1c737fe640 1 -- 172.21.15.94:0/930656322 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12885 (secure 0 0 0) 0x7f1c840f2110 con 0x7f1c8c0c8a70 2024-04-25T12:21:50.547 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:21:50.547 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":18,"fsid":"7059a9e2-aec4-4b84-b942-caf531e15da3","created":"2024-04-25T12:21:29.118508+0000","modified":"2024-04-25T12:21:42.941025+0000","last_up_change":"2024-04-25T12:21:40.912605+0000","last_in_change":"2024-04-25T12:21:31.372905+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:39.781011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"640a65ef-0734-468a-a8f5-9ed70cf75c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6809","nonce":2553247564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6811","nonce":2553247564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6815","nonce":2553247564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6813","nonce":2553247564}]},"public_addr":"172.21.15.94:6809/2553247564","cluster_addr":"172.21.15.94:6811/2553247564","heartbeat_back_addr":"172.21.15.94:6815/2553247564","heartbeat_front_addr":"172.21.15.94:6813/2553247564","state":["exists","up"]},{"osd":1,"uuid":"d6e886e6-c8c1-4761-9a4c-abc6961c7c81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6818","nonce":2492806478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6822","nonce":2492806478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6830","nonce":2492806478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6826","nonce":2492806478}]},"public_addr":"172.21.15.94:6818/2492806478","cluster_addr":"172.21.15.94:6822/2492806478","heartbeat_back_addr":"172.21.15.94:6830/2492806478","heartbeat_front_addr":"172.21.15.94:6826/2492806478","state":["exists","up"]},{"osd":2,"uuid":"ba20f409-ed46-43b6-b16d-43dc4622c042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6801","nonce":1485061290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6803","nonce":1485061290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6807","nonce":1485061290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6805","nonce":1485061290}]},"public_addr":"172.21.15.94:6801/1485061290","cluster_addr":"172.21.15.94:6803/1485061290","heartbeat_back_addr":"172.21.15.94:6807/1485061290","heartbeat_front_addr":"172.21.15.94:6805/1485061290","state":["exists","up"]},{"osd":3,"uuid":"85816a2b-3a3f-4ec8-8373-8230d948396f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6819","nonce":1548488434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6823","nonce":1548488434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6829","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6831","nonce":1548488434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6827","nonce":1548488434}]},"public_addr":"172.21.15.94:6819/1548488434","cluster_addr":"172.21.15.94:6823/1548488434","heartbeat_back_addr":"172.21.15.94:6831/1548488434","heartbeat_front_addr":"172.21.15.94:6827/1548488434","state":["exists","up"]},{"osd":4,"uuid":"b4a953b7-01d6-4623-9324-63135fdaf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6811","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6814","nonce":4070977083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6817","nonce":4070977083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6823","nonce":4070977083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6819","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6821","nonce":4070977083}]},"public_addr":"172.21.15.111:6814/4070977083","cluster_addr":"172.21.15.111:6817/4070977083","heartbeat_back_addr":"172.21.15.111:6823/4070977083","heartbeat_front_addr":"172.21.15.111:6821/4070977083","state":["exists","up"]},{"osd":5,"uuid":"c0acc514-427d-41bf-a965-b8463cebf045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6803","nonce":1054925605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6809","nonce":1054925605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6820","nonce":1054925605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6815","nonce":1054925605}]},"public_addr":"172.21.15.111:6803/1054925605","cluster_addr":"172.21.15.111:6809/1054925605","heartbeat_back_addr":"172.21.15.111:6820/1054925605","heartbeat_front_addr":"172.21.15.111:6815/1054925605","state":["exists","up"]},{"osd":6,"uuid":"26ff742f-5a57-44a7-a095-f04d6e87f885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6825","nonce":3619235078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6827","nonce":3619235078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6831","nonce":3619235078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6829","nonce":3619235078}]},"public_addr":"172.21.15.111:6825/3619235078","cluster_addr":"172.21.15.111:6827/3619235078","heartbeat_back_addr":"172.21.15.111:6831/3619235078","heartbeat_front_addr":"172.21.15.111:6829/3619235078","state":["exists","up"]},{"osd":7,"uuid":"9c214cba-693a-4b25-aad7-05a5b0006e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6801","nonce":558758517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6805","nonce":558758517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6813","nonce":558758517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6807","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6808","nonce":558758517}]},"public_addr":"172.21.15.111:6801/558758517","cluster_addr":"172.21.15.111:6805/558758517","heartbeat_back_addr":"172.21.15.111:6813/558758517","heartbeat_front_addr":"172.21.15.111:6808/558758517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.664958+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.853375+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.654455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:37.033852+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.968691+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.856013+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.913496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.848565+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:21:50.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.541+0000 7f1c914ea640 1 -- 172.21.15.94:0/930656322 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f1c78068380 msgr2=0x7f1c7806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:50.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.541+0000 7f1c914ea640 1 --2- 172.21.15.94:0/930656322 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f1c78068380 0x7f1c7806a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c000f70 tx=0x7f1c7c009040 comp rx=0 tx=0).stop 2024-04-25T12:21:50.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.541+0000 7f1c914ea640 1 -- 172.21.15.94:0/930656322 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1c8c0c8a70 msgr2=0x7f1c8c160f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:50.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.541+0000 7f1c914ea640 1 --2- 172.21.15.94:0/930656322 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1c8c0c8a70 0x7f1c8c160f30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1c8401a4f0 tx=0x7f1c84019660 comp rx=0 tx=0).stop 2024-04-25T12:21:50.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.545+0000 7f1c914ea640 1 -- 172.21.15.94:0/930656322 shutdown_connections 2024-04-25T12:21:50.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.545+0000 7f1c914ea640 1 --2- 172.21.15.94:0/930656322 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f1c78068380 0x7f1c7806a840 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.545+0000 7f1c914ea640 1 --2- 172.21.15.94:0/930656322 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1c8c0c8a70 0x7f1c8c160f30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.545+0000 7f1c914ea640 1 --2- 172.21.15.94:0/930656322 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1c8c0c8630 0x7f1c8c1f7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.545+0000 7f1c914ea640 1 --2- 172.21.15.94:0/930656322 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1c8c0c8250 0x7f1c8c147710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.545+0000 7f1c914ea640 1 -- 172.21.15.94:0/930656322 >> 172.21.15.94:0/930656322 conn(0x7f1c8c06b9d0 msgr2=0x7f1c8c147fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:50.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.545+0000 7f1c914ea640 1 -- 172.21.15.94:0/930656322 shutdown_connections 2024-04-25T12:21:50.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.545+0000 7f1c914ea640 1 -- 172.21.15.94:0/930656322 wait complete. 2024-04-25T12:21:50.566 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T12:21:39.781011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T12:21:50.566 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T12:21:50.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.681+0000 7f9b51e17640 1 Processor -- start 2024-04-25T12:21:50.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.681+0000 7f9b51e17640 1 -- start start 2024-04-25T12:21:50.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b51e17640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9b4c14ffa0 0x7f9b4c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b51e17640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b4c0c5d70 con 0x7f9b4c074100 2024-04-25T12:21:50.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b51e17640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b4c0c6050 con 0x7f9b4c14fbc0 2024-04-25T12:21:50.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b51e17640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f9b4c0c6330 con 0x7f9b4c14ffa0 2024-04-25T12:21:50.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4bfff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f9b4c074100 0x7f9b4c0c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:48070/0 (socket says 172.21.15.94:48070) 2024-04-25T12:21:50.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4bfff640 1 -- 172.21.15.94:0/1184219329 learned_addr learned my addr 172.21.15.94:0/1184219329 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:21:50.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4affd640 1 --2- 172.21.15.94:0/1184219329 >> v2:172.21.15.111:3300/0 conn(0x7f9b4c14ffa0 0x7f9b4c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4a7fc640 1 -- 172.21.15.94:0/1184219329 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3190008099 0 0) 0x7f9b4c0c5d70 con 0x7f9b4c074100 2024-04-25T12:21:50.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4a7fc640 1 -- 172.21.15.94:0/1184219329 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b34003530 con 0x7f9b4c074100 2024-04-25T12:21:50.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4a7fc640 1 -- 172.21.15.94:0/1184219329 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2400289551 0 0) 0x7f9b34003530 con 0x7f9b4c074100 2024-04-25T12:21:50.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4a7fc640 1 -- 172.21.15.94:0/1184219329 >> v2:172.21.15.111:3300/0 conn(0x7f9b4c14ffa0 msgr2=0x7f9b4c06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:50.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4a7fc640 1 --2- 172.21.15.94:0/1184219329 >> v2:172.21.15.111:3300/0 conn(0x7f9b4c14ffa0 0x7f9b4c06f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4a7fc640 1 -- 172.21.15.94:0/1184219329 >> v1:172.21.15.111:6789/0 conn(0x7f9b4c14fbc0 legacy=0x7f9b4c0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:50.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4a7fc640 1 -- 172.21.15.94:0/1184219329 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4c0c6610 con 0x7f9b4c074100 2024-04-25T12:21:50.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4a7fc640 1 -- 172.21.15.94:0/1184219329 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7f9b44001a00 con 0x7f9b4c074100 2024-04-25T12:21:50.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4a7fc640 1 -- 172.21.15.94:0/1184219329 >> v1:172.21.15.94:6789/0 conn(0x7f9b4c074100 legacy=0x7f9b4c0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:50.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4a7fc640 1 --2- 172.21.15.94:0/1184219329 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b340039c0 0x7f9b34003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4a7fc640 1 --2- 172.21.15.94:0/1184219329 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b34004810 0x7f9b34004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4a7fc640 1 --2- 172.21.15.94:0/1184219329 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b340051d0 0x7f9b3400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4a7fc640 1 -- 172.21.15.94:0/1184219329 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c0c6330 con 0x7f9b340051d0 2024-04-25T12:21:50.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4a7fc640 1 -- 172.21.15.94:0/1184219329 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3400c070 con 0x7f9b340039c0 2024-04-25T12:21:50.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4a7fc640 1 -- 172.21.15.94:0/1184219329 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f9b3400c270 con 0x7f9b34004810 2024-04-25T12:21:50.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4bfff640 1 --2- 172.21.15.94:0/1184219329 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b340051d0 0x7f9b3400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4b7fe640 1 --2- 172.21.15.94:0/1184219329 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b340039c0 0x7f9b34003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4affd640 1 --2- 172.21.15.94:0/1184219329 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b34004810 0x7f9b34004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4bfff640 1 -- 172.21.15.94:0/1184219329 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b34004810 msgr2=0x7f9b34004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:50.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4bfff640 1 --2- 172.21.15.94:0/1184219329 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b34004810 0x7f9b34004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4bfff640 1 -- 172.21.15.94:0/1184219329 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b340039c0 msgr2=0x7f9b34003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:50.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4bfff640 1 --2- 172.21.15.94:0/1184219329 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b340039c0 0x7f9b34003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4bfff640 1 -- 172.21.15.94:0/1184219329 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b34003530 con 0x7f9b340051d0 2024-04-25T12:21:50.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.685+0000 7f9b4b7fe640 1 --2- 172.21.15.94:0/1184219329 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b340039c0 0x7f9b34003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:50.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b4bfff640 1 -- 172.21.15.94:0/1184219329 reap_dead start 2024-04-25T12:21:50.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b4bfff640 1 --2- 172.21.15.94:0/1184219329 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b340051d0 0x7f9b3400b9d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c15a080 tx=0x7f9b4401d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2736ffda7afdc03 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:50.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b4a7fc640 1 -- 172.21.15.94:0/1184219329 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4400a460 con 0x7f9b340051d0 2024-04-25T12:21:50.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b4a7fc640 1 -- 172.21.15.94:0/1184219329 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b440ac620 con 0x7f9b340051d0 2024-04-25T12:21:50.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b4a7fc640 1 -- 172.21.15.94:0/1184219329 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b440aca10 con 0x7f9b340051d0 2024-04-25T12:21:50.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b51e17640 1 -- 172.21.15.94:0/1184219329 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b340051d0 msgr2=0x7f9b3400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:50.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b51e17640 1 --2- 172.21.15.94:0/1184219329 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b340051d0 0x7f9b3400b9d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c15a080 tx=0x7f9b4401d300 comp rx=0 tx=0).stop 2024-04-25T12:21:50.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b51e17640 1 -- 172.21.15.94:0/1184219329 shutdown_connections 2024-04-25T12:21:50.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b51e17640 1 --2- 172.21.15.94:0/1184219329 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b340051d0 0x7f9b3400b9d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b51e17640 1 -- 172.21.15.94:0/1184219329 >> 172.21.15.94:0/1184219329 conn(0x7f9b4c06b9d0 msgr2=0x7f9b4c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:50.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b51e17640 1 -- 172.21.15.94:0/1184219329 shutdown_connections 2024-04-25T12:21:50.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b51e17640 1 -- 172.21.15.94:0/1184219329 wait complete. 2024-04-25T12:21:50.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b51e17640 1 Processor -- start 2024-04-25T12:21:50.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b51e17640 1 -- start start 2024-04-25T12:21:50.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b51e17640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b340051d0 0x7f9b4c1418d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b51e17640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b4c0c47a0 0x7f9b4c14b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b51e17640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b4c14b660 0x7f9b4c15ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b51e17640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c074530 con 0x7f9b4c0c47a0 2024-04-25T12:21:50.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b51e17640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c0c5bf0 con 0x7f9b340051d0 2024-04-25T12:21:50.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b51e17640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f9b4c0681d0 con 0x7f9b4c14b660 2024-04-25T12:21:50.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b4affd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b4c0c47a0 0x7f9b4c14b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b4affd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b4c0c47a0 0x7f9b4c14b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58430/0 (socket says 172.21.15.94:58430) 2024-04-25T12:21:50.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b4affd640 1 -- 172.21.15.94:0/654018784 learned_addr learned my addr 172.21.15.94:0/654018784 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:50.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b4b7fe640 1 --2- 172.21.15.94:0/654018784 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b340051d0 0x7f9b4c1418d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b4bfff640 1 --2- 172.21.15.94:0/654018784 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b4c14b660 0x7f9b4c15ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b4affd640 1 -- 172.21.15.94:0/654018784 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b4c14b660 msgr2=0x7f9b4c15ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:50.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b4affd640 1 --2- 172.21.15.94:0/654018784 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b4c14b660 0x7f9b4c15ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b4affd640 1 -- 172.21.15.94:0/654018784 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b340051d0 msgr2=0x7f9b4c1418d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:50.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b4affd640 1 --2- 172.21.15.94:0/654018784 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b340051d0 0x7f9b4c1418d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b4affd640 1 -- 172.21.15.94:0/654018784 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4c15a0b0 con 0x7f9b4c0c47a0 2024-04-25T12:21:50.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b4affd640 1 --2- 172.21.15.94:0/654018784 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b4c0c47a0 0x7f9b4c14b120 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9b40011590 tx=0x7f9b40011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:50.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b33fff640 1 -- 172.21.15.94:0/654018784 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b40015930 con 0x7f9b4c0c47a0 2024-04-25T12:21:50.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b33fff640 1 -- 172.21.15.94:0/654018784 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b40015ad0 con 0x7f9b4c0c47a0 2024-04-25T12:21:50.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b51e17640 1 -- 172.21.15.94:0/654018784 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b4c15a380 con 0x7f9b4c0c47a0 2024-04-25T12:21:50.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b33fff640 1 -- 172.21.15.94:0/654018784 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4000f460 con 0x7f9b4c0c47a0 2024-04-25T12:21:50.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.689+0000 7f9b51e17640 1 -- 172.21.15.94:0/654018784 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b4c0c39e0 con 0x7f9b4c0c47a0 2024-04-25T12:21:50.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.693+0000 7f9b51e17640 1 -- 172.21.15.94:0/654018784 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b4c075df0 con 0x7f9b4c0c47a0 2024-04-25T12:21:50.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.693+0000 7f9b33fff640 1 -- 172.21.15.94:0/654018784 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9b4000f600 con 0x7f9b4c0c47a0 2024-04-25T12:21:50.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.693+0000 7f9b33fff640 1 --2- 172.21.15.94:0/654018784 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f9b38068380 0x7f9b3806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.693+0000 7f9b33fff640 1 -- 172.21.15.94:0/654018784 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f9b40086f40 con 0x7f9b4c0c47a0 2024-04-25T12:21:50.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.693+0000 7f9b4b7fe640 1 --2- 172.21.15.94:0/654018784 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f9b38068380 0x7f9b3806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.693+0000 7f9b4b7fe640 1 --2- 172.21.15.94:0/654018784 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f9b38068380 0x7f9b3806a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c007fd0 tx=0x7f9b3c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:50.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.697+0000 7f9b33fff640 1 -- 172.21.15.94:0/654018784 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9b40019030 con 0x7f9b4c0c47a0 2024-04-25T12:21:50.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.849+0000 7f9b51e17640 1 -- 172.21.15.94:0/654018784 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9b4c14c550 con 0x7f9b4c0c47a0 2024-04-25T12:21:50.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.853+0000 7f9b33fff640 1 -- 172.21.15.94:0/654018784 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) ==== 93+0+10 (secure 0 0 0) 0x7f9b40057850 con 0x7f9b4c0c47a0 2024-04-25T12:21:50.858 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2024-04-25T12:21:50.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.853+0000 7f9b51e17640 1 -- 172.21.15.94:0/654018784 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f9b38068380 msgr2=0x7f9b3806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:50.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.853+0000 7f9b51e17640 1 --2- 172.21.15.94:0/654018784 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f9b38068380 0x7f9b3806a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c007fd0 tx=0x7f9b3c009040 comp rx=0 tx=0).stop 2024-04-25T12:21:50.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.853+0000 7f9b51e17640 1 -- 172.21.15.94:0/654018784 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b4c0c47a0 msgr2=0x7f9b4c14b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:50.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.853+0000 7f9b51e17640 1 --2- 172.21.15.94:0/654018784 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b4c0c47a0 0x7f9b4c14b120 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9b40011590 tx=0x7f9b40011a50 comp rx=0 tx=0).stop 2024-04-25T12:21:50.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.853+0000 7f9b51e17640 1 -- 172.21.15.94:0/654018784 shutdown_connections 2024-04-25T12:21:50.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.853+0000 7f9b51e17640 1 --2- 172.21.15.94:0/654018784 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f9b38068380 0x7f9b3806a840 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.853+0000 7f9b51e17640 1 --2- 172.21.15.94:0/654018784 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b4c14b660 0x7f9b4c15ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.853+0000 7f9b51e17640 1 --2- 172.21.15.94:0/654018784 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9b4c0c47a0 0x7f9b4c14b120 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.853+0000 7f9b51e17640 1 --2- 172.21.15.94:0/654018784 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b340051d0 0x7f9b4c1418d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.853+0000 7f9b51e17640 1 -- 172.21.15.94:0/654018784 >> 172.21.15.94:0/654018784 conn(0x7f9b4c06b9d0 msgr2=0x7f9b4c0728f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:50.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.853+0000 7f9b51e17640 1 -- 172.21.15.94:0/654018784 shutdown_connections 2024-04-25T12:21:50.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.853+0000 7f9b51e17640 1 -- 172.21.15.94:0/654018784 wait complete. 2024-04-25T12:21:50.875 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T12:21:50.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81ecc3c640 1 Processor -- start 2024-04-25T12:21:50.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81ecc3c640 1 -- start start 2024-04-25T12:21:50.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81ecc3c640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81e80723d0 0x7f81e80727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81ecc3c640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f81e81533f0 0x7f81e806ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81ecc3c640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81e80742d0 con 0x7f81e8067b00 2024-04-25T12:21:50.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81ecc3c640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f81e8074550 con 0x7f81e81533f0 2024-04-25T12:21:50.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81ecc3c640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f81e8159a60 con 0x7f81e80723d0 2024-04-25T12:21:50.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e5d9b640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f81e8067b00 0x7f81e8152ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:48074/0 (socket says 172.21.15.94:48074) 2024-04-25T12:21:50.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e5d9b640 1 -- 172.21.15.94:0/1355227162 learned_addr learned my addr 172.21.15.94:0/1355227162 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:21:50.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e6d9d640 1 --2- 172.21.15.94:0/1355227162 >> v2:172.21.15.111:3300/0 conn(0x7f81e81533f0 0x7f81e806ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e659c640 1 --2- 172.21.15.94:0/1355227162 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81e80723d0 0x7f81e80727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e559a640 1 -- 172.21.15.94:0/1355227162 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 574585248 0 0) 0x7f81d0001120 con 0x7f81e8067b00 2024-04-25T12:21:50.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e559a640 1 -- 172.21.15.94:0/1355227162 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81d4003530 con 0x7f81e8067b00 2024-04-25T12:21:50.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e559a640 1 -- 172.21.15.94:0/1355227162 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3344573208 0 0) 0x7f81d4003530 con 0x7f81e8067b00 2024-04-25T12:21:50.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e559a640 1 -- 172.21.15.94:0/1355227162 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81e80723d0 msgr2=0x7f81e80727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:50.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e559a640 1 --2- 172.21.15.94:0/1355227162 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81e80723d0 0x7f81e80727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e559a640 1 -- 172.21.15.94:0/1355227162 >> v2:172.21.15.111:3300/0 conn(0x7f81e81533f0 msgr2=0x7f81e806ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:50.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e559a640 1 --2- 172.21.15.94:0/1355227162 >> v2:172.21.15.111:3300/0 conn(0x7f81e81533f0 0x7f81e806ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e559a640 1 -- 172.21.15.94:0/1355227162 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e80c9370 con 0x7f81e8067b00 2024-04-25T12:21:50.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e559a640 1 -- 172.21.15.94:0/1355227162 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7f81d0001850 con 0x7f81e8067b00 2024-04-25T12:21:50.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e559a640 1 -- 172.21.15.94:0/1355227162 >> v1:172.21.15.94:6789/0 conn(0x7f81e8067b00 legacy=0x7f81e8152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:50.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e559a640 1 --2- 172.21.15.94:0/1355227162 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81d40039c0 0x7f81d4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e559a640 1 --2- 172.21.15.94:0/1355227162 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81d4004810 0x7f81d4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e559a640 1 --2- 172.21.15.94:0/1355227162 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81e80723d0 0x7f81d40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:50.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e559a640 1 -- 172.21.15.94:0/1355227162 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f81e8074550 con 0x7f81d40039c0 2024-04-25T12:21:50.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e559a640 1 -- 172.21.15.94:0/1355227162 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f81e8159a60 con 0x7f81d4004810 2024-04-25T12:21:50.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e559a640 1 -- 172.21.15.94:0/1355227162 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f81d400b9d0 con 0x7f81e80723d0 2024-04-25T12:21:50.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e659c640 1 --2- 172.21.15.94:0/1355227162 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81d40039c0 0x7f81d4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e5d9b640 1 --2- 172.21.15.94:0/1355227162 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81d4004810 0x7f81d4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e6d9d640 1 --2- 172.21.15.94:0/1355227162 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81e80723d0 0x7f81d40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:50.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e659c640 1 -- 172.21.15.94:0/1355227162 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81e80723d0 msgr2=0x7f81d40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:50.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e659c640 1 --2- 172.21.15.94:0/1355227162 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81e80723d0 0x7f81d40051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e659c640 1 -- 172.21.15.94:0/1355227162 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81d4004810 msgr2=0x7f81d4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:50.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e659c640 1 --2- 172.21.15.94:0/1355227162 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81d4004810 0x7f81d4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:50.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.985+0000 7f81e659c640 1 -- 172.21.15.94:0/1355227162 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d4003530 con 0x7f81d40039c0 2024-04-25T12:21:50.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.989+0000 7f81e659c640 1 --2- 172.21.15.94:0/1355227162 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81d40039c0 0x7f81d4003de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f81d8009fa0 tx=0x7f81d801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b109f5fd45c49691 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:50.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.989+0000 7f81e559a640 1 -- 172.21.15.94:0/1355227162 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d80b2070 con 0x7f81d40039c0 2024-04-25T12:21:50.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.989+0000 7f81e559a640 1 -- 172.21.15.94:0/1355227162 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81d80a5a10 con 0x7f81d40039c0 2024-04-25T12:21:50.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.989+0000 7f81e559a640 1 -- 172.21.15.94:0/1355227162 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d8009bf0 con 0x7f81d40039c0 2024-04-25T12:21:50.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.989+0000 7f81ecc3c640 1 -- 172.21.15.94:0/1355227162 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81d40039c0 msgr2=0x7f81d4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:51.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.989+0000 7f81ecc3c640 1 --2- 172.21.15.94:0/1355227162 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81d40039c0 0x7f81d4003de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f81d8009fa0 tx=0x7f81d801cc40 comp rx=0 tx=0).stop 2024-04-25T12:21:51.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.989+0000 7f81e6d9d640 1 -- 172.21.15.94:0/1355227162 reap_dead start 2024-04-25T12:21:51.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.989+0000 7f81ecc3c640 1 -- 172.21.15.94:0/1355227162 shutdown_connections 2024-04-25T12:21:51.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.989+0000 7f81ecc3c640 1 -- 172.21.15.94:0/1355227162 >> 172.21.15.94:0/1355227162 conn(0x7f81e80c9a70 msgr2=0x7f81e80c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:51.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.989+0000 7f81ecc3c640 1 -- 172.21.15.94:0/1355227162 shutdown_connections 2024-04-25T12:21:51.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.989+0000 7f81ecc3c640 1 -- 172.21.15.94:0/1355227162 wait complete. 2024-04-25T12:21:51.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.989+0000 7f81ecc3c640 1 Processor -- start 2024-04-25T12:21:51.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.989+0000 7f81ecc3c640 1 -- start start 2024-04-25T12:21:51.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.989+0000 7f81ecc3c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81d40039c0 0x7f81e80c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:51.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.989+0000 7f81ecc3c640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81e8162250 0x7f81e8150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:51.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.989+0000 7f81ecc3c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81e8161540 0x7f81e81619f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:51.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.989+0000 7f81ecc3c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f81e8067820 con 0x7f81d40039c0 2024-04-25T12:21:51.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.989+0000 7f81ecc3c640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f81e80676a0 con 0x7f81e8161540 2024-04-25T12:21:51.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.989+0000 7f81ecc3c640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f81e8072bc0 con 0x7f81e8162250 2024-04-25T12:21:51.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.989+0000 7f81e659c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81d40039c0 0x7f81e80c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:51.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.989+0000 7f81e659c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81d40039c0 0x7f81e80c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58450/0 (socket says 172.21.15.94:58450) 2024-04-25T12:21:51.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.989+0000 7f81e659c640 1 -- 172.21.15.94:0/2941556930 learned_addr learned my addr 172.21.15.94:0/2941556930 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:51.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.993+0000 7f81e6d9d640 1 --2- 172.21.15.94:0/2941556930 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81e8161540 0x7f81e81619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:51.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.993+0000 7f81e5d9b640 1 --2- 172.21.15.94:0/2941556930 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81e8162250 0x7f81e8150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:51.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.993+0000 7f81e659c640 1 -- 172.21.15.94:0/2941556930 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81e8162250 msgr2=0x7f81e8150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:51.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.993+0000 7f81e659c640 1 --2- 172.21.15.94:0/2941556930 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81e8162250 0x7f81e8150490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:51.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.993+0000 7f81e659c640 1 -- 172.21.15.94:0/2941556930 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81e8161540 msgr2=0x7f81e81619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:51.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.993+0000 7f81e659c640 1 --2- 172.21.15.94:0/2941556930 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81e8161540 0x7f81e81619f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:51.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.993+0000 7f81e659c640 1 -- 172.21.15.94:0/2941556930 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e81f6350 con 0x7f81d40039c0 2024-04-25T12:21:51.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.993+0000 7f81e6d9d640 1 --2- 172.21.15.94:0/2941556930 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81e8161540 0x7f81e81619f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:51.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.993+0000 7f81e659c640 1 --2- 172.21.15.94:0/2941556930 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81d40039c0 0x7f81e80c8910 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f81d801ca70 tx=0x7f81d4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:51.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.993+0000 7f81deffd640 1 -- 172.21.15.94:0/2941556930 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d80be070 con 0x7f81d40039c0 2024-04-25T12:21:51.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.993+0000 7f81deffd640 1 -- 172.21.15.94:0/2941556930 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81d80b3040 con 0x7f81d40039c0 2024-04-25T12:21:51.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.993+0000 7f81ecc3c640 1 -- 172.21.15.94:0/2941556930 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81e81f23b0 con 0x7f81d40039c0 2024-04-25T12:21:51.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.993+0000 7f81deffd640 1 -- 172.21.15.94:0/2941556930 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d80b2050 con 0x7f81d40039c0 2024-04-25T12:21:51.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.993+0000 7f81ecc3c640 1 -- 172.21.15.94:0/2941556930 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81e81f2970 con 0x7f81d40039c0 2024-04-25T12:21:51.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.993+0000 7f81ecc3c640 1 -- 172.21.15.94:0/2941556930 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81e8075df0 con 0x7f81d40039c0 2024-04-25T12:21:51.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.993+0000 7f81deffd640 1 -- 172.21.15.94:0/2941556930 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f81d80c1070 con 0x7f81d40039c0 2024-04-25T12:21:51.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.993+0000 7f81deffd640 1 --2- 172.21.15.94:0/2941556930 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f81c8068380 0x7f81c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:51.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.993+0000 7f81deffd640 1 -- 172.21.15.94:0/2941556930 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f81d81207d0 con 0x7f81d40039c0 2024-04-25T12:21:51.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.993+0000 7f81e5d9b640 1 --2- 172.21.15.94:0/2941556930 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f81c8068380 0x7f81c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:51.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.993+0000 7f81e5d9b640 1 --2- 172.21.15.94:0/2941556930 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f81c8068380 0x7f81c806a840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f81d0000f70 tx=0x7f81d0000ee0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:51.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:50.997+0000 7f81deffd640 1 -- 172.21.15.94:0/2941556930 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f81d8016950 con 0x7f81d40039c0 2024-04-25T12:21:51.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.149+0000 7f81ecc3c640 1 -- 172.21.15.94:0/2941556930 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f81e806e970 con 0x7f81d40039c0 2024-04-25T12:21:51.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.149+0000 7f81deffd640 1 -- 172.21.15.94:0/2941556930 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f81d80f0b70 con 0x7f81d40039c0 2024-04-25T12:21:51.155 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:21:51.156 INFO:teuthology.orchestra.run.smithi094.stdout:[ 2024-04-25T12:21:51.156 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-25T12:21:51.156 INFO:teuthology.orchestra.run.smithi094.stdout: "poolnum": 1, 2024-04-25T12:21:51.156 INFO:teuthology.orchestra.run.smithi094.stdout: "poolname": ".mgr" 2024-04-25T12:21:51.156 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-25T12:21:51.156 INFO:teuthology.orchestra.run.smithi094.stdout:] 2024-04-25T12:21:51.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.153+0000 7f81ecc3c640 1 -- 172.21.15.94:0/2941556930 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f81c8068380 msgr2=0x7f81c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:51.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.153+0000 7f81ecc3c640 1 --2- 172.21.15.94:0/2941556930 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f81c8068380 0x7f81c806a840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f81d0000f70 tx=0x7f81d0000ee0 comp rx=0 tx=0).stop 2024-04-25T12:21:51.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.153+0000 7f81ecc3c640 1 -- 172.21.15.94:0/2941556930 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81d40039c0 msgr2=0x7f81e80c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:51.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.153+0000 7f81ecc3c640 1 --2- 172.21.15.94:0/2941556930 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81d40039c0 0x7f81e80c8910 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f81d801ca70 tx=0x7f81d4005840 comp rx=0 tx=0).stop 2024-04-25T12:21:51.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.153+0000 7f81ecc3c640 1 -- 172.21.15.94:0/2941556930 shutdown_connections 2024-04-25T12:21:51.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.153+0000 7f81ecc3c640 1 --2- 172.21.15.94:0/2941556930 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f81c8068380 0x7f81c806a840 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:51.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.153+0000 7f81ecc3c640 1 --2- 172.21.15.94:0/2941556930 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81e8162250 0x7f81e8150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:51.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.153+0000 7f81ecc3c640 1 --2- 172.21.15.94:0/2941556930 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81e8161540 0x7f81e81619f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:51.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.153+0000 7f81ecc3c640 1 --2- 172.21.15.94:0/2941556930 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81d40039c0 0x7f81e80c8910 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:51.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.153+0000 7f81ecc3c640 1 -- 172.21.15.94:0/2941556930 >> 172.21.15.94:0/2941556930 conn(0x7f81e80c9a70 msgr2=0x7f81e8156d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:51.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.153+0000 7f81ecc3c640 1 -- 172.21.15.94:0/2941556930 shutdown_connections 2024-04-25T12:21:51.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.153+0000 7f81ecc3c640 1 -- 172.21.15.94:0/2941556930 wait complete. 2024-04-25T12:21:51.174 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T12:21:51.174 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T12:21:51.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.293+0000 7f26b4dd1640 1 Processor -- start 2024-04-25T12:21:51.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.293+0000 7f26b4dd1640 1 -- start start 2024-04-25T12:21:51.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.293+0000 7f26b4dd1640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f26b00cabf0 0x7f26b015b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:51.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.293+0000 7f26b4dd1640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26b0072f70 con 0x7f26b015cc10 2024-04-25T12:21:51.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.293+0000 7f26b4dd1640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26b0073250 con 0x7f26b01445c0 2024-04-25T12:21:51.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.293+0000 7f26b4dd1640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f26b0072d20 con 0x7f26b00cabf0 2024-04-25T12:21:51.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.293+0000 7f26aed9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f26b00cabf0 0x7f26b015b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:51.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.293+0000 7f26add9b640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f26b015cc10 0x7f26b015b030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:48078/0 (socket says 172.21.15.94:48078) 2024-04-25T12:21:51.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.293+0000 7f26add9b640 1 -- 172.21.15.94:0/84138066 learned_addr learned my addr 172.21.15.94:0/84138066 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:21:51.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.293+0000 7f26aed9d640 1 -- 172.21.15.94:0/84138066 >> v1:172.21.15.111:6789/0 conn(0x7f26b01445c0 legacy=0x7f26b015c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:51.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.293+0000 7f26ad59a640 1 -- 172.21.15.94:0/84138066 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2254733708 0 0) 0x7f26b0072f70 con 0x7f26b015cc10 2024-04-25T12:21:51.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.293+0000 7f26aed9d640 1 -- 172.21.15.94:0/84138066 >> v1:172.21.15.94:6789/0 conn(0x7f26b015cc10 legacy=0x7f26b015b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:51.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.293+0000 7f26aed9d640 1 -- 172.21.15.94:0/84138066 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b0073530 con 0x7f26b00cabf0 2024-04-25T12:21:51.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26aed9d640 1 --2- 172.21.15.94:0/84138066 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26b00cabf0 0x7f26b015b740 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f26a8009d90 tx=0x7f26a801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=340f9e020a5f6b47 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:51.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26ad59a640 1 -- 172.21.15.94:0/84138066 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a80b2070 con 0x7f26b00cabf0 2024-04-25T12:21:51.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26ad59a640 1 -- 172.21.15.94:0/84138066 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26a80a5920 con 0x7f26b00cabf0 2024-04-25T12:21:51.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26ad59a640 1 -- 172.21.15.94:0/84138066 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a80a5cf0 con 0x7f26b00cabf0 2024-04-25T12:21:51.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26b4dd1640 1 -- 172.21.15.94:0/84138066 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26b00cabf0 msgr2=0x7f26b015b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:51.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26b4dd1640 1 --2- 172.21.15.94:0/84138066 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26b00cabf0 0x7f26b015b740 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f26a8009d90 tx=0x7f26a801c970 comp rx=0 tx=0).stop 2024-04-25T12:21:51.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26b4dd1640 1 -- 172.21.15.94:0/84138066 shutdown_connections 2024-04-25T12:21:51.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26b4dd1640 1 --2- 172.21.15.94:0/84138066 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26b00cabf0 0x7f26b015b740 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:51.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26b4dd1640 1 -- 172.21.15.94:0/84138066 >> 172.21.15.94:0/84138066 conn(0x7f26b00ca0d0 msgr2=0x7f26b00ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:51.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26b4dd1640 1 -- 172.21.15.94:0/84138066 shutdown_connections 2024-04-25T12:21:51.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26b4dd1640 1 -- 172.21.15.94:0/84138066 wait complete. 2024-04-25T12:21:51.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26b4dd1640 1 Processor -- start 2024-04-25T12:21:51.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26b4dd1640 1 -- start start 2024-04-25T12:21:51.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26b4dd1640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f26b00cabf0 0x7f26b015a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:51.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26b4dd1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26b01445c0 0x7f26b0157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:51.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26b4dd1640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f26b015cc10 0x7f26b0157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:51.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26b4dd1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f26b0169550 con 0x7f26b01445c0 2024-04-25T12:21:51.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26b4dd1640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f26b01693d0 con 0x7f26b015cc10 2024-04-25T12:21:51.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26b4dd1640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f26b01696d0 con 0x7f26b00cabf0 2024-04-25T12:21:51.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26add9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26b01445c0 0x7f26b0157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:51.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26add9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26b01445c0 0x7f26b0157310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58460/0 (socket says 172.21.15.94:58460) 2024-04-25T12:21:51.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26add9b640 1 -- 172.21.15.94:0/1483418054 learned_addr learned my addr 172.21.15.94:0/1483418054 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:51.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26ae59c640 1 --2- 172.21.15.94:0/1483418054 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f26b00cabf0 0x7f26b015a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:51.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26aed9d640 1 --2- 172.21.15.94:0/1483418054 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f26b015cc10 0x7f26b0157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:51.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26add9b640 1 -- 172.21.15.94:0/1483418054 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f26b00cabf0 msgr2=0x7f26b015a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:51.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26add9b640 1 --2- 172.21.15.94:0/1483418054 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f26b00cabf0 0x7f26b015a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:51.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26add9b640 1 -- 172.21.15.94:0/1483418054 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f26b015cc10 msgr2=0x7f26b0157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:51.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26add9b640 1 --2- 172.21.15.94:0/1483418054 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f26b015cc10 0x7f26b0157850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:51.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26add9b640 1 -- 172.21.15.94:0/1483418054 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b015adf0 con 0x7f26b01445c0 2024-04-25T12:21:51.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26ae59c640 1 --2- 172.21.15.94:0/1483418054 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f26b00cabf0 0x7f26b015a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:51.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26add9b640 1 --2- 172.21.15.94:0/1483418054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26b01445c0 0x7f26b0157310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f26a400c440 tx=0x7f26a400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:51.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f269effd640 1 -- 172.21.15.94:0/1483418054 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a4018070 con 0x7f26b01445c0 2024-04-25T12:21:51.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f269effd640 1 -- 172.21.15.94:0/1483418054 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26a40074e0 con 0x7f26b01445c0 2024-04-25T12:21:51.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f269effd640 1 -- 172.21.15.94:0/1483418054 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a4004a10 con 0x7f26b01445c0 2024-04-25T12:21:51.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26b4dd1640 1 -- 172.21.15.94:0/1483418054 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26b00c7ef0 con 0x7f26b01445c0 2024-04-25T12:21:51.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.297+0000 7f26b4dd1640 1 -- 172.21.15.94:0/1483418054 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26b00c8490 con 0x7f26b01445c0 2024-04-25T12:21:51.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.301+0000 7f26b4dd1640 1 -- 172.21.15.94:0/1483418054 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26b0075e60 con 0x7f26b01445c0 2024-04-25T12:21:51.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.301+0000 7f269effd640 1 -- 172.21.15.94:0/1483418054 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f26a401b070 con 0x7f26b01445c0 2024-04-25T12:21:51.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.301+0000 7f269effd640 1 --2- 172.21.15.94:0/1483418054 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2690068380 0x7f269006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:51.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.301+0000 7f269effd640 1 -- 172.21.15.94:0/1483418054 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f26a4085900 con 0x7f26b01445c0 2024-04-25T12:21:51.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.301+0000 7f26ae59c640 1 --2- 172.21.15.94:0/1483418054 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2690068380 0x7f269006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:51.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.301+0000 7f26ae59c640 1 --2- 172.21.15.94:0/1483418054 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2690068380 0x7f269006a840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f26a0000f70 tx=0x7f26a0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:51.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.305+0000 7f269effd640 1 -- 172.21.15.94:0/1483418054 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f26a4056180 con 0x7f26b01445c0 2024-04-25T12:21:51.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:51.453+0000 7f26b4dd1640 1 -- 172.21.15.94:0/1483418054 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f26b00c7c40 con 0x7f26b01445c0 2024-04-25T12:21:52.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.133+0000 7f269effd640 1 -- 172.21.15.94:0/1483418054 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7f26a4055a80 con 0x7f26b01445c0 2024-04-25T12:21:52.139 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_metadata' created 2024-04-25T12:21:52.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.137+0000 7f26b4dd1640 1 -- 172.21.15.94:0/1483418054 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2690068380 msgr2=0x7f269006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:52.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.137+0000 7f26b4dd1640 1 --2- 172.21.15.94:0/1483418054 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2690068380 0x7f269006a840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f26a0000f70 tx=0x7f26a0009040 comp rx=0 tx=0).stop 2024-04-25T12:21:52.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.137+0000 7f26b4dd1640 1 -- 172.21.15.94:0/1483418054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26b01445c0 msgr2=0x7f26b0157310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:52.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.137+0000 7f26b4dd1640 1 --2- 172.21.15.94:0/1483418054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26b01445c0 0x7f26b0157310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f26a400c440 tx=0x7f26a400c900 comp rx=0 tx=0).stop 2024-04-25T12:21:52.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.137+0000 7f26b4dd1640 1 -- 172.21.15.94:0/1483418054 shutdown_connections 2024-04-25T12:21:52.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.137+0000 7f26b4dd1640 1 --2- 172.21.15.94:0/1483418054 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2690068380 0x7f269006a840 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:52.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.137+0000 7f26b4dd1640 1 --2- 172.21.15.94:0/1483418054 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f26b015cc10 0x7f26b0157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:52.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.137+0000 7f26b4dd1640 1 --2- 172.21.15.94:0/1483418054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26b01445c0 0x7f26b0157310 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:52.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.137+0000 7f26b4dd1640 1 --2- 172.21.15.94:0/1483418054 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f26b00cabf0 0x7f26b015a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:52.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.137+0000 7f26b4dd1640 1 -- 172.21.15.94:0/1483418054 >> 172.21.15.94:0/1483418054 conn(0x7f26b00ca0d0 msgr2=0x7f26b01427b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:52.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.137+0000 7f26b4dd1640 1 -- 172.21.15.94:0/1483418054 shutdown_connections 2024-04-25T12:21:52.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.137+0000 7f26b4dd1640 1 -- 172.21.15.94:0/1483418054 wait complete. 2024-04-25T12:21:52.167 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-25T12:21:52.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.285+0000 7fa7cb984640 1 Processor -- start 2024-04-25T12:21:52.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.285+0000 7fa7cb984640 1 -- start start 2024-04-25T12:21:52.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.285+0000 7fa7cb984640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa7c41596b0 0x7fa7c4163380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:52.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.285+0000 7fa7cb984640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7c415f3d0 0x7fa7c406cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:52.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.285+0000 7fa7cb984640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7c41638c0 con 0x7fa7c40c8040 2024-04-25T12:21:52.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.285+0000 7fa7cb984640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fa7c4159a90 con 0x7fa7c41596b0 2024-04-25T12:21:52.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.285+0000 7fa7cb984640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa7c415f880 con 0x7fa7c415f3d0 2024-04-25T12:21:52.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.285+0000 7fa7c9720640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa7c41596b0 0x7fa7c4163380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:52.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.285+0000 7fa7c9720640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa7c41596b0 0x7fa7c4163380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40986/0 (socket says 172.21.15.94:40986) 2024-04-25T12:21:52.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.285+0000 7fa7c9720640 1 -- 172.21.15.94:0/4151412356 learned_addr learned my addr 172.21.15.94:0/4151412356 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:52.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.285+0000 7fa7c8f1f640 1 --2- 172.21.15.94:0/4151412356 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7c415f3d0 0x7fa7c406cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:52.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.285+0000 7fa7c9720640 1 -- 172.21.15.94:0/4151412356 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7c415f3d0 msgr2=0x7fa7c406cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:52.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.285+0000 7fa7c9720640 1 --2- 172.21.15.94:0/4151412356 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7c415f3d0 0x7fa7c406cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:52.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.285+0000 7fa7c9720640 1 -- 172.21.15.94:0/4151412356 >> v1:172.21.15.111:6789/0 conn(0x7fa7c40c8040 legacy=0x7fa7c4072790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:52.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.285+0000 7fa7c9720640 1 -- 172.21.15.94:0/4151412356 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c415fb60 con 0x7fa7c41596b0 2024-04-25T12:21:52.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.289+0000 7fa7c9720640 1 --2- 172.21.15.94:0/4151412356 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c41596b0 0x7fa7c4163380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc009e50 tx=0x7fa7bc01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4822c60aa6b621 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:52.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.289+0000 7fa7b7fff640 1 -- 172.21.15.94:0/4151412356 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc0b4070 con 0x7fa7c41596b0 2024-04-25T12:21:52.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.289+0000 7fa7b7fff640 1 -- 172.21.15.94:0/4151412356 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7bc0af400 con 0x7fa7c41596b0 2024-04-25T12:21:52.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.289+0000 7fa7b7fff640 1 -- 172.21.15.94:0/4151412356 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc0af7d0 con 0x7fa7c41596b0 2024-04-25T12:21:52.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.289+0000 7fa7cb984640 1 -- 172.21.15.94:0/4151412356 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c41596b0 msgr2=0x7fa7c4163380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:52.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.289+0000 7fa7cb984640 1 --2- 172.21.15.94:0/4151412356 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c41596b0 0x7fa7c4163380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc009e50 tx=0x7fa7bc01f1e0 comp rx=0 tx=0).stop 2024-04-25T12:21:52.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.289+0000 7fa7cb984640 1 -- 172.21.15.94:0/4151412356 shutdown_connections 2024-04-25T12:21:52.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.289+0000 7fa7cb984640 1 --2- 172.21.15.94:0/4151412356 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7c415f3d0 0x7fa7c406cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:52.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.289+0000 7fa7cb984640 1 --2- 172.21.15.94:0/4151412356 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c41596b0 0x7fa7c4163380 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:52.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.289+0000 7fa7cb984640 1 -- 172.21.15.94:0/4151412356 >> 172.21.15.94:0/4151412356 conn(0x7fa7c40ca540 msgr2=0x7fa7c40ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:52.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.289+0000 7fa7cb984640 1 -- 172.21.15.94:0/4151412356 shutdown_connections 2024-04-25T12:21:52.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.289+0000 7fa7cb984640 1 -- 172.21.15.94:0/4151412356 wait complete. 2024-04-25T12:21:52.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.289+0000 7fa7cb984640 1 Processor -- start 2024-04-25T12:21:52.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.289+0000 7fa7cb984640 1 -- start start 2024-04-25T12:21:52.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7cb984640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c40c8040 0x7fa7c41f6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:52.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7cb984640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7c41596b0 0x7fa7c41eaa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:52.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7cb984640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7c415f3d0 0x7fa7c4150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:52.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7cb984640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c4072270 con 0x7fa7c40c8040 2024-04-25T12:21:52.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7cb984640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c4160120 con 0x7fa7c415f3d0 2024-04-25T12:21:52.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7cb984640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa7c4072ea0 con 0x7fa7c41596b0 2024-04-25T12:21:52.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7c9720640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c40c8040 0x7fa7c41f6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:52.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7c9720640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c40c8040 0x7fa7c41f6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40990/0 (socket says 172.21.15.94:40990) 2024-04-25T12:21:52.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7c9720640 1 -- 172.21.15.94:0/3715440544 learned_addr learned my addr 172.21.15.94:0/3715440544 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:52.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7c8f1f640 1 --2- 172.21.15.94:0/3715440544 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7c41596b0 0x7fa7c41eaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:52.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7c9f21640 1 --2- 172.21.15.94:0/3715440544 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7c415f3d0 0x7fa7c4150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:52.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7c9720640 1 -- 172.21.15.94:0/3715440544 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7c41596b0 msgr2=0x7fa7c41eaa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:52.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7c9720640 1 --2- 172.21.15.94:0/3715440544 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7c41596b0 0x7fa7c41eaa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:52.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7c9720640 1 -- 172.21.15.94:0/3715440544 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7c415f3d0 msgr2=0x7fa7c4150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:52.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7c9720640 1 --2- 172.21.15.94:0/3715440544 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7c415f3d0 0x7fa7c4150430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:52.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7c9720640 1 -- 172.21.15.94:0/3715440544 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c406d600 con 0x7fa7c40c8040 2024-04-25T12:21:52.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7c9720640 1 --2- 172.21.15.94:0/3715440544 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c40c8040 0x7fa7c41f6070 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc0b2040 tx=0x7fa7bc01bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:52.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7b5ffb640 1 -- 172.21.15.94:0/3715440544 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc0b4040 con 0x7fa7c40c8040 2024-04-25T12:21:52.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7b5ffb640 1 -- 172.21.15.94:0/3715440544 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7bc0c1070 con 0x7fa7c40c8040 2024-04-25T12:21:52.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7cb984640 1 -- 172.21.15.94:0/3715440544 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7c4159220 con 0x7fa7c40c8040 2024-04-25T12:21:52.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7b5ffb640 1 -- 172.21.15.94:0/3715440544 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc009510 con 0x7fa7c40c8040 2024-04-25T12:21:52.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7cb984640 1 -- 172.21.15.94:0/3715440544 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7c4152f10 con 0x7fa7c40c8040 2024-04-25T12:21:52.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7cb984640 1 -- 172.21.15.94:0/3715440544 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7c4075df0 con 0x7fa7c40c8040 2024-04-25T12:21:52.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7b5ffb640 1 -- 172.21.15.94:0/3715440544 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa7bc0b7070 con 0x7fa7c40c8040 2024-04-25T12:21:52.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7b5ffb640 1 --2- 172.21.15.94:0/3715440544 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa7a8068380 0x7fa7a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:52.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7b5ffb640 1 -- 172.21.15.94:0/3715440544 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7fa7bc1249a0 con 0x7fa7c40c8040 2024-04-25T12:21:52.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7c8f1f640 1 --2- 172.21.15.94:0/3715440544 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa7a8068380 0x7fa7a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:52.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.293+0000 7fa7c8f1f640 1 --2- 172.21.15.94:0/3715440544 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa7a8068380 0x7fa7a806a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40c4250 tx=0x7fa7c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:52.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.297+0000 7fa7b5ffb640 1 -- 172.21.15.94:0/3715440544 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa7bc018d40 con 0x7fa7c40c8040 2024-04-25T12:21:52.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:52.457+0000 7fa7cb984640 1 -- 172.21.15.94:0/3715440544 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fa7c41625a0 con 0x7fa7c40c8040 2024-04-25T12:21:53.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.137+0000 7fa7b5ffb640 1 -- 172.21.15.94:0/3715440544 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) ==== 171+0+0 (secure 0 0 0) 0x7fa7bc0c4360 con 0x7fa7c40c8040 2024-04-25T12:21:53.145 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data' created 2024-04-25T12:21:53.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.141+0000 7fa7cb984640 1 -- 172.21.15.94:0/3715440544 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa7a8068380 msgr2=0x7fa7a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:53.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.141+0000 7fa7cb984640 1 --2- 172.21.15.94:0/3715440544 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa7a8068380 0x7fa7a806a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40c4250 tx=0x7fa7c0008040 comp rx=0 tx=0).stop 2024-04-25T12:21:53.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.141+0000 7fa7cb984640 1 -- 172.21.15.94:0/3715440544 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c40c8040 msgr2=0x7fa7c41f6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:53.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.141+0000 7fa7cb984640 1 --2- 172.21.15.94:0/3715440544 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c40c8040 0x7fa7c41f6070 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc0b2040 tx=0x7fa7bc01bf80 comp rx=0 tx=0).stop 2024-04-25T12:21:53.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.141+0000 7fa7cb984640 1 -- 172.21.15.94:0/3715440544 shutdown_connections 2024-04-25T12:21:53.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.141+0000 7fa7cb984640 1 --2- 172.21.15.94:0/3715440544 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa7a8068380 0x7fa7a806a840 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:53.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.141+0000 7fa7cb984640 1 --2- 172.21.15.94:0/3715440544 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7c41596b0 0x7fa7c41eaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:53.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.141+0000 7fa7cb984640 1 --2- 172.21.15.94:0/3715440544 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7c415f3d0 0x7fa7c4150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:53.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.141+0000 7fa7cb984640 1 --2- 172.21.15.94:0/3715440544 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c40c8040 0x7fa7c41f6070 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:53.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.141+0000 7fa7cb984640 1 -- 172.21.15.94:0/3715440544 >> 172.21.15.94:0/3715440544 conn(0x7fa7c40ca540 msgr2=0x7fa7c415dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:53.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.145+0000 7fa7cb984640 1 -- 172.21.15.94:0/3715440544 shutdown_connections 2024-04-25T12:21:53.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.145+0000 7fa7cb984640 1 -- 172.21.15.94:0/3715440544 wait complete. 2024-04-25T12:21:53.185 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T12:21:53.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.297+0000 7fc8ae6d0640 1 Processor -- start 2024-04-25T12:21:53.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.297+0000 7fc8ae6d0640 1 -- start start 2024-04-25T12:21:53.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.301+0000 7fc8ae6d0640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fc8a814fbc0 0x7fc8a806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:53.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.301+0000 7fc8ae6d0640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc8a814ffa0 0x7fc8a80c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:53.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.301+0000 7fc8ae6d0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc8a8074100 0x7fc8a80c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:53.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.301+0000 7fc8ae6d0640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc8a80c5d70 con 0x7fc8a8074100 2024-04-25T12:21:53.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.301+0000 7fc8ae6d0640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fc8a80c6050 con 0x7fc8a814fbc0 2024-04-25T12:21:53.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.301+0000 7fc8ae6d0640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fc8a80c6330 con 0x7fc8a814ffa0 2024-04-25T12:21:53.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.301+0000 7fc8acc6d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc8a8074100 0x7fc8a80c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:53.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.301+0000 7fc8acc6d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc8a8074100 0x7fc8a80c8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40992/0 (socket says 172.21.15.94:40992) 2024-04-25T12:21:53.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.301+0000 7fc8acc6d640 1 -- 172.21.15.94:0/2750904085 learned_addr learned my addr 172.21.15.94:0/2750904085 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:53.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.301+0000 7fc8a7fff640 1 --2- 172.21.15.94:0/2750904085 >> v2:172.21.15.111:3300/0 conn(0x7fc8a814fbc0 0x7fc8a806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:53.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.301+0000 7fc8a77fe640 1 --2- 172.21.15.94:0/2750904085 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc8a814ffa0 0x7fc8a80c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:53.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.301+0000 7fc8acc6d640 1 -- 172.21.15.94:0/2750904085 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc8a814ffa0 msgr2=0x7fc8a80c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:53.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.301+0000 7fc8acc6d640 1 --2- 172.21.15.94:0/2750904085 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc8a814ffa0 0x7fc8a80c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:53.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.301+0000 7fc8acc6d640 1 -- 172.21.15.94:0/2750904085 >> v2:172.21.15.111:3300/0 conn(0x7fc8a814fbc0 msgr2=0x7fc8a806f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:53.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.301+0000 7fc8acc6d640 1 --2- 172.21.15.94:0/2750904085 >> v2:172.21.15.111:3300/0 conn(0x7fc8a814fbc0 0x7fc8a806f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:53.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.301+0000 7fc8acc6d640 1 -- 172.21.15.94:0/2750904085 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a80c6610 con 0x7fc8a8074100 2024-04-25T12:21:53.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.301+0000 7fc8a7fff640 1 --2- 172.21.15.94:0/2750904085 >> v2:172.21.15.111:3300/0 conn(0x7fc8a814fbc0 0x7fc8a806f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:53.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.301+0000 7fc8acc6d640 1 --2- 172.21.15.94:0/2750904085 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8a8074100 0x7fc8a80c8760 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8050430 tx=0x7fc8a001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37bb704806a40947 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:53.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.301+0000 7fc8a6ffd640 1 -- 172.21.15.94:0/2750904085 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a00a5890 con 0x7fc8a8074100 2024-04-25T12:21:53.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.301+0000 7fc8a6ffd640 1 -- 172.21.15.94:0/2750904085 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a00a5a30 con 0x7fc8a8074100 2024-04-25T12:21:53.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.301+0000 7fc8a6ffd640 1 -- 172.21.15.94:0/2750904085 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a00a5e00 con 0x7fc8a8074100 2024-04-25T12:21:53.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8ae6d0640 1 -- 172.21.15.94:0/2750904085 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8a8074100 msgr2=0x7fc8a80c8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:53.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8ae6d0640 1 --2- 172.21.15.94:0/2750904085 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8a8074100 0x7fc8a80c8760 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8050430 tx=0x7fc8a001c9f0 comp rx=0 tx=0).stop 2024-04-25T12:21:53.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8ae6d0640 1 -- 172.21.15.94:0/2750904085 shutdown_connections 2024-04-25T12:21:53.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8ae6d0640 1 --2- 172.21.15.94:0/2750904085 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8a8074100 0x7fc8a80c8760 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:53.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8ae6d0640 1 --2- 172.21.15.94:0/2750904085 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc8a814ffa0 0x7fc8a80c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:53.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8ae6d0640 1 --2- 172.21.15.94:0/2750904085 >> v2:172.21.15.111:3300/0 conn(0x7fc8a814fbc0 0x7fc8a806f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:53.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8ae6d0640 1 -- 172.21.15.94:0/2750904085 >> 172.21.15.94:0/2750904085 conn(0x7fc8a806b9d0 msgr2=0x7fc8a806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:53.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8ae6d0640 1 -- 172.21.15.94:0/2750904085 shutdown_connections 2024-04-25T12:21:53.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8ae6d0640 1 -- 172.21.15.94:0/2750904085 wait complete. 2024-04-25T12:21:53.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8ae6d0640 1 Processor -- start 2024-04-25T12:21:53.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8ae6d0640 1 -- start start 2024-04-25T12:21:53.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8ae6d0640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8a8074100 0x7fc8a81f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:53.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8ae6d0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8a814fbc0 0x7fc8a815c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:53.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8ae6d0640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc8a814ffa0 0x7fc8a81f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:53.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8ae6d0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a81592e0 con 0x7fc8a814fbc0 2024-04-25T12:21:53.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8ae6d0640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a8159160 con 0x7fc8a8074100 2024-04-25T12:21:53.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8ae6d0640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fc8a8159460 con 0x7fc8a814ffa0 2024-04-25T12:21:53.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8a77fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8a814fbc0 0x7fc8a815c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:53.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8a77fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8a814fbc0 0x7fc8a815c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41002/0 (socket says 172.21.15.94:41002) 2024-04-25T12:21:53.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8a77fe640 1 -- 172.21.15.94:0/4060594217 learned_addr learned my addr 172.21.15.94:0/4060594217 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:53.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8a7fff640 1 --2- 172.21.15.94:0/4060594217 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8a8074100 0x7fc8a81f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:53.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8acc6d640 1 --2- 172.21.15.94:0/4060594217 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc8a814ffa0 0x7fc8a81f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:53.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8a77fe640 1 -- 172.21.15.94:0/4060594217 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc8a814ffa0 msgr2=0x7fc8a81f4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:53.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8a77fe640 1 --2- 172.21.15.94:0/4060594217 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc8a814ffa0 0x7fc8a81f4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:53.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8a77fe640 1 -- 172.21.15.94:0/4060594217 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8a8074100 msgr2=0x7fc8a81f21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:53.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8a77fe640 1 --2- 172.21.15.94:0/4060594217 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8a8074100 0x7fc8a81f21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:53.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8a77fe640 1 -- 172.21.15.94:0/4060594217 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a81485b0 con 0x7fc8a814fbc0 2024-04-25T12:21:53.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8a77fe640 1 --2- 172.21.15.94:0/4060594217 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8a814fbc0 0x7fc8a815c6f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc89800c820 tx=0x7fc89800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:53.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8a4ff9640 1 -- 172.21.15.94:0/4060594217 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc898015070 con 0x7fc8a814fbc0 2024-04-25T12:21:53.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8a4ff9640 1 -- 172.21.15.94:0/4060594217 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc898007a30 con 0x7fc8a814fbc0 2024-04-25T12:21:53.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8a4ff9640 1 -- 172.21.15.94:0/4060594217 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc898007e20 con 0x7fc8a814fbc0 2024-04-25T12:21:53.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8ae6d0640 1 -- 172.21.15.94:0/4060594217 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8a8148820 con 0x7fc8a814fbc0 2024-04-25T12:21:53.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.305+0000 7fc8ae6d0640 1 -- 172.21.15.94:0/4060594217 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8a8148de0 con 0x7fc8a814fbc0 2024-04-25T12:21:53.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.309+0000 7fc8ae6d0640 1 -- 172.21.15.94:0/4060594217 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8a8075df0 con 0x7fc8a814fbc0 2024-04-25T12:21:53.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.309+0000 7fc8a4ff9640 1 -- 172.21.15.94:0/4060594217 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc898018070 con 0x7fc8a814fbc0 2024-04-25T12:21:53.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.309+0000 7fc8a4ff9640 1 --2- 172.21.15.94:0/4060594217 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc8940683b0 0x7fc89406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:53.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.309+0000 7fc8a4ff9640 1 -- 172.21.15.94:0/4060594217 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7fc898086a60 con 0x7fc8a814fbc0 2024-04-25T12:21:53.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.309+0000 7fc8a7fff640 1 --2- 172.21.15.94:0/4060594217 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc8940683b0 0x7fc89406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:53.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.309+0000 7fc8a7fff640 1 --2- 172.21.15.94:0/4060594217 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc8940683b0 0x7fc89406a870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc89c006b20 tx=0x7fc89c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:53.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.313+0000 7fc8a4ff9640 1 -- 172.21.15.94:0/4060594217 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc8980571f0 con 0x7fc8a814fbc0 2024-04-25T12:21:53.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:53.509+0000 7fc8ae6d0640 1 -- 172.21.15.94:0/4060594217 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc8a8158d30 con 0x7fc8a814fbc0 2024-04-25T12:21:54.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.189+0000 7fc8a4ff9640 1 -- 172.21.15.94:0/4060594217 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fc898086070 con 0x7fc8a814fbc0 2024-04-25T12:21:54.196 INFO:teuthology.orchestra.run.smithi094.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T12:21:54.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.197+0000 7fc8ae6d0640 1 -- 172.21.15.94:0/4060594217 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc8940683b0 msgr2=0x7fc89406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:54.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.197+0000 7fc8ae6d0640 1 --2- 172.21.15.94:0/4060594217 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc8940683b0 0x7fc89406a870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc89c006b20 tx=0x7fc89c008040 comp rx=0 tx=0).stop 2024-04-25T12:21:54.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.197+0000 7fc8ae6d0640 1 -- 172.21.15.94:0/4060594217 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8a814fbc0 msgr2=0x7fc8a815c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:54.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.197+0000 7fc8ae6d0640 1 --2- 172.21.15.94:0/4060594217 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8a814fbc0 0x7fc8a815c6f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc89800c820 tx=0x7fc89800cce0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.197+0000 7fc8ae6d0640 1 -- 172.21.15.94:0/4060594217 shutdown_connections 2024-04-25T12:21:54.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.197+0000 7fc8ae6d0640 1 --2- 172.21.15.94:0/4060594217 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc8940683b0 0x7fc89406a870 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.197+0000 7fc8ae6d0640 1 --2- 172.21.15.94:0/4060594217 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc8a814ffa0 0x7fc8a81f4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.197+0000 7fc8ae6d0640 1 --2- 172.21.15.94:0/4060594217 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8a814fbc0 0x7fc8a815c6f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.197+0000 7fc8ae6d0640 1 --2- 172.21.15.94:0/4060594217 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8a8074100 0x7fc8a81f21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.197+0000 7fc8ae6d0640 1 -- 172.21.15.94:0/4060594217 >> 172.21.15.94:0/4060594217 conn(0x7fc8a806b9d0 msgr2=0x7fc8a814e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:54.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.201+0000 7fc8ae6d0640 1 -- 172.21.15.94:0/4060594217 shutdown_connections 2024-04-25T12:21:54.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.201+0000 7fc8ae6d0640 1 -- 172.21.15.94:0/4060594217 wait complete. 2024-04-25T12:21:54.228 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-25T12:21:54.228 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-25T12:21:54.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc894c640 1 Processor -- start 2024-04-25T12:21:54.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc894c640 1 -- start start 2024-04-25T12:21:54.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc894c640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f7dc41521f0 0x7f7dc40c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:54.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc894c640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7dc40c4f50 0x7f7dc40c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:54.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc894c640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dc415ba00 con 0x7f7dc41525d0 2024-04-25T12:21:54.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc894c640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f7dc415bce0 con 0x7f7dc41521f0 2024-04-25T12:21:54.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc894c640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f7dc415bfc0 con 0x7f7dc40c4f50 2024-04-25T12:21:54.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc1d9b640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f7dc41525d0 0x7f7dc4158760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41754/0 (socket says 172.21.15.94:41754) 2024-04-25T12:21:54.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc1d9b640 1 -- 172.21.15.94:0/3183433906 learned_addr learned my addr 172.21.15.94:0/3183433906 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:21:54.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc2d9d640 1 --2- 172.21.15.94:0/3183433906 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7dc40c4f50 0x7f7dc40c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:54.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc259c640 1 --2- 172.21.15.94:0/3183433906 >> v2:172.21.15.111:3300/0 conn(0x7f7dc41521f0 0x7f7dc40c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:54.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc159a640 1 -- 172.21.15.94:0/3183433906 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3693757247 0 0) 0x7f7dc415ba00 con 0x7f7dc41525d0 2024-04-25T12:21:54.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc159a640 1 -- 172.21.15.94:0/3183433906 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7dac003530 con 0x7f7dc41525d0 2024-04-25T12:21:54.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc159a640 1 -- 172.21.15.94:0/3183433906 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3062676355 0 0) 0x7f7dac003530 con 0x7f7dc41525d0 2024-04-25T12:21:54.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc159a640 1 -- 172.21.15.94:0/3183433906 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7dc40c4f50 msgr2=0x7f7dc40c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:54.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc159a640 1 --2- 172.21.15.94:0/3183433906 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7dc40c4f50 0x7f7dc40c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc159a640 1 -- 172.21.15.94:0/3183433906 >> v2:172.21.15.111:3300/0 conn(0x7f7dc41521f0 msgr2=0x7f7dc40c3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:54.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc159a640 1 --2- 172.21.15.94:0/3183433906 >> v2:172.21.15.111:3300/0 conn(0x7f7dc41521f0 0x7f7dc40c3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc159a640 1 -- 172.21.15.94:0/3183433906 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc415c2a0 con 0x7f7dc41525d0 2024-04-25T12:21:54.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc159a640 1 -- 172.21.15.94:0/3183433906 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7f7db4001680 con 0x7f7dc41525d0 2024-04-25T12:21:54.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc159a640 1 -- 172.21.15.94:0/3183433906 >> v1:172.21.15.94:6789/0 conn(0x7f7dc41525d0 legacy=0x7f7dc4158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:54.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc159a640 1 --2- 172.21.15.94:0/3183433906 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7dc40c4f50 0x7f7dac0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:54.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc159a640 1 --2- 172.21.15.94:0/3183433906 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7dac003f40 0x7f7dac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:54.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc159a640 1 --2- 172.21.15.94:0/3183433906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7dac004d50 0x7f7dac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:54.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc159a640 1 -- 172.21.15.94:0/3183433906 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc415bce0 con 0x7f7dac004d50 2024-04-25T12:21:54.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc159a640 1 -- 172.21.15.94:0/3183433906 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc415bfc0 con 0x7f7dac003f40 2024-04-25T12:21:54.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc159a640 1 -- 172.21.15.94:0/3183433906 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f7dac00b9d0 con 0x7f7dc40c4f50 2024-04-25T12:21:54.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc2d9d640 1 --2- 172.21.15.94:0/3183433906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7dac004d50 0x7f7dac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:54.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc259c640 1 --2- 172.21.15.94:0/3183433906 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7dc40c4f50 0x7f7dac0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:54.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc1d9b640 1 --2- 172.21.15.94:0/3183433906 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7dac003f40 0x7f7dac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:54.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc2d9d640 1 -- 172.21.15.94:0/3183433906 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7dc40c4f50 msgr2=0x7f7dac0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:54.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc2d9d640 1 --2- 172.21.15.94:0/3183433906 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7dc40c4f50 0x7f7dac0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc2d9d640 1 -- 172.21.15.94:0/3183433906 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7dac003f40 msgr2=0x7f7dac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:54.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc2d9d640 1 --2- 172.21.15.94:0/3183433906 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7dac003f40 0x7f7dac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc2d9d640 1 -- 172.21.15.94:0/3183433906 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dac003530 con 0x7f7dac004d50 2024-04-25T12:21:54.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc1d9b640 1 --2- 172.21.15.94:0/3183433906 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7dac003f40 0x7f7dac004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:54.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc2d9d640 1 --2- 172.21.15.94:0/3183433906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7dac004d50 0x7f7dac0051d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7db80093e0 tx=0x7f7db801ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a3257255563498 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:54.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc159a640 1 -- 172.21.15.94:0/3183433906 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db80b4070 con 0x7f7dac004d50 2024-04-25T12:21:54.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc159a640 1 -- 172.21.15.94:0/3183433906 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db80a7880 con 0x7f7dac004d50 2024-04-25T12:21:54.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc159a640 1 -- 172.21.15.94:0/3183433906 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db8009690 con 0x7f7dac004d50 2024-04-25T12:21:54.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc894c640 1 -- 172.21.15.94:0/3183433906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7dac004d50 msgr2=0x7f7dac0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:54.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc894c640 1 --2- 172.21.15.94:0/3183433906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7dac004d50 0x7f7dac0051d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7db80093e0 tx=0x7f7db801ec20 comp rx=0 tx=0).stop 2024-04-25T12:21:54.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc2d9d640 1 -- 172.21.15.94:0/3183433906 reap_dead start 2024-04-25T12:21:54.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc894c640 1 -- 172.21.15.94:0/3183433906 shutdown_connections 2024-04-25T12:21:54.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc894c640 1 -- 172.21.15.94:0/3183433906 >> 172.21.15.94:0/3183433906 conn(0x7f7dc40c9130 msgr2=0x7f7dc40c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:54.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc894c640 1 -- 172.21.15.94:0/3183433906 shutdown_connections 2024-04-25T12:21:54.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.345+0000 7f7dc894c640 1 -- 172.21.15.94:0/3183433906 wait complete. 2024-04-25T12:21:54.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.349+0000 7f7dc894c640 1 Processor -- start 2024-04-25T12:21:54.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.349+0000 7f7dc894c640 1 -- start start 2024-04-25T12:21:54.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.349+0000 7f7dc894c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7dc40cb810 0x7f7dc41f46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:54.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.349+0000 7f7dc894c640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7dc41591b0 0x7f7dc41f1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:54.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.349+0000 7f7dc894c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7dc40cbbf0 0x7f7dc414ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:54.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.349+0000 7f7dc894c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc4158ff0 con 0x7f7dc40cb810 2024-04-25T12:21:54.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.349+0000 7f7dc894c640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc4158e70 con 0x7f7dc40cbbf0 2024-04-25T12:21:54.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.349+0000 7f7dc894c640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f7dc40c4070 con 0x7f7dc41591b0 2024-04-25T12:21:54.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.349+0000 7f7dc259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7dc40cb810 0x7f7dc41f46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:54.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.349+0000 7f7dc259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7dc40cb810 0x7f7dc41f46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41020/0 (socket says 172.21.15.94:41020) 2024-04-25T12:21:54.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.349+0000 7f7dc259c640 1 -- 172.21.15.94:0/3594178753 learned_addr learned my addr 172.21.15.94:0/3594178753 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:54.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.349+0000 7f7dc2d9d640 1 --2- 172.21.15.94:0/3594178753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7dc40cbbf0 0x7f7dc414ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:54.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.349+0000 7f7dc259c640 1 -- 172.21.15.94:0/3594178753 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7dc41591b0 msgr2=0x7f7dc41f1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:54.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.349+0000 7f7dc1d9b640 1 --2- 172.21.15.94:0/3594178753 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7dc41591b0 0x7f7dc41f1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:54.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.349+0000 7f7dc259c640 1 --2- 172.21.15.94:0/3594178753 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7dc41591b0 0x7f7dc41f1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.349+0000 7f7dc259c640 1 -- 172.21.15.94:0/3594178753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7dc40cbbf0 msgr2=0x7f7dc414ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:54.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.349+0000 7f7dc259c640 1 --2- 172.21.15.94:0/3594178753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7dc40cbbf0 0x7f7dc414ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:54.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.349+0000 7f7dc259c640 1 -- 172.21.15.94:0/3594178753 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc41f16c0 con 0x7f7dc40cb810 2024-04-25T12:21:54.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.349+0000 7f7dc2d9d640 1 --2- 172.21.15.94:0/3594178753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7dc40cbbf0 0x7f7dc414ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:54.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.349+0000 7f7dc259c640 1 --2- 172.21.15.94:0/3594178753 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7dc40cb810 0x7f7dc41f46f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc007f30 tx=0x7f7dbc011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:54.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.349+0000 7f7db2ffd640 1 -- 172.21.15.94:0/3594178753 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc01a020 con 0x7f7dc40cb810 2024-04-25T12:21:54.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.349+0000 7f7db2ffd640 1 -- 172.21.15.94:0/3594178753 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dbc016470 con 0x7f7dc40cb810 2024-04-25T12:21:54.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.349+0000 7f7dc894c640 1 -- 172.21.15.94:0/3594178753 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dc414e7f0 con 0x7f7dc40cb810 2024-04-25T12:21:54.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.349+0000 7f7db2ffd640 1 -- 172.21.15.94:0/3594178753 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc016860 con 0x7f7dc40cb810 2024-04-25T12:21:54.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.349+0000 7f7dc894c640 1 -- 172.21.15.94:0/3594178753 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dc41f0980 con 0x7f7dc40cb810 2024-04-25T12:21:54.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.349+0000 7f7dc894c640 1 -- 172.21.15.94:0/3594178753 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dc41f0770 con 0x7f7dc40cb810 2024-04-25T12:21:54.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.353+0000 7f7db2ffd640 1 -- 172.21.15.94:0/3594178753 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7dbc01d020 con 0x7f7dc40cb810 2024-04-25T12:21:54.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.353+0000 7f7db2ffd640 1 --2- 172.21.15.94:0/3594178753 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7da4068380 0x7f7da406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:54.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.353+0000 7f7db2ffd640 1 -- 172.21.15.94:0/3594178753 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7dbc087a40 con 0x7f7dc40cb810 2024-04-25T12:21:54.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.353+0000 7f7dc1d9b640 1 --2- 172.21.15.94:0/3594178753 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7da4068380 0x7f7da406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:54.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.353+0000 7f7dc1d9b640 1 --2- 172.21.15.94:0/3594178753 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7da4068380 0x7f7da406a840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7db40017f0 tx=0x7f7db4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:54.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.357+0000 7f7db2ffd640 1 -- 172.21.15.94:0/3594178753 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7dbc024030 con 0x7f7dc40cb810 2024-04-25T12:21:54.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:54.525+0000 7f7dc894c640 1 -- 172.21.15.94:0/3594178753 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f7dc4075e60 con 0x7f7dc40cb810 2024-04-25T12:21:55.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.161+0000 7f7db2ffd640 1 -- 172.21.15.94:0/3594178753 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) ==== 157+0+0 (secure 0 0 0) 0x7f7dbc057f70 con 0x7f7dc40cb810 2024-04-25T12:21:55.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.165+0000 7f7dc894c640 1 -- 172.21.15.94:0/3594178753 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7da4068380 msgr2=0x7f7da406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:55.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.165+0000 7f7dc894c640 1 --2- 172.21.15.94:0/3594178753 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7da4068380 0x7f7da406a840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7db40017f0 tx=0x7f7db4009040 comp rx=0 tx=0).stop 2024-04-25T12:21:55.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.165+0000 7f7dc894c640 1 -- 172.21.15.94:0/3594178753 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7dc40cb810 msgr2=0x7f7dc41f46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:55.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.165+0000 7f7dc894c640 1 --2- 172.21.15.94:0/3594178753 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7dc40cb810 0x7f7dc41f46f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc007f30 tx=0x7f7dbc011660 comp rx=0 tx=0).stop 2024-04-25T12:21:55.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.165+0000 7f7dc894c640 1 -- 172.21.15.94:0/3594178753 shutdown_connections 2024-04-25T12:21:55.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.165+0000 7f7dc894c640 1 --2- 172.21.15.94:0/3594178753 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7da4068380 0x7f7da406a840 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.165+0000 7f7dc894c640 1 --2- 172.21.15.94:0/3594178753 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7dc41591b0 0x7f7dc41f1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.165+0000 7f7dc894c640 1 --2- 172.21.15.94:0/3594178753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7dc40cbbf0 0x7f7dc414ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.165+0000 7f7dc894c640 1 --2- 172.21.15.94:0/3594178753 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7dc40cb810 0x7f7dc41f46f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.165+0000 7f7dc894c640 1 -- 172.21.15.94:0/3594178753 >> 172.21.15.94:0/3594178753 conn(0x7f7dc40c9130 msgr2=0x7f7dc406e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:55.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.165+0000 7f7dc894c640 1 -- 172.21.15.94:0/3594178753 shutdown_connections 2024-04-25T12:21:55.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.165+0000 7f7dc894c640 1 -- 172.21.15.94:0/3594178753 wait complete. 2024-04-25T12:21:55.187 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T12:21:55.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.313+0000 7f1671a5d640 1 Processor -- start 2024-04-25T12:21:55.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.313+0000 7f1671a5d640 1 -- start start 2024-04-25T12:21:55.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.313+0000 7f1671a5d640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f166c073360 0x7f166c0c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.313+0000 7f1671a5d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f166c073740 0x7f166c15b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.313+0000 7f1671a5d640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f166c0cc9d0 con 0x7f166c0cd490 2024-04-25T12:21:55.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.313+0000 7f1671a5d640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f166c073e30 con 0x7f166c073740 2024-04-25T12:21:55.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.313+0000 7f1671a5d640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f166c15ba20 con 0x7f166c073360 2024-04-25T12:21:55.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.313+0000 7f166b7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f166c0cd490 0x7f166c154fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41760/0 (socket says 172.21.15.94:41760) 2024-04-25T12:21:55.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.313+0000 7f166b7fe640 1 -- 172.21.15.94:0/1968406437 learned_addr learned my addr 172.21.15.94:0/1968406437 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:21:55.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.313+0000 7f1663fff640 1 --2- 172.21.15.94:0/1968406437 >> v2:172.21.15.94:3300/0 conn(0x7f166c073740 0x7f166c15b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:55.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.317+0000 7f166a7fc640 1 -- 172.21.15.94:0/1968406437 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 353096012 0 0) 0x7f166c0cc9d0 con 0x7f166c0cd490 2024-04-25T12:21:55.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.317+0000 7f166affd640 1 --2- 172.21.15.94:0/1968406437 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f166c073360 0x7f166c0c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:55.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.317+0000 7f166a7fc640 1 -- 172.21.15.94:0/1968406437 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1658003530 con 0x7f166c0cd490 2024-04-25T12:21:55.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.317+0000 7f166a7fc640 1 -- 172.21.15.94:0/1968406437 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2076602329 0 0) 0x7f1658003530 con 0x7f166c0cd490 2024-04-25T12:21:55.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.317+0000 7f1663fff640 1 -- 172.21.15.94:0/1968406437 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f166c073360 msgr2=0x7f166c0c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:55.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.317+0000 7f1663fff640 1 --2- 172.21.15.94:0/1968406437 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f166c073360 0x7f166c0c58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.317+0000 7f1663fff640 1 -- 172.21.15.94:0/1968406437 >> v1:172.21.15.94:6789/0 conn(0x7f166c0cd490 legacy=0x7f166c154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:55.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.317+0000 7f1663fff640 1 -- 172.21.15.94:0/1968406437 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166c15bd00 con 0x7f166c073740 2024-04-25T12:21:55.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.317+0000 7f1663fff640 1 --2- 172.21.15.94:0/1968406437 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f166c073740 0x7f166c15b120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f16540097c0 tx=0x7f165401ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e863f6a1d41dafb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:55.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.317+0000 7f166a7fc640 1 -- 172.21.15.94:0/1968406437 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16540b5070 con 0x7f166c073740 2024-04-25T12:21:55.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.317+0000 7f166a7fc640 1 -- 172.21.15.94:0/1968406437 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16540a85f0 con 0x7f166c073740 2024-04-25T12:21:55.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.317+0000 7f166a7fc640 1 -- 172.21.15.94:0/1968406437 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1664001a00 con 0x7f166c073740 2024-04-25T12:21:55.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.317+0000 7f1671a5d640 1 -- 172.21.15.94:0/1968406437 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f166c073740 msgr2=0x7f166c15b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:55.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.317+0000 7f1671a5d640 1 --2- 172.21.15.94:0/1968406437 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f166c073740 0x7f166c15b120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f16540097c0 tx=0x7f165401ebb0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.317+0000 7f1671a5d640 1 -- 172.21.15.94:0/1968406437 shutdown_connections 2024-04-25T12:21:55.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.317+0000 7f1671a5d640 1 --2- 172.21.15.94:0/1968406437 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f166c073740 0x7f166c15b120 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.317+0000 7f1671a5d640 1 --2- 172.21.15.94:0/1968406437 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f166c073360 0x7f166c0c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.317+0000 7f1671a5d640 1 -- 172.21.15.94:0/1968406437 >> 172.21.15.94:0/1968406437 conn(0x7f166c06cc30 msgr2=0x7f166c06d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:55.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.317+0000 7f1671a5d640 1 -- 172.21.15.94:0/1968406437 shutdown_connections 2024-04-25T12:21:55.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.317+0000 7f1671a5d640 1 -- 172.21.15.94:0/1968406437 wait complete. 2024-04-25T12:21:55.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.321+0000 7f1671a5d640 1 Processor -- start 2024-04-25T12:21:55.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.321+0000 7f1671a5d640 1 -- start start 2024-04-25T12:21:55.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.321+0000 7f1671a5d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f166c073360 0x7f166c1475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.321+0000 7f1671a5d640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f166c073740 0x7f166c14a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.321+0000 7f1671a5d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f166c0cd490 0x7f166c14aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.321+0000 7f1671a5d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f166c0ccf70 con 0x7f166c073360 2024-04-25T12:21:55.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.321+0000 7f1671a5d640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f166c0ccc90 con 0x7f166c0cd490 2024-04-25T12:21:55.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.321+0000 7f1671a5d640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f166c15b660 con 0x7f166c073740 2024-04-25T12:21:55.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.321+0000 7f166affd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f166c073360 0x7f166c1475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:55.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.321+0000 7f166affd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f166c073360 0x7f166c1475e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41050/0 (socket says 172.21.15.94:41050) 2024-04-25T12:21:55.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.321+0000 7f166affd640 1 -- 172.21.15.94:0/1516300717 learned_addr learned my addr 172.21.15.94:0/1516300717 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:55.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.321+0000 7f166affd640 1 -- 172.21.15.94:0/1516300717 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f166c073740 msgr2=0x7f166c14a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:55.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.321+0000 7f1663fff640 1 --2- 172.21.15.94:0/1516300717 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f166c073740 0x7f166c14a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:55.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.321+0000 7f166b7fe640 1 --2- 172.21.15.94:0/1516300717 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f166c0cd490 0x7f166c14aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:55.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.321+0000 7f166affd640 1 --2- 172.21.15.94:0/1516300717 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f166c073740 0x7f166c14a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.321+0000 7f166affd640 1 -- 172.21.15.94:0/1516300717 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f166c0cd490 msgr2=0x7f166c14aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:55.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.321+0000 7f166affd640 1 --2- 172.21.15.94:0/1516300717 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f166c0cd490 0x7f166c14aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:55.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.321+0000 7f166affd640 1 -- 172.21.15.94:0/1516300717 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166c0cece0 con 0x7f166c073360 2024-04-25T12:21:55.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.321+0000 7f166affd640 1 --2- 172.21.15.94:0/1516300717 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f166c073360 0x7f166c1475e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f165c00e9b0 tx=0x7f165c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:55.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.321+0000 7f1668ff9640 1 -- 172.21.15.94:0/1516300717 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c017070 con 0x7f166c073360 2024-04-25T12:21:55.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.321+0000 7f1668ff9640 1 -- 172.21.15.94:0/1516300717 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f165c00c9a0 con 0x7f166c073360 2024-04-25T12:21:55.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.321+0000 7f1671a5d640 1 -- 172.21.15.94:0/1516300717 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f166c0d0b10 con 0x7f166c073360 2024-04-25T12:21:55.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.321+0000 7f1668ff9640 1 -- 172.21.15.94:0/1516300717 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c00cd70 con 0x7f166c073360 2024-04-25T12:21:55.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.321+0000 7f1671a5d640 1 -- 172.21.15.94:0/1516300717 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f166c0cef80 con 0x7f166c073360 2024-04-25T12:21:55.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.325+0000 7f1671a5d640 1 -- 172.21.15.94:0/1516300717 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f166c0cf1c0 con 0x7f166c073360 2024-04-25T12:21:55.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.325+0000 7f1668ff9640 1 -- 172.21.15.94:0/1516300717 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f165c01a070 con 0x7f166c073360 2024-04-25T12:21:55.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.325+0000 7f1668ff9640 1 --2- 172.21.15.94:0/1516300717 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f164c068380 0x7f164c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:55.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.325+0000 7f1668ff9640 1 -- 172.21.15.94:0/1516300717 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6007+0+0 (secure 0 0 0) 0x7f165c086b20 con 0x7f166c073360 2024-04-25T12:21:55.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.325+0000 7f1663fff640 1 --2- 172.21.15.94:0/1516300717 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f164c068380 0x7f164c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:55.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.325+0000 7f1663fff640 1 --2- 172.21.15.94:0/1516300717 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f164c068380 0x7f164c06a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f16540b2000 tx=0x7f1654008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:55.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.329+0000 7f1668ff9640 1 -- 172.21.15.94:0/1516300717 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f166c0cf1c0 con 0x7f166c073360 2024-04-25T12:21:55.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:55.485+0000 7f1671a5d640 1 -- 172.21.15.94:0/1516300717 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f166c075df0 con 0x7f166c073360 2024-04-25T12:21:57.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.209+0000 7f1668ff9640 1 -- 172.21.15.94:0/1516300717 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) ==== 228+0+0 (secure 0 0 0) 0x7f165c057040 con 0x7f166c073360 2024-04-25T12:21:57.212 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data_ec' created 2024-04-25T12:21:57.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.213+0000 7f1671a5d640 1 -- 172.21.15.94:0/1516300717 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f164c068380 msgr2=0x7f164c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.213+0000 7f1671a5d640 1 --2- 172.21.15.94:0/1516300717 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f164c068380 0x7f164c06a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f16540b2000 tx=0x7f1654008040 comp rx=0 tx=0).stop 2024-04-25T12:21:57.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.213+0000 7f1671a5d640 1 -- 172.21.15.94:0/1516300717 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f166c073360 msgr2=0x7f166c1475e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.213+0000 7f1671a5d640 1 --2- 172.21.15.94:0/1516300717 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f166c073360 0x7f166c1475e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f165c00e9b0 tx=0x7f165c00ee70 comp rx=0 tx=0).stop 2024-04-25T12:21:57.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.213+0000 7f1671a5d640 1 -- 172.21.15.94:0/1516300717 shutdown_connections 2024-04-25T12:21:57.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.213+0000 7f1671a5d640 1 --2- 172.21.15.94:0/1516300717 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f164c068380 0x7f164c06a840 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.213+0000 7f1671a5d640 1 --2- 172.21.15.94:0/1516300717 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f166c073740 0x7f166c14a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.213+0000 7f1671a5d640 1 --2- 172.21.15.94:0/1516300717 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f166c0cd490 0x7f166c14aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.213+0000 7f1671a5d640 1 --2- 172.21.15.94:0/1516300717 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f166c073360 0x7f166c1475e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.213+0000 7f1671a5d640 1 -- 172.21.15.94:0/1516300717 >> 172.21.15.94:0/1516300717 conn(0x7f166c06cc30 msgr2=0x7f166c0cd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:57.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.213+0000 7f1671a5d640 1 -- 172.21.15.94:0/1516300717 shutdown_connections 2024-04-25T12:21:57.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.213+0000 7f1671a5d640 1 -- 172.21.15.94:0/1516300717 wait complete. 2024-04-25T12:21:57.244 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-25T12:21:57.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.361+0000 7ff06e455640 1 Processor -- start 2024-04-25T12:21:57.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.361+0000 7ff06e455640 1 -- start start 2024-04-25T12:21:57.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff06e455640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff0680c7900 0x7ff068166990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff06e455640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0680c8230 con 0x7ff068151f30 2024-04-25T12:21:57.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff06e455640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff06815ed60 con 0x7ff068074270 2024-04-25T12:21:57.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff06e455640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff0680c87d0 con 0x7ff0680c7900 2024-04-25T12:21:57.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff067fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7ff068151f30 0x7ff06815e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41764/0 (socket says 172.21.15.94:41764) 2024-04-25T12:21:57.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff067fff640 1 -- 172.21.15.94:0/1361715118 learned_addr learned my addr 172.21.15.94:0/1361715118 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:21:57.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff0677fe640 1 -- 172.21.15.94:0/1361715118 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3203463745 0 0) 0x7ff0680c8230 con 0x7ff068151f30 2024-04-25T12:21:57.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff0677fe640 1 -- 172.21.15.94:0/1361715118 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff054003530 con 0x7ff068151f30 2024-04-25T12:21:57.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff06c9f2640 1 --2- 172.21.15.94:0/1361715118 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff0680c7900 0x7ff068166990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff0677fe640 1 -- 172.21.15.94:0/1361715118 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1892069636 0 0) 0x7ff054003530 con 0x7ff068151f30 2024-04-25T12:21:57.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff0677fe640 1 -- 172.21.15.94:0/1361715118 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff0680c7900 msgr2=0x7ff068166990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:57.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff0677fe640 1 --2- 172.21.15.94:0/1361715118 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff0680c7900 0x7ff068166990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff0677fe640 1 -- 172.21.15.94:0/1361715118 >> v1:172.21.15.111:6789/0 conn(0x7ff068074270 legacy=0x7ff0680c8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff0677fe640 1 -- 172.21.15.94:0/1361715118 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff068152310 con 0x7ff068151f30 2024-04-25T12:21:57.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff0677fe640 1 -- 172.21.15.94:0/1361715118 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7ff058001680 con 0x7ff068151f30 2024-04-25T12:21:57.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff0677fe640 1 -- 172.21.15.94:0/1361715118 >> v1:172.21.15.94:6789/0 conn(0x7ff068151f30 legacy=0x7ff06815e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff0677fe640 1 --2- 172.21.15.94:0/1361715118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0540039f0 0x7ff054003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff0677fe640 1 --2- 172.21.15.94:0/1361715118 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff0680c7900 0x7ff054004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff0677fe640 1 --2- 172.21.15.94:0/1361715118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff054004d50 0x7ff0540051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff0677fe640 1 -- 172.21.15.94:0/1361715118 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff0680c87d0 con 0x7ff0540039f0 2024-04-25T12:21:57.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff0677fe640 1 -- 172.21.15.94:0/1361715118 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff05400bab0 con 0x7ff054004d50 2024-04-25T12:21:57.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff0677fe640 1 -- 172.21.15.94:0/1361715118 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff05400bcb0 con 0x7ff0680c7900 2024-04-25T12:21:57.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff067fff640 1 --2- 172.21.15.94:0/1361715118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0540039f0 0x7ff054003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff067fff640 1 -- 172.21.15.94:0/1361715118 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff0680c7900 msgr2=0x7ff054004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:57.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff05ffff640 1 --2- 172.21.15.94:0/1361715118 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff0680c7900 0x7ff054004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff06c9f2640 1 --2- 172.21.15.94:0/1361715118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff054004d50 0x7ff0540051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff067fff640 1 --2- 172.21.15.94:0/1361715118 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff0680c7900 0x7ff054004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff067fff640 1 -- 172.21.15.94:0/1361715118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff054004d50 msgr2=0x7ff0540051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:57.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff067fff640 1 --2- 172.21.15.94:0/1361715118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff054004d50 0x7ff0540051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff067fff640 1 -- 172.21.15.94:0/1361715118 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff054003530 con 0x7ff0540039f0 2024-04-25T12:21:57.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.365+0000 7ff05ffff640 1 --2- 172.21.15.94:0/1361715118 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff0680c7900 0x7ff054004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:57.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff067fff640 1 --2- 172.21.15.94:0/1361715118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0540039f0 0x7ff054003e10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff058001ec0 tx=0x7ff05801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f1d528e1fbf20a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff0677fe640 1 -- 172.21.15.94:0/1361715118 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058007d40 con 0x7ff0540039f0 2024-04-25T12:21:57.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff0677fe640 1 -- 172.21.15.94:0/1361715118 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0580a9070 con 0x7ff0540039f0 2024-04-25T12:21:57.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff0677fe640 1 -- 172.21.15.94:0/1361715118 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058005d40 con 0x7ff0540039f0 2024-04-25T12:21:57.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff06e455640 1 -- 172.21.15.94:0/1361715118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0540039f0 msgr2=0x7ff054003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff06e455640 1 --2- 172.21.15.94:0/1361715118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0540039f0 0x7ff054003e10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff058001ec0 tx=0x7ff05801cc60 comp rx=0 tx=0).stop 2024-04-25T12:21:57.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff06c9f2640 1 -- 172.21.15.94:0/1361715118 reap_dead start 2024-04-25T12:21:57.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff06e455640 1 -- 172.21.15.94:0/1361715118 shutdown_connections 2024-04-25T12:21:57.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff06e455640 1 -- 172.21.15.94:0/1361715118 >> 172.21.15.94:0/1361715118 conn(0x7ff0680ccf00 msgr2=0x7ff0680cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:57.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff06e455640 1 -- 172.21.15.94:0/1361715118 shutdown_connections 2024-04-25T12:21:57.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff06e455640 1 -- 172.21.15.94:0/1361715118 wait complete. 2024-04-25T12:21:57.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff06e455640 1 Processor -- start 2024-04-25T12:21:57.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff06e455640 1 -- start start 2024-04-25T12:21:57.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff06e455640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff0540039f0 0x7ff068073d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff06e455640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff068073530 0x7ff06814cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff06e455640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0681f3a50 0x7ff0681f3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff06e455640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff0680c3420 con 0x7ff0681f3a50 2024-04-25T12:21:57.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff06e455640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff0680c2f00 con 0x7ff068073530 2024-04-25T12:21:57.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff06e455640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff068073970 con 0x7ff0540039f0 2024-04-25T12:21:57.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff06c9f2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0681f3a50 0x7ff0681f3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff06c9f2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0681f3a50 0x7ff0681f3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41066/0 (socket says 172.21.15.94:41066) 2024-04-25T12:21:57.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff06c9f2640 1 -- 172.21.15.94:0/1971786140 learned_addr learned my addr 172.21.15.94:0/1971786140 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:57.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff067fff640 1 --2- 172.21.15.94:0/1971786140 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff0540039f0 0x7ff068073d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff05ffff640 1 --2- 172.21.15.94:0/1971786140 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff068073530 0x7ff06814cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff06c9f2640 1 -- 172.21.15.94:0/1971786140 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff0540039f0 msgr2=0x7ff068073d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff06c9f2640 1 --2- 172.21.15.94:0/1971786140 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff0540039f0 0x7ff068073d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff06c9f2640 1 -- 172.21.15.94:0/1971786140 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff068073530 msgr2=0x7ff06814cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:57.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff06c9f2640 1 --2- 172.21.15.94:0/1971786140 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff068073530 0x7ff06814cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:57.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff06c9f2640 1 -- 172.21.15.94:0/1971786140 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0681f4410 con 0x7ff0681f3a50 2024-04-25T12:21:57.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.369+0000 7ff06c9f2640 1 --2- 172.21.15.94:0/1971786140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0681f3a50 0x7ff0681f3ed0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff068155a20 tx=0x7ff06000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.373+0000 7ff0657fa640 1 -- 172.21.15.94:0/1971786140 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06001c070 con 0x7ff0681f3a50 2024-04-25T12:21:57.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.373+0000 7ff0657fa640 1 -- 172.21.15.94:0/1971786140 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff060017400 con 0x7ff0681f3a50 2024-04-25T12:21:57.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.373+0000 7ff06e455640 1 -- 172.21.15.94:0/1971786140 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff068155bf0 con 0x7ff0681f3a50 2024-04-25T12:21:57.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.373+0000 7ff0657fa640 1 -- 172.21.15.94:0/1971786140 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0600177f0 con 0x7ff0681f3a50 2024-04-25T12:21:57.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.373+0000 7ff06e455640 1 -- 172.21.15.94:0/1971786140 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0681561b0 con 0x7ff0681f3a50 2024-04-25T12:21:57.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.373+0000 7ff06e455640 1 -- 172.21.15.94:0/1971786140 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff068075e60 con 0x7ff0681f3a50 2024-04-25T12:21:57.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.373+0000 7ff0657fa640 1 -- 172.21.15.94:0/1971786140 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff06001f070 con 0x7ff0681f3a50 2024-04-25T12:21:57.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.373+0000 7ff0657fa640 1 --2- 172.21.15.94:0/1971786140 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff048068380 0x7ff04806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:57.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.373+0000 7ff0657fa640 1 -- 172.21.15.94:0/1971786140 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7ff060086d00 con 0x7ff0681f3a50 2024-04-25T12:21:57.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.373+0000 7ff067fff640 1 --2- 172.21.15.94:0/1971786140 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff048068380 0x7ff04806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:57.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.373+0000 7ff067fff640 1 --2- 172.21.15.94:0/1971786140 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff048068380 0x7ff04806a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff0580ab000 tx=0x7ff0580b1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:57.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.377+0000 7ff0657fa640 1 -- 172.21.15.94:0/1971786140 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff0681f4410 con 0x7ff0681f3a50 2024-04-25T12:21:57.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:57.537+0000 7ff06e455640 1 -- 172.21.15.94:0/1971786140 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7ff0680c23e0 con 0x7ff0681f3a50 2024-04-25T12:21:58.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.213+0000 7ff0657fa640 1 -- 172.21.15.94:0/1971786140 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) ==== 169+0+0 (secure 0 0 0) 0x7ff060012070 con 0x7ff0681f3a50 2024-04-25T12:21:58.215 INFO:teuthology.orchestra.run.smithi094.stderr:set pool 4 allow_ec_overwrites to true 2024-04-25T12:21:58.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.217+0000 7ff06e455640 1 -- 172.21.15.94:0/1971786140 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff048068380 msgr2=0x7ff04806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.217+0000 7ff06e455640 1 --2- 172.21.15.94:0/1971786140 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff048068380 0x7ff04806a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff0580ab000 tx=0x7ff0580b1040 comp rx=0 tx=0).stop 2024-04-25T12:21:58.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.217+0000 7ff06e455640 1 -- 172.21.15.94:0/1971786140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0681f3a50 msgr2=0x7ff0681f3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.217+0000 7ff06e455640 1 --2- 172.21.15.94:0/1971786140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0681f3a50 0x7ff0681f3ed0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff068155a20 tx=0x7ff06000f4a0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.217+0000 7ff06e455640 1 -- 172.21.15.94:0/1971786140 shutdown_connections 2024-04-25T12:21:58.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.217+0000 7ff06e455640 1 --2- 172.21.15.94:0/1971786140 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff048068380 0x7ff04806a840 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.217+0000 7ff06e455640 1 --2- 172.21.15.94:0/1971786140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0681f3a50 0x7ff0681f3ed0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.217+0000 7ff06e455640 1 --2- 172.21.15.94:0/1971786140 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff068073530 0x7ff06814cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.217+0000 7ff06e455640 1 --2- 172.21.15.94:0/1971786140 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff0540039f0 0x7ff068073d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.217+0000 7ff06e455640 1 -- 172.21.15.94:0/1971786140 >> 172.21.15.94:0/1971786140 conn(0x7ff0680ccf00 msgr2=0x7ff0680cad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:58.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.217+0000 7ff06e455640 1 -- 172.21.15.94:0/1971786140 shutdown_connections 2024-04-25T12:21:58.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.217+0000 7ff06e455640 1 -- 172.21.15.94:0/1971786140 wait complete. 2024-04-25T12:21:58.250 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-25T12:21:58.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe11019a640 1 Processor -- start 2024-04-25T12:21:58.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe11019a640 1 -- start start 2024-04-25T12:21:58.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe11019a640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe1080c8800 0x7fe1080c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe11019a640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe1080c5e90 0x7fe1080c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe11019a640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1080c8be0 con 0x7fe1080c4b40 2024-04-25T12:21:58.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe11019a640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fe108158090 con 0x7fe1080c8800 2024-04-25T12:21:58.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe11019a640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe1081585c0 con 0x7fe1080c5e90 2024-04-25T12:21:58.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10d735640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe1080c4b40 0x7fe1080c5780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41770/0 (socket says 172.21.15.94:41770) 2024-04-25T12:21:58.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10d735640 1 -- 172.21.15.94:0/4217843987 learned_addr learned my addr 172.21.15.94:0/4217843987 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:21:58.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10cf34640 1 -- 172.21.15.94:0/4217843987 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 129540254 0 0) 0x7fe1080c8be0 con 0x7fe1080c4b40 2024-04-25T12:21:58.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10df36640 1 --2- 172.21.15.94:0/4217843987 >> v2:172.21.15.111:3300/0 conn(0x7fe1080c8800 0x7fe1080c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10cf34640 1 -- 172.21.15.94:0/4217843987 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0f4003530 con 0x7fe1080c4b40 2024-04-25T12:21:58.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10e737640 1 --2- 172.21.15.94:0/4217843987 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe1080c5e90 0x7fe1080c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10cf34640 1 -- 172.21.15.94:0/4217843987 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1563052652 0 0) 0x7fe0f4003530 con 0x7fe1080c4b40 2024-04-25T12:21:58.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10cf34640 1 -- 172.21.15.94:0/4217843987 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe1080c5e90 msgr2=0x7fe1080c3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:58.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10cf34640 1 --2- 172.21.15.94:0/4217843987 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe1080c5e90 0x7fe1080c3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10cf34640 1 -- 172.21.15.94:0/4217843987 >> v2:172.21.15.111:3300/0 conn(0x7fe1080c8800 msgr2=0x7fe1080c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:58.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10cf34640 1 --2- 172.21.15.94:0/4217843987 >> v2:172.21.15.111:3300/0 conn(0x7fe1080c8800 0x7fe1080c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10cf34640 1 -- 172.21.15.94:0/4217843987 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1080c4790 con 0x7fe1080c4b40 2024-04-25T12:21:58.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10cf34640 1 -- 172.21.15.94:0/4217843987 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7fe0f8001680 con 0x7fe1080c4b40 2024-04-25T12:21:58.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10df36640 1 --2- 172.21.15.94:0/4217843987 >> v2:172.21.15.111:3300/0 conn(0x7fe1080c8800 0x7fe1080c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:21:58.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10cf34640 1 -- 172.21.15.94:0/4217843987 >> v1:172.21.15.94:6789/0 conn(0x7fe1080c4b40 legacy=0x7fe1080c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10cf34640 1 --2- 172.21.15.94:0/4217843987 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0f40039c0 0x7fe0f4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10cf34640 1 --2- 172.21.15.94:0/4217843987 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe0f4004810 0x7fe0f4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10cf34640 1 --2- 172.21.15.94:0/4217843987 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe1080c5e90 0x7fe0f4005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10cf34640 1 -- 172.21.15.94:0/4217843987 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe108158090 con 0x7fe0f40039c0 2024-04-25T12:21:58.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10cf34640 1 -- 172.21.15.94:0/4217843987 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe1081585c0 con 0x7fe0f4004810 2024-04-25T12:21:58.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10cf34640 1 -- 172.21.15.94:0/4217843987 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe0f400ccc0 con 0x7fe1080c5e90 2024-04-25T12:21:58.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10df36640 1 --2- 172.21.15.94:0/4217843987 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0f40039c0 0x7fe0f4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10d735640 1 --2- 172.21.15.94:0/4217843987 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe0f4004810 0x7fe0f4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10e737640 1 --2- 172.21.15.94:0/4217843987 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe1080c5e90 0x7fe0f4005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10df36640 1 -- 172.21.15.94:0/4217843987 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe1080c5e90 msgr2=0x7fe0f4005280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:58.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10df36640 1 --2- 172.21.15.94:0/4217843987 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe1080c5e90 0x7fe0f4005280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10df36640 1 -- 172.21.15.94:0/4217843987 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe0f4004810 msgr2=0x7fe0f4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:58.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10df36640 1 --2- 172.21.15.94:0/4217843987 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe0f4004810 0x7fe0f4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.369+0000 7fe10df36640 1 -- 172.21.15.94:0/4217843987 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f4003530 con 0x7fe0f40039c0 2024-04-25T12:21:58.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.373+0000 7fe10df36640 1 --2- 172.21.15.94:0/4217843987 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0f40039c0 0x7fe0f4003de0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe104009600 tx=0x7fe10401e860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a6c6b167e25d189 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.373+0000 7fe10cf34640 1 -- 172.21.15.94:0/4217843987 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1040b4070 con 0x7fe0f40039c0 2024-04-25T12:21:58.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.373+0000 7fe10cf34640 1 -- 172.21.15.94:0/4217843987 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1040a77f0 con 0x7fe0f40039c0 2024-04-25T12:21:58.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.373+0000 7fe10cf34640 1 -- 172.21.15.94:0/4217843987 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10400f040 con 0x7fe0f40039c0 2024-04-25T12:21:58.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.373+0000 7fe11019a640 1 -- 172.21.15.94:0/4217843987 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0f40039c0 msgr2=0x7fe0f4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.373+0000 7fe11019a640 1 --2- 172.21.15.94:0/4217843987 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe0f40039c0 0x7fe0f4003de0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe104009600 tx=0x7fe10401e860 comp rx=0 tx=0).stop 2024-04-25T12:21:58.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.373+0000 7fe10e737640 1 -- 172.21.15.94:0/4217843987 reap_dead start 2024-04-25T12:21:58.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.373+0000 7fe11019a640 1 -- 172.21.15.94:0/4217843987 shutdown_connections 2024-04-25T12:21:58.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.373+0000 7fe11019a640 1 -- 172.21.15.94:0/4217843987 >> 172.21.15.94:0/4217843987 conn(0x7fe10806b9d0 msgr2=0x7fe10806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:58.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.373+0000 7fe11019a640 1 -- 172.21.15.94:0/4217843987 shutdown_connections 2024-04-25T12:21:58.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.373+0000 7fe11019a640 1 -- 172.21.15.94:0/4217843987 wait complete. 2024-04-25T12:21:58.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.373+0000 7fe11019a640 1 Processor -- start 2024-04-25T12:21:58.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.373+0000 7fe11019a640 1 -- start start 2024-04-25T12:21:58.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe11019a640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe0f40039c0 0x7fe1081f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe11019a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe10815f5f0 0x7fe10815e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe11019a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe10815fa50 0x7fe108146e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe11019a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe108068610 con 0x7fe10815f5f0 2024-04-25T12:21:58.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe11019a640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe1080c52f0 con 0x7fe10815fa50 2024-04-25T12:21:58.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe11019a640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe108068790 con 0x7fe0f40039c0 2024-04-25T12:21:58.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe10d735640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe10815f5f0 0x7fe10815e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe10d735640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe10815f5f0 0x7fe10815e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41086/0 (socket says 172.21.15.94:41086) 2024-04-25T12:21:58.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe10d735640 1 -- 172.21.15.94:0/3646974152 learned_addr learned my addr 172.21.15.94:0/3646974152 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:58.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe10df36640 1 --2- 172.21.15.94:0/3646974152 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe0f40039c0 0x7fe1081f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe10e737640 1 --2- 172.21.15.94:0/3646974152 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe10815fa50 0x7fe108146e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe10d735640 1 -- 172.21.15.94:0/3646974152 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe0f40039c0 msgr2=0x7fe1081f7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe10d735640 1 --2- 172.21.15.94:0/3646974152 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe0f40039c0 0x7fe1081f7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe10d735640 1 -- 172.21.15.94:0/3646974152 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe10815fa50 msgr2=0x7fe108146e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:58.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe10d735640 1 --2- 172.21.15.94:0/3646974152 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe10815fa50 0x7fe108146e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:58.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe10d735640 1 -- 172.21.15.94:0/3646974152 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1081f81e0 con 0x7fe10815f5f0 2024-04-25T12:21:58.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe10df36640 1 --2- 172.21.15.94:0/3646974152 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe0f40039c0 0x7fe1081f7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:58.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe10d735640 1 --2- 172.21.15.94:0/3646974152 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe10815f5f0 0x7fe10815e000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8001870 tx=0x7fe0f800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe0fe7fc640 1 -- 172.21.15.94:0/3646974152 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f800ee60 con 0x7fe10815f5f0 2024-04-25T12:21:58.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe0fe7fc640 1 -- 172.21.15.94:0/3646974152 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f8018070 con 0x7fe10815f5f0 2024-04-25T12:21:58.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe11019a640 1 -- 172.21.15.94:0/3646974152 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe10815cd90 con 0x7fe10815f5f0 2024-04-25T12:21:58.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe0fe7fc640 1 -- 172.21.15.94:0/3646974152 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f800caf0 con 0x7fe10815f5f0 2024-04-25T12:21:58.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe11019a640 1 -- 172.21.15.94:0/3646974152 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe10815d310 con 0x7fe10815f5f0 2024-04-25T12:21:58.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe11019a640 1 -- 172.21.15.94:0/3646974152 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe108075df0 con 0x7fe10815f5f0 2024-04-25T12:21:58.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe0fe7fc640 1 -- 172.21.15.94:0/3646974152 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe0f800cc90 con 0x7fe10815f5f0 2024-04-25T12:21:58.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe0fe7fc640 1 --2- 172.21.15.94:0/3646974152 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe0ec0683b0 0x7fe0ec06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:58.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe10df36640 1 --2- 172.21.15.94:0/3646974152 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe0ec0683b0 0x7fe0ec06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:58.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe0fe7fc640 1 -- 172.21.15.94:0/3646974152 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7fe0f8086c00 con 0x7fe10815f5f0 2024-04-25T12:21:58.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.377+0000 7fe10df36640 1 --2- 172.21.15.94:0/3646974152 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe0ec0683b0 0x7fe0ec06a870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe1040b1000 tx=0x7fe104010040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:58.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.381+0000 7fe0fe7fc640 1 -- 172.21.15.94:0/3646974152 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe0f808d080 con 0x7fe10815f5f0 2024-04-25T12:21:58.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:58.565+0000 7fe11019a640 1 -- 172.21.15.94:0/3646974152 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fe10806f840 con 0x7fe10815f5f0 2024-04-25T12:21:59.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.257+0000 7fe0fe7fc640 1 -- 172.21.15.94:0/3646974152 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7fe0f8056e10 con 0x7fe10815f5f0 2024-04-25T12:21:59.261 INFO:teuthology.orchestra.run.smithi094.stderr:added data pool 4 to fsmap 2024-04-25T12:21:59.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.261+0000 7fe11019a640 1 -- 172.21.15.94:0/3646974152 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe0ec0683b0 msgr2=0x7fe0ec06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.261+0000 7fe11019a640 1 --2- 172.21.15.94:0/3646974152 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe0ec0683b0 0x7fe0ec06a870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe1040b1000 tx=0x7fe104010040 comp rx=0 tx=0).stop 2024-04-25T12:21:59.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.261+0000 7fe11019a640 1 -- 172.21.15.94:0/3646974152 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe10815f5f0 msgr2=0x7fe10815e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.261+0000 7fe11019a640 1 --2- 172.21.15.94:0/3646974152 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe10815f5f0 0x7fe10815e000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8001870 tx=0x7fe0f800ec10 comp rx=0 tx=0).stop 2024-04-25T12:21:59.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.261+0000 7fe11019a640 1 -- 172.21.15.94:0/3646974152 shutdown_connections 2024-04-25T12:21:59.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.261+0000 7fe11019a640 1 --2- 172.21.15.94:0/3646974152 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe0ec0683b0 0x7fe0ec06a870 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.261+0000 7fe11019a640 1 --2- 172.21.15.94:0/3646974152 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe10815fa50 0x7fe108146e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.261+0000 7fe11019a640 1 --2- 172.21.15.94:0/3646974152 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe10815f5f0 0x7fe10815e000 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.261+0000 7fe11019a640 1 --2- 172.21.15.94:0/3646974152 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe0f40039c0 0x7fe1081f7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.261+0000 7fe11019a640 1 -- 172.21.15.94:0/3646974152 >> 172.21.15.94:0/3646974152 conn(0x7fe10806b9d0 msgr2=0x7fe108155350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:59.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.261+0000 7fe11019a640 1 -- 172.21.15.94:0/3646974152 shutdown_connections 2024-04-25T12:21:59.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.261+0000 7fe11019a640 1 -- 172.21.15.94:0/3646974152 wait complete. 2024-04-25T12:21:59.283 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:21:59.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.401+0000 7fe3f6933640 1 Processor -- start 2024-04-25T12:21:59.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.401+0000 7fe3f6933640 1 -- start start 2024-04-25T12:21:59.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.405+0000 7fe3f6933640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe3f00c5f20 0x7fe3f00c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.405+0000 7fe3f6933640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe3f00c9c10 0x7fe3f00c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.405+0000 7fe3f6933640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3f00ca960 con 0x7fe3f00c9700 2024-04-25T12:21:59.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.405+0000 7fe3f6933640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fe3f00c7f30 con 0x7fe3f00c5f20 2024-04-25T12:21:59.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.405+0000 7fe3f6933640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe3f00ca0c0 con 0x7fe3f00c9c10 2024-04-25T12:21:59.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.405+0000 7fe3effff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe3f00c5f20 0x7fe3f00c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.405+0000 7fe3effff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe3f00c5f20 0x7fe3f00c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41090/0 (socket says 172.21.15.94:41090) 2024-04-25T12:21:59.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.405+0000 7fe3effff640 1 -- 172.21.15.94:0/3999514350 learned_addr learned my addr 172.21.15.94:0/3999514350 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:59.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.405+0000 7fe3ef7fe640 1 --2- 172.21.15.94:0/3999514350 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe3f00c9c10 0x7fe3f00c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.405+0000 7fe3effff640 1 -- 172.21.15.94:0/3999514350 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe3f00c9c10 msgr2=0x7fe3f00c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:59.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.405+0000 7fe3effff640 1 --2- 172.21.15.94:0/3999514350 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe3f00c9c10 0x7fe3f00c91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.405+0000 7fe3effff640 1 -- 172.21.15.94:0/3999514350 >> v1:172.21.15.111:6789/0 conn(0x7fe3f00c9700 legacy=0x7fe3f0152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:59.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.405+0000 7fe3effff640 1 -- 172.21.15.94:0/3999514350 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f00ca3a0 con 0x7fe3f00c5f20 2024-04-25T12:21:59.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.405+0000 7fe3ef7fe640 1 --2- 172.21.15.94:0/3999514350 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe3f00c9c10 0x7fe3f00c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:59.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.405+0000 7fe3effff640 1 --2- 172.21.15.94:0/3999514350 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3f00c5f20 0x7fe3f00c86f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009870 tx=0x7fe3e801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c264d90dcc55618 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:59.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3eeffd640 1 -- 172.21.15.94:0/3999514350 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e80b5070 con 0x7fe3f00c5f20 2024-04-25T12:21:59.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3eeffd640 1 -- 172.21.15.94:0/3999514350 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e80a89d0 con 0x7fe3f00c5f20 2024-04-25T12:21:59.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3eeffd640 1 -- 172.21.15.94:0/3999514350 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e80a8da0 con 0x7fe3f00c5f20 2024-04-25T12:21:59.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3f6933640 1 -- 172.21.15.94:0/3999514350 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3f00c5f20 msgr2=0x7fe3f00c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3f6933640 1 --2- 172.21.15.94:0/3999514350 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3f00c5f20 0x7fe3f00c86f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009870 tx=0x7fe3e801ed10 comp rx=0 tx=0).stop 2024-04-25T12:21:59.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3f6933640 1 -- 172.21.15.94:0/3999514350 shutdown_connections 2024-04-25T12:21:59.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3f6933640 1 --2- 172.21.15.94:0/3999514350 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe3f00c9c10 0x7fe3f00c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3f6933640 1 --2- 172.21.15.94:0/3999514350 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3f00c5f20 0x7fe3f00c86f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3f6933640 1 -- 172.21.15.94:0/3999514350 >> 172.21.15.94:0/3999514350 conn(0x7fe3f00676a0 msgr2=0x7fe3f0067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:59.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3f6933640 1 -- 172.21.15.94:0/3999514350 shutdown_connections 2024-04-25T12:21:59.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3f6933640 1 -- 172.21.15.94:0/3999514350 wait complete. 2024-04-25T12:21:59.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3f6933640 1 Processor -- start 2024-04-25T12:21:59.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3f6933640 1 -- start start 2024-04-25T12:21:59.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3f6933640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3f00c5f20 0x7fe3f015b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3f6933640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3f00c9700 0x7fe3f015be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3f6933640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe3f00c9c10 0x7fe3f006dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3f6933640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f00c8c30 con 0x7fe3f00c5f20 2024-04-25T12:21:59.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3f6933640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f00c81d0 con 0x7fe3f00c9700 2024-04-25T12:21:59.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3f6933640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe3f00c5830 con 0x7fe3f00c9c10 2024-04-25T12:21:59.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3effff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3f00c5f20 0x7fe3f015b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3effff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3f00c5f20 0x7fe3f015b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41104/0 (socket says 172.21.15.94:41104) 2024-04-25T12:21:59.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3effff640 1 -- 172.21.15.94:0/2170174647 learned_addr learned my addr 172.21.15.94:0/2170174647 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:59.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3ef7fe640 1 --2- 172.21.15.94:0/2170174647 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3f00c9700 0x7fe3f015be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3f4ed0640 1 --2- 172.21.15.94:0/2170174647 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe3f00c9c10 0x7fe3f006dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3effff640 1 -- 172.21.15.94:0/2170174647 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe3f00c9c10 msgr2=0x7fe3f006dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3effff640 1 --2- 172.21.15.94:0/2170174647 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe3f00c9c10 0x7fe3f006dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3effff640 1 -- 172.21.15.94:0/2170174647 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3f00c9700 msgr2=0x7fe3f015be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3effff640 1 --2- 172.21.15.94:0/2170174647 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3f00c9700 0x7fe3f015be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3effff640 1 -- 172.21.15.94:0/2170174647 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f015c3c0 con 0x7fe3f00c5f20 2024-04-25T12:21:59.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3f4ed0640 1 --2- 172.21.15.94:0/2170174647 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe3f00c9c10 0x7fe3f006dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:59.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3effff640 1 --2- 172.21.15.94:0/2170174647 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3f00c5f20 0x7fe3f015b710 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe3e801d3c0 tx=0x7fe3e801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:59.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3ecff9640 1 -- 172.21.15.94:0/2170174647 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e80b5040 con 0x7fe3f00c5f20 2024-04-25T12:21:59.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3ecff9640 1 -- 172.21.15.94:0/2170174647 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e80be070 con 0x7fe3f00c5f20 2024-04-25T12:21:59.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3f6933640 1 -- 172.21.15.94:0/2170174647 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3f0158160 con 0x7fe3f00c5f20 2024-04-25T12:21:59.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3ecff9640 1 -- 172.21.15.94:0/2170174647 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e80b0ac0 con 0x7fe3f00c5f20 2024-04-25T12:21:59.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.409+0000 7fe3f6933640 1 -- 172.21.15.94:0/2170174647 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3f0158720 con 0x7fe3f00c5f20 2024-04-25T12:21:59.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.413+0000 7fe3f6933640 1 -- 172.21.15.94:0/2170174647 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3f0075df0 con 0x7fe3f00c5f20 2024-04-25T12:21:59.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.413+0000 7fe3ecff9640 1 -- 172.21.15.94:0/2170174647 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe3e80b0c60 con 0x7fe3f00c5f20 2024-04-25T12:21:59.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.413+0000 7fe3ecff9640 1 --2- 172.21.15.94:0/2170174647 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe3dc068380 0x7fe3dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.413+0000 7fe3ecff9640 1 -- 172.21.15.94:0/2170174647 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe3e8124270 con 0x7fe3f00c5f20 2024-04-25T12:21:59.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.413+0000 7fe3ef7fe640 1 --2- 172.21.15.94:0/2170174647 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe3dc068380 0x7fe3dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.413+0000 7fe3ef7fe640 1 --2- 172.21.15.94:0/2170174647 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe3dc068380 0x7fe3dc06a840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe3e00075b0 tx=0x7fe3e0007540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:59.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.417+0000 7fe3ecff9640 1 -- 172.21.15.94:0/2170174647 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe3e8018870 con 0x7fe3f00c5f20 2024-04-25T12:21:59.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.613+0000 7fe3f6933640 1 -- 172.21.15.94:0/2170174647 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3f015cd00 con 0x7fe3f00c5f20 2024-04-25T12:21:59.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.613+0000 7fe3ecff9640 1 -- 172.21.15.94:0/2170174647 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+6829 (secure 0 0 0) 0x7fe3e80f7ac0 con 0x7fe3f00c5f20 2024-04-25T12:21:59.617 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:21:59.617 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6838/1468945344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6835","nonce":1468945344},{"type":"v1","addr":"172.21.15.94:6838","nonce":1468945344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4223,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6839/3773379365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":3773379365},{"type":"v1","addr":"172.21.15.94:6839","nonce":3773379365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6835/3463503555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3463503555},{"type":"v1","addr":"172.21.15.111:6835","nonce":3463503555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/1182495659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1182495659},{"type":"v1","addr":"172.21.15.94:6837","nonce":1182495659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6833/2332499082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":2332499082},{"type":"v1","addr":"172.21.15.111:6833","nonce":2332499082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T12:21:53.517464+0000","modified":"2024-04-25T12:21:58.569228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.111:6837/3560813143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":3560813143},{"type":"v1","addr":"172.21.15.111:6837","nonce":3560813143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T12:21:59.618 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 5 2024-04-25T12:21:59.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.617+0000 7fe3f6933640 1 -- 172.21.15.94:0/2170174647 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe3dc068380 msgr2=0x7fe3dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.617+0000 7fe3f6933640 1 --2- 172.21.15.94:0/2170174647 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe3dc068380 0x7fe3dc06a840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe3e00075b0 tx=0x7fe3e0007540 comp rx=0 tx=0).stop 2024-04-25T12:21:59.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.617+0000 7fe3f6933640 1 -- 172.21.15.94:0/2170174647 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3f00c5f20 msgr2=0x7fe3f015b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.617+0000 7fe3f6933640 1 --2- 172.21.15.94:0/2170174647 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3f00c5f20 0x7fe3f015b710 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe3e801d3c0 tx=0x7fe3e801bab0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.617+0000 7fe3f6933640 1 -- 172.21.15.94:0/2170174647 shutdown_connections 2024-04-25T12:21:59.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.617+0000 7fe3f6933640 1 --2- 172.21.15.94:0/2170174647 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe3dc068380 0x7fe3dc06a840 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.617+0000 7fe3f6933640 1 --2- 172.21.15.94:0/2170174647 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe3f00c9c10 0x7fe3f006dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.617+0000 7fe3f6933640 1 --2- 172.21.15.94:0/2170174647 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3f00c9700 0x7fe3f015be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.617+0000 7fe3f6933640 1 --2- 172.21.15.94:0/2170174647 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3f00c5f20 0x7fe3f015b710 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.617+0000 7fe3f6933640 1 -- 172.21.15.94:0/2170174647 >> 172.21.15.94:0/2170174647 conn(0x7fe3f00676a0 msgr2=0x7fe3f01596f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:59.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.617+0000 7fe3f6933640 1 -- 172.21.15.94:0/2170174647 shutdown_connections 2024-04-25T12:21:59.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.617+0000 7fe3f6933640 1 -- 172.21.15.94:0/2170174647 wait complete. 2024-04-25T12:21:59.636 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:21:59.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.757+0000 7f6ab538e640 1 Processor -- start 2024-04-25T12:21:59.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.757+0000 7f6ab538e640 1 -- start start 2024-04-25T12:21:59.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.757+0000 7f6ab538e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6ab006d200 0x7f6ab00c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.757+0000 7f6ab538e640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6ab00c6d50 0x7f6ab00c7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.757+0000 7f6ab538e640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ab00c4be0 con 0x7f6ab006d5e0 2024-04-25T12:21:59.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.757+0000 7f6ab538e640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f6ab00c8de0 con 0x7f6ab006d200 2024-04-25T12:21:59.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.757+0000 7f6ab538e640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f6ab00c76d0 con 0x7f6ab00c6d50 2024-04-25T12:21:59.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.757+0000 7f6aaeffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6ab006d200 0x7f6ab00c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.757+0000 7f6aaeffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6ab006d200 0x7f6ab00c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41106/0 (socket says 172.21.15.94:41106) 2024-04-25T12:21:59.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.757+0000 7f6aaeffd640 1 -- 172.21.15.94:0/3892953074 learned_addr learned my addr 172.21.15.94:0/3892953074 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:59.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.757+0000 7f6aa67fc640 1 --1- 172.21.15.94:0/3892953074 >> v1:172.21.15.94:6789/0 conn(0x7f6ab006d5e0 0x7f6ab006ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41776/0 (socket says 172.21.15.94:41776) 2024-04-25T12:21:59.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.757+0000 7f6aaf7fe640 1 --2- 172.21.15.94:0/3892953074 >> v2:172.21.15.111:3300/0 conn(0x7f6ab00c6d50 0x7f6ab00c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.757+0000 7f6aaeffd640 1 -- 172.21.15.94:0/3892953074 >> v2:172.21.15.111:3300/0 conn(0x7f6ab00c6d50 msgr2=0x7f6ab00c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:21:59.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.757+0000 7f6aaeffd640 1 --2- 172.21.15.94:0/3892953074 >> v2:172.21.15.111:3300/0 conn(0x7f6ab00c6d50 0x7f6ab00c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.757+0000 7f6aaeffd640 1 -- 172.21.15.94:0/3892953074 >> v1:172.21.15.94:6789/0 conn(0x7f6ab006d5e0 legacy=0x7f6ab006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.757+0000 7f6aaeffd640 1 -- 172.21.15.94:0/3892953074 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab0070720 con 0x7f6ab006d200 2024-04-25T12:21:59.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.757+0000 7f6aae7fc640 1 -- 172.21.15.94:0/3892953074 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2749829797 0 0) 0x7f6ab00c4be0 con 0x7f6ab006d5e0 2024-04-25T12:21:59.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.757+0000 7f6aaf7fe640 1 --2- 172.21.15.94:0/3892953074 >> v2:172.21.15.111:3300/0 conn(0x7f6ab00c6d50 0x7f6ab00c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:21:59.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6aaeffd640 1 --2- 172.21.15.94:0/3892953074 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ab006d200 0x7f6ab00c88a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6ab006db10 tx=0x7f6aa001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93846fe3e98c66c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:59.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6aae7fc640 1 -- 172.21.15.94:0/3892953074 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa00b5070 con 0x7f6ab006d200 2024-04-25T12:21:59.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6aae7fc640 1 -- 172.21.15.94:0/3892953074 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aa00a8a10 con 0x7f6ab006d200 2024-04-25T12:21:59.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6aae7fc640 1 -- 172.21.15.94:0/3892953074 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa00a8de0 con 0x7f6ab006d200 2024-04-25T12:21:59.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6ab538e640 1 -- 172.21.15.94:0/3892953074 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ab006d200 msgr2=0x7f6ab00c88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6ab538e640 1 --2- 172.21.15.94:0/3892953074 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ab006d200 0x7f6ab00c88a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6ab006db10 tx=0x7f6aa001ed10 comp rx=0 tx=0).stop 2024-04-25T12:21:59.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6ab538e640 1 -- 172.21.15.94:0/3892953074 shutdown_connections 2024-04-25T12:21:59.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6ab538e640 1 --2- 172.21.15.94:0/3892953074 >> v2:172.21.15.111:3300/0 conn(0x7f6ab00c6d50 0x7f6ab00c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6ab538e640 1 --2- 172.21.15.94:0/3892953074 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ab006d200 0x7f6ab00c88a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6ab538e640 1 -- 172.21.15.94:0/3892953074 >> 172.21.15.94:0/3892953074 conn(0x7f6ab00ca540 msgr2=0x7f6ab00ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:59.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6ab538e640 1 -- 172.21.15.94:0/3892953074 shutdown_connections 2024-04-25T12:21:59.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6ab538e640 1 -- 172.21.15.94:0/3892953074 wait complete. 2024-04-25T12:21:59.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6ab538e640 1 Processor -- start 2024-04-25T12:21:59.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6ab538e640 1 -- start start 2024-04-25T12:21:59.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6ab538e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ab006d200 0x7f6ab01f3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6ab538e640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6ab006d5e0 0x7f6ab01f10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6ab538e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ab00c6d50 0x7f6ab014bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6ab538e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab00c5410 con 0x7f6ab006d200 2024-04-25T12:21:59.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6ab538e640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab00c5130 con 0x7f6ab00c6d50 2024-04-25T12:21:59.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6ab538e640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6ab00c9da0 con 0x7f6ab006d5e0 2024-04-25T12:21:59.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6aaeffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ab006d200 0x7f6ab01f3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6aaeffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ab006d200 0x7f6ab01f3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41108/0 (socket says 172.21.15.94:41108) 2024-04-25T12:21:59.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6aaeffd640 1 -- 172.21.15.94:0/1508931896 learned_addr learned my addr 172.21.15.94:0/1508931896 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:21:59.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6aaeffd640 1 -- 172.21.15.94:0/1508931896 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6ab006d5e0 msgr2=0x7f6ab01f10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6aaeffd640 1 --2- 172.21.15.94:0/1508931896 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6ab006d5e0 0x7f6ab01f10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6aaeffd640 1 -- 172.21.15.94:0/1508931896 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ab00c6d50 msgr2=0x7f6ab014bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6aaeffd640 1 --2- 172.21.15.94:0/1508931896 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ab00c6d50 0x7f6ab014bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6aaeffd640 1 -- 172.21.15.94:0/1508931896 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab01f4300 con 0x7f6ab006d200 2024-04-25T12:21:59.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6aaeffd640 1 --2- 172.21.15.94:0/1508931896 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ab006d200 0x7f6ab01f3c60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6aa001b920 tx=0x7f6aa001bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:59.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6aa7fff640 1 -- 172.21.15.94:0/1508931896 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa00b5070 con 0x7f6ab006d200 2024-04-25T12:21:59.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6aa7fff640 1 -- 172.21.15.94:0/1508931896 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aa00b0c20 con 0x7f6ab006d200 2024-04-25T12:21:59.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6ab538e640 1 -- 172.21.15.94:0/1508931896 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab01f45e0 con 0x7f6ab006d200 2024-04-25T12:21:59.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6aa7fff640 1 -- 172.21.15.94:0/1508931896 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa00bb410 con 0x7f6ab006d200 2024-04-25T12:21:59.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.761+0000 7f6ab538e640 1 -- 172.21.15.94:0/1508931896 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ab01f08f0 con 0x7f6ab006d200 2024-04-25T12:21:59.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.765+0000 7f6ab538e640 1 -- 172.21.15.94:0/1508931896 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ab0075df0 con 0x7f6ab006d200 2024-04-25T12:21:59.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.765+0000 7f6aa7fff640 1 -- 172.21.15.94:0/1508931896 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6aa00c2060 con 0x7f6ab006d200 2024-04-25T12:21:59.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.765+0000 7f6aa7fff640 1 --2- 172.21.15.94:0/1508931896 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6a90068380 0x7f6a9006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:21:59.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.765+0000 7f6aa67fc640 1 --2- 172.21.15.94:0/1508931896 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6a90068380 0x7f6a9006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:21:59.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.765+0000 7f6aa7fff640 1 -- 172.21.15.94:0/1508931896 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6aa0123ee0 con 0x7f6ab006d200 2024-04-25T12:21:59.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.765+0000 7f6aa67fc640 1 --2- 172.21.15.94:0/1508931896 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6a90068380 0x7f6a9006a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0151020 tx=0x7f6a98007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:21:59.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.769+0000 7f6aa7fff640 1 -- 172.21.15.94:0/1508931896 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6aa0018870 con 0x7f6ab006d200 2024-04-25T12:21:59.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.929+0000 7f6ab538e640 1 -- 172.21.15.94:0/1508931896 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ab0070a90 con 0x7f6ab006d200 2024-04-25T12:21:59.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.933+0000 7f6aa7fff640 1 -- 172.21.15.94:0/1508931896 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18514 (secure 0 0 0) 0x7f6aa00f4160 con 0x7f6ab006d200 2024-04-25T12:21:59.937 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:21:59.937 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":26,"fsid":"7059a9e2-aec4-4b84-b942-caf531e15da3","created":"2024-04-25T12:21:29.118508+0000","modified":"2024-04-25T12:21:58.568896+0000","last_up_change":"2024-04-25T12:21:40.912605+0000","last_in_change":"2024-04-25T12:21:31.372905+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:39.781011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:51.465886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:52.470540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:56.209936+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"640a65ef-0734-468a-a8f5-9ed70cf75c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6809","nonce":2553247564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6811","nonce":2553247564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6815","nonce":2553247564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6813","nonce":2553247564}]},"public_addr":"172.21.15.94:6809/2553247564","cluster_addr":"172.21.15.94:6811/2553247564","heartbeat_back_addr":"172.21.15.94:6815/2553247564","heartbeat_front_addr":"172.21.15.94:6813/2553247564","state":["exists","up"]},{"osd":1,"uuid":"d6e886e6-c8c1-4761-9a4c-abc6961c7c81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6818","nonce":2492806478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6822","nonce":2492806478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6830","nonce":2492806478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6826","nonce":2492806478}]},"public_addr":"172.21.15.94:6818/2492806478","cluster_addr":"172.21.15.94:6822/2492806478","heartbeat_back_addr":"172.21.15.94:6830/2492806478","heartbeat_front_addr":"172.21.15.94:6826/2492806478","state":["exists","up"]},{"osd":2,"uuid":"ba20f409-ed46-43b6-b16d-43dc4622c042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6801","nonce":1485061290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6803","nonce":1485061290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6807","nonce":1485061290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6805","nonce":1485061290}]},"public_addr":"172.21.15.94:6801/1485061290","cluster_addr":"172.21.15.94:6803/1485061290","heartbeat_back_addr":"172.21.15.94:6807/1485061290","heartbeat_front_addr":"172.21.15.94:6805/1485061290","state":["exists","up"]},{"osd":3,"uuid":"85816a2b-3a3f-4ec8-8373-8230d948396f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6819","nonce":1548488434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6823","nonce":1548488434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6829","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6831","nonce":1548488434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6827","nonce":1548488434}]},"public_addr":"172.21.15.94:6819/1548488434","cluster_addr":"172.21.15.94:6823/1548488434","heartbeat_back_addr":"172.21.15.94:6831/1548488434","heartbeat_front_addr":"172.21.15.94:6827/1548488434","state":["exists","up"]},{"osd":4,"uuid":"b4a953b7-01d6-4623-9324-63135fdaf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6811","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6814","nonce":4070977083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6817","nonce":4070977083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6823","nonce":4070977083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6819","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6821","nonce":4070977083}]},"public_addr":"172.21.15.111:6814/4070977083","cluster_addr":"172.21.15.111:6817/4070977083","heartbeat_back_addr":"172.21.15.111:6823/4070977083","heartbeat_front_addr":"172.21.15.111:6821/4070977083","state":["exists","up"]},{"osd":5,"uuid":"c0acc514-427d-41bf-a965-b8463cebf045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6803","nonce":1054925605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6809","nonce":1054925605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6820","nonce":1054925605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6815","nonce":1054925605}]},"public_addr":"172.21.15.111:6803/1054925605","cluster_addr":"172.21.15.111:6809/1054925605","heartbeat_back_addr":"172.21.15.111:6820/1054925605","heartbeat_front_addr":"172.21.15.111:6815/1054925605","state":["exists","up"]},{"osd":6,"uuid":"26ff742f-5a57-44a7-a095-f04d6e87f885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6825","nonce":3619235078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6827","nonce":3619235078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6831","nonce":3619235078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6829","nonce":3619235078}]},"public_addr":"172.21.15.111:6825/3619235078","cluster_addr":"172.21.15.111:6827/3619235078","heartbeat_back_addr":"172.21.15.111:6831/3619235078","heartbeat_front_addr":"172.21.15.111:6829/3619235078","state":["exists","up"]},{"osd":7,"uuid":"9c214cba-693a-4b25-aad7-05a5b0006e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6801","nonce":558758517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6805","nonce":558758517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6813","nonce":558758517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6807","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6808","nonce":558758517}]},"public_addr":"172.21.15.111:6801/558758517","cluster_addr":"172.21.15.111:6805/558758517","heartbeat_back_addr":"172.21.15.111:6813/558758517","heartbeat_front_addr":"172.21.15.111:6808/558758517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.664958+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.853375+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.654455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:37.033852+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.968691+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.856013+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.913496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.848565+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:21:59.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.937+0000 7f6ab538e640 1 -- 172.21.15.94:0/1508931896 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6a90068380 msgr2=0x7f6a9006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.937+0000 7f6ab538e640 1 --2- 172.21.15.94:0/1508931896 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6a90068380 0x7f6a9006a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0151020 tx=0x7f6a98007970 comp rx=0 tx=0).stop 2024-04-25T12:21:59.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.937+0000 7f6ab538e640 1 -- 172.21.15.94:0/1508931896 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ab006d200 msgr2=0x7f6ab01f3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:21:59.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.937+0000 7f6ab538e640 1 --2- 172.21.15.94:0/1508931896 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ab006d200 0x7f6ab01f3c60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6aa001b920 tx=0x7f6aa001bab0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.937+0000 7f6ab538e640 1 -- 172.21.15.94:0/1508931896 shutdown_connections 2024-04-25T12:21:59.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.937+0000 7f6ab538e640 1 --2- 172.21.15.94:0/1508931896 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6a90068380 0x7f6a9006a840 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.937+0000 7f6ab538e640 1 --2- 172.21.15.94:0/1508931896 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6ab006d5e0 0x7f6ab01f10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.937+0000 7f6ab538e640 1 --2- 172.21.15.94:0/1508931896 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ab00c6d50 0x7f6ab014bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.937+0000 7f6ab538e640 1 --2- 172.21.15.94:0/1508931896 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ab006d200 0x7f6ab01f3c60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:21:59.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.937+0000 7f6ab538e640 1 -- 172.21.15.94:0/1508931896 >> 172.21.15.94:0/1508931896 conn(0x7f6ab00ca540 msgr2=0x7f6ab0158300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:21:59.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.937+0000 7f6ab538e640 1 -- 172.21.15.94:0/1508931896 shutdown_connections 2024-04-25T12:21:59.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:21:59.937+0000 7f6ab538e640 1 -- 172.21.15.94:0/1508931896 wait complete. 2024-04-25T12:21:59.955 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:22:00.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.073+0000 7f8235533640 1 Processor -- start 2024-04-25T12:22:00.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.073+0000 7f8235533640 1 -- start start 2024-04-25T12:22:00.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.077+0000 7f8235533640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f82300cada0 0x7f823006cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:00.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.077+0000 7f8235533640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f823006d020 0x7f823015b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:00.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.077+0000 7f8235533640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82301556f0 con 0x7f8230155310 2024-04-25T12:22:00.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.077+0000 7f8235533640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f823015f2e0 con 0x7f82300cada0 2024-04-25T12:22:00.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.077+0000 7f8235533640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f823006d4d0 con 0x7f823006d020 2024-04-25T12:22:00.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.077+0000 7f8227fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f82300cada0 0x7f823006cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:00.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.077+0000 7f8227fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f82300cada0 0x7f823006cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41114/0 (socket says 172.21.15.94:41114) 2024-04-25T12:22:00.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.077+0000 7f8227fff640 1 -- 172.21.15.94:0/844343774 learned_addr learned my addr 172.21.15.94:0/844343774 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:22:00.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.077+0000 7f822effd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f8230155310 0x7f82300cb350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41784/0 (socket says 172.21.15.94:41784) 2024-04-25T12:22:00.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.077+0000 7f822f7fe640 1 --2- 172.21.15.94:0/844343774 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f823006d020 0x7f823015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:00.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.077+0000 7f8227fff640 1 -- 172.21.15.94:0/844343774 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f823006d020 msgr2=0x7f823015b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:00.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.077+0000 7f8227fff640 1 --2- 172.21.15.94:0/844343774 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f823006d020 0x7f823015b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.077+0000 7f8227fff640 1 -- 172.21.15.94:0/844343774 >> v1:172.21.15.94:6789/0 conn(0x7f8230155310 legacy=0x7f82300cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:00.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.077+0000 7f8227fff640 1 -- 172.21.15.94:0/844343774 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f823015e6d0 con 0x7f82300cada0 2024-04-25T12:22:00.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.077+0000 7f8227fff640 1 --2- 172.21.15.94:0/844343774 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82300cada0 0x7f823006cae0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8218009870 tx=0x7f821801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a7d90b309592238 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:00.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.077+0000 7f822e7fc640 1 -- 172.21.15.94:0/844343774 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82180b2070 con 0x7f82300cada0 2024-04-25T12:22:00.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.077+0000 7f822e7fc640 1 -- 172.21.15.94:0/844343774 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82180a9070 con 0x7f82300cada0 2024-04-25T12:22:00.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.077+0000 7f822e7fc640 1 -- 172.21.15.94:0/844343774 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82180ad880 con 0x7f82300cada0 2024-04-25T12:22:00.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8235533640 1 -- 172.21.15.94:0/844343774 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82300cada0 msgr2=0x7f823006cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:00.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8235533640 1 --2- 172.21.15.94:0/844343774 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82300cada0 0x7f823006cae0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8218009870 tx=0x7f821801c560 comp rx=0 tx=0).stop 2024-04-25T12:22:00.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8235533640 1 -- 172.21.15.94:0/844343774 shutdown_connections 2024-04-25T12:22:00.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8235533640 1 --2- 172.21.15.94:0/844343774 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f823006d020 0x7f823015b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8235533640 1 --2- 172.21.15.94:0/844343774 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82300cada0 0x7f823006cae0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8235533640 1 -- 172.21.15.94:0/844343774 >> 172.21.15.94:0/844343774 conn(0x7f82300676a0 msgr2=0x7f8230067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:00.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8235533640 1 -- 172.21.15.94:0/844343774 shutdown_connections 2024-04-25T12:22:00.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8235533640 1 -- 172.21.15.94:0/844343774 wait complete. 2024-04-25T12:22:00.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8235533640 1 Processor -- start 2024-04-25T12:22:00.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8235533640 1 -- start start 2024-04-25T12:22:00.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8235533640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f823006d020 0x7f823015a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:00.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8235533640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82300cada0 0x7f82301f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:00.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8235533640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8230155310 0x7f82301f7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:00.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8235533640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f82300cba60 con 0x7f82300cada0 2024-04-25T12:22:00.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8235533640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f823015bb50 con 0x7f823006d020 2024-04-25T12:22:00.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8235533640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f82300cbbe0 con 0x7f8230155310 2024-04-25T12:22:00.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8227fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82300cada0 0x7f82301f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:00.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8227fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82300cada0 0x7f82301f78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41122/0 (socket says 172.21.15.94:41122) 2024-04-25T12:22:00.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8227fff640 1 -- 172.21.15.94:0/3475946473 learned_addr learned my addr 172.21.15.94:0/3475946473 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:22:00.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f822f7fe640 1 --2- 172.21.15.94:0/3475946473 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8230155310 0x7f82301f7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:00.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f822effd640 1 --2- 172.21.15.94:0/3475946473 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f823006d020 0x7f823015a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:00.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8227fff640 1 -- 172.21.15.94:0/3475946473 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8230155310 msgr2=0x7f82301f7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:00.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8227fff640 1 --2- 172.21.15.94:0/3475946473 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8230155310 0x7f82301f7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8227fff640 1 -- 172.21.15.94:0/3475946473 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f823006d020 msgr2=0x7f823015a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:00.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8227fff640 1 --2- 172.21.15.94:0/3475946473 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f823006d020 0x7f823015a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8227fff640 1 -- 172.21.15.94:0/3475946473 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8230155e00 con 0x7f82300cada0 2024-04-25T12:22:00.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8227fff640 1 --2- 172.21.15.94:0/3475946473 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82300cada0 0x7f82301f78b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f821801a190 tx=0x7f8218019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:00.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f82277fe640 1 -- 172.21.15.94:0/3475946473 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82180bb070 con 0x7f82300cada0 2024-04-25T12:22:00.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f82277fe640 1 -- 172.21.15.94:0/3475946473 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82180addb0 con 0x7f82300cada0 2024-04-25T12:22:00.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8235533640 1 -- 172.21.15.94:0/3475946473 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82301f4360 con 0x7f82300cada0 2024-04-25T12:22:00.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f82277fe640 1 -- 172.21.15.94:0/3475946473 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82180b2040 con 0x7f82300cada0 2024-04-25T12:22:00.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.081+0000 7f8235533640 1 -- 172.21.15.94:0/3475946473 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82301f4920 con 0x7f82300cada0 2024-04-25T12:22:00.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.085+0000 7f8235533640 1 -- 172.21.15.94:0/3475946473 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8230075df0 con 0x7f82300cada0 2024-04-25T12:22:00.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.085+0000 7f82277fe640 1 -- 172.21.15.94:0/3475946473 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f82180be070 con 0x7f82300cada0 2024-04-25T12:22:00.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.085+0000 7f82277fe640 1 --2- 172.21.15.94:0/3475946473 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8210068380 0x7f821006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:00.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.085+0000 7f82277fe640 1 -- 172.21.15.94:0/3475946473 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f821811fd20 con 0x7f82300cada0 2024-04-25T12:22:00.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.085+0000 7f822effd640 1 --2- 172.21.15.94:0/3475946473 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8210068380 0x7f821006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:00.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.085+0000 7f822effd640 1 --2- 172.21.15.94:0/3475946473 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8210068380 0x7f821006a840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8220000f70 tx=0x7f8220007cf0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:00.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.089+0000 7f82277fe640 1 -- 172.21.15.94:0/3475946473 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8218016150 con 0x7f82300cada0 2024-04-25T12:22:00.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.253+0000 7f8235533640 1 -- 172.21.15.94:0/3475946473 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f82300c9680 con 0x7f82300cada0 2024-04-25T12:22:00.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.253+0000 7f82277fe640 1 -- 172.21.15.94:0/3475946473 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18514 (secure 0 0 0) 0x7f82180effa0 con 0x7f82300cada0 2024-04-25T12:22:00.257 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:22:00.257 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":26,"fsid":"7059a9e2-aec4-4b84-b942-caf531e15da3","created":"2024-04-25T12:21:29.118508+0000","modified":"2024-04-25T12:21:58.568896+0000","last_up_change":"2024-04-25T12:21:40.912605+0000","last_in_change":"2024-04-25T12:21:31.372905+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:39.781011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:51.465886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:52.470540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:56.209936+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"640a65ef-0734-468a-a8f5-9ed70cf75c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6809","nonce":2553247564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6811","nonce":2553247564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6815","nonce":2553247564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6813","nonce":2553247564}]},"public_addr":"172.21.15.94:6809/2553247564","cluster_addr":"172.21.15.94:6811/2553247564","heartbeat_back_addr":"172.21.15.94:6815/2553247564","heartbeat_front_addr":"172.21.15.94:6813/2553247564","state":["exists","up"]},{"osd":1,"uuid":"d6e886e6-c8c1-4761-9a4c-abc6961c7c81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6818","nonce":2492806478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6822","nonce":2492806478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6830","nonce":2492806478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6826","nonce":2492806478}]},"public_addr":"172.21.15.94:6818/2492806478","cluster_addr":"172.21.15.94:6822/2492806478","heartbeat_back_addr":"172.21.15.94:6830/2492806478","heartbeat_front_addr":"172.21.15.94:6826/2492806478","state":["exists","up"]},{"osd":2,"uuid":"ba20f409-ed46-43b6-b16d-43dc4622c042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6801","nonce":1485061290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6803","nonce":1485061290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6807","nonce":1485061290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6805","nonce":1485061290}]},"public_addr":"172.21.15.94:6801/1485061290","cluster_addr":"172.21.15.94:6803/1485061290","heartbeat_back_addr":"172.21.15.94:6807/1485061290","heartbeat_front_addr":"172.21.15.94:6805/1485061290","state":["exists","up"]},{"osd":3,"uuid":"85816a2b-3a3f-4ec8-8373-8230d948396f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6819","nonce":1548488434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6823","nonce":1548488434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6829","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6831","nonce":1548488434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6827","nonce":1548488434}]},"public_addr":"172.21.15.94:6819/1548488434","cluster_addr":"172.21.15.94:6823/1548488434","heartbeat_back_addr":"172.21.15.94:6831/1548488434","heartbeat_front_addr":"172.21.15.94:6827/1548488434","state":["exists","up"]},{"osd":4,"uuid":"b4a953b7-01d6-4623-9324-63135fdaf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6811","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6814","nonce":4070977083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6817","nonce":4070977083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6823","nonce":4070977083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6819","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6821","nonce":4070977083}]},"public_addr":"172.21.15.111:6814/4070977083","cluster_addr":"172.21.15.111:6817/4070977083","heartbeat_back_addr":"172.21.15.111:6823/4070977083","heartbeat_front_addr":"172.21.15.111:6821/4070977083","state":["exists","up"]},{"osd":5,"uuid":"c0acc514-427d-41bf-a965-b8463cebf045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6803","nonce":1054925605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6809","nonce":1054925605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6820","nonce":1054925605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6815","nonce":1054925605}]},"public_addr":"172.21.15.111:6803/1054925605","cluster_addr":"172.21.15.111:6809/1054925605","heartbeat_back_addr":"172.21.15.111:6820/1054925605","heartbeat_front_addr":"172.21.15.111:6815/1054925605","state":["exists","up"]},{"osd":6,"uuid":"26ff742f-5a57-44a7-a095-f04d6e87f885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6825","nonce":3619235078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6827","nonce":3619235078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6831","nonce":3619235078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6829","nonce":3619235078}]},"public_addr":"172.21.15.111:6825/3619235078","cluster_addr":"172.21.15.111:6827/3619235078","heartbeat_back_addr":"172.21.15.111:6831/3619235078","heartbeat_front_addr":"172.21.15.111:6829/3619235078","state":["exists","up"]},{"osd":7,"uuid":"9c214cba-693a-4b25-aad7-05a5b0006e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6801","nonce":558758517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6805","nonce":558758517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6813","nonce":558758517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6807","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6808","nonce":558758517}]},"public_addr":"172.21.15.111:6801/558758517","cluster_addr":"172.21.15.111:6805/558758517","heartbeat_back_addr":"172.21.15.111:6813/558758517","heartbeat_front_addr":"172.21.15.111:6808/558758517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.664958+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.853375+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.654455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:37.033852+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.968691+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.856013+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.913496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.848565+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:22:00.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.257+0000 7f8235533640 1 -- 172.21.15.94:0/3475946473 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8210068380 msgr2=0x7f821006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:00.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.257+0000 7f8235533640 1 --2- 172.21.15.94:0/3475946473 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8210068380 0x7f821006a840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8220000f70 tx=0x7f8220007cf0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.257+0000 7f8235533640 1 -- 172.21.15.94:0/3475946473 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82300cada0 msgr2=0x7f82301f78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:00.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.257+0000 7f8235533640 1 --2- 172.21.15.94:0/3475946473 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82300cada0 0x7f82301f78b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f821801a190 tx=0x7f8218019300 comp rx=0 tx=0).stop 2024-04-25T12:22:00.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.257+0000 7f8235533640 1 -- 172.21.15.94:0/3475946473 shutdown_connections 2024-04-25T12:22:00.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.257+0000 7f8235533640 1 --2- 172.21.15.94:0/3475946473 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8210068380 0x7f821006a840 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.257+0000 7f8235533640 1 --2- 172.21.15.94:0/3475946473 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8230155310 0x7f82301f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.257+0000 7f8235533640 1 --2- 172.21.15.94:0/3475946473 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82300cada0 0x7f82301f78b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.257+0000 7f8235533640 1 --2- 172.21.15.94:0/3475946473 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f823006d020 0x7f823015a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.257+0000 7f8235533640 1 -- 172.21.15.94:0/3475946473 >> 172.21.15.94:0/3475946473 conn(0x7f82300676a0 msgr2=0x7f82300cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:00.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.257+0000 7f8235533640 1 -- 172.21.15.94:0/3475946473 shutdown_connections 2024-04-25T12:22:00.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.257+0000 7f8235533640 1 -- 172.21.15.94:0/3475946473 wait complete. 2024-04-25T12:22:00.290 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:22:00.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.401+0000 7f66f86fa640 1 Processor -- start 2024-04-25T12:22:00.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.401+0000 7f66f86fa640 1 -- start start 2024-04-25T12:22:00.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.401+0000 7f66f86fa640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f66f014fbc0 0x7f66f006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:00.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.401+0000 7f66f86fa640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f66f014ffa0 0x7f66f00c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:00.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.401+0000 7f66f86fa640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f66f0074100 0x7f66f00c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:00.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.401+0000 7f66f86fa640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f66f00c5d70 con 0x7f66f014fbc0 2024-04-25T12:22:00.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.401+0000 7f66f86fa640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f66f00c6050 con 0x7f66f0074100 2024-04-25T12:22:00.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.401+0000 7f66f86fa640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f66f00c6330 con 0x7f66f014ffa0 2024-04-25T12:22:00.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.401+0000 7f66f6496640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f66f014fbc0 0x7f66f006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:00.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.401+0000 7f66f6496640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f66f014fbc0 0x7f66f006f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41132/0 (socket says 172.21.15.94:41132) 2024-04-25T12:22:00.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.401+0000 7f66f6496640 1 -- 172.21.15.94:0/1986558521 learned_addr learned my addr 172.21.15.94:0/1986558521 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:22:00.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.401+0000 7f66f6c97640 1 --2- 172.21.15.94:0/1986558521 >> v2:172.21.15.111:3300/0 conn(0x7f66f0074100 0x7f66f00c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:00.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.401+0000 7f66f5c95640 1 --2- 172.21.15.94:0/1986558521 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f66f014ffa0 0x7f66f00c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:00.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.401+0000 7f66f6496640 1 -- 172.21.15.94:0/1986558521 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f66f014ffa0 msgr2=0x7f66f00c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:00.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.401+0000 7f66f6496640 1 --2- 172.21.15.94:0/1986558521 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f66f014ffa0 0x7f66f00c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.401+0000 7f66f6496640 1 -- 172.21.15.94:0/1986558521 >> v2:172.21.15.111:3300/0 conn(0x7f66f0074100 msgr2=0x7f66f00c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:00.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.401+0000 7f66f6496640 1 --2- 172.21.15.94:0/1986558521 >> v2:172.21.15.111:3300/0 conn(0x7f66f0074100 0x7f66f00c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.401+0000 7f66f6496640 1 -- 172.21.15.94:0/1986558521 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f00c6610 con 0x7f66f014fbc0 2024-04-25T12:22:00.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f6496640 1 --2- 172.21.15.94:0/1986558521 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66f014fbc0 0x7f66f006f700 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f66f00744e0 tx=0x7f66ec01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8977be040312f77 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:00.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f5494640 1 -- 172.21.15.94:0/1986558521 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec0aa660 con 0x7f66f014fbc0 2024-04-25T12:22:00.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f5494640 1 -- 172.21.15.94:0/1986558521 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66ec0af070 con 0x7f66f014fbc0 2024-04-25T12:22:00.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f5494640 1 -- 172.21.15.94:0/1986558521 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec0aaa20 con 0x7f66f014fbc0 2024-04-25T12:22:00.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f86fa640 1 -- 172.21.15.94:0/1986558521 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66f014fbc0 msgr2=0x7f66f006f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:00.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f86fa640 1 --2- 172.21.15.94:0/1986558521 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66f014fbc0 0x7f66f006f700 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f66f00744e0 tx=0x7f66ec01c520 comp rx=0 tx=0).stop 2024-04-25T12:22:00.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f86fa640 1 -- 172.21.15.94:0/1986558521 shutdown_connections 2024-04-25T12:22:00.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f86fa640 1 --2- 172.21.15.94:0/1986558521 >> v2:172.21.15.111:3300/0 conn(0x7f66f0074100 0x7f66f00c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f86fa640 1 --2- 172.21.15.94:0/1986558521 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f66f014ffa0 0x7f66f00c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f86fa640 1 --2- 172.21.15.94:0/1986558521 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66f014fbc0 0x7f66f006f700 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f86fa640 1 -- 172.21.15.94:0/1986558521 >> 172.21.15.94:0/1986558521 conn(0x7f66f006b9d0 msgr2=0x7f66f006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:00.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f86fa640 1 -- 172.21.15.94:0/1986558521 shutdown_connections 2024-04-25T12:22:00.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f86fa640 1 -- 172.21.15.94:0/1986558521 wait complete. 2024-04-25T12:22:00.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f86fa640 1 Processor -- start 2024-04-25T12:22:00.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f86fa640 1 -- start start 2024-04-25T12:22:00.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f86fa640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66f0074100 0x7f66f0151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:00.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f86fa640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66f014fbc0 0x7f66f00c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:00.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f86fa640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f66f014ffa0 0x7f66f0162400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:00.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f86fa640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f66f01592e0 con 0x7f66f0074100 2024-04-25T12:22:00.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f86fa640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f66f0159160 con 0x7f66f014fbc0 2024-04-25T12:22:00.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f86fa640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f66f0159460 con 0x7f66f014ffa0 2024-04-25T12:22:00.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f6496640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66f0074100 0x7f66f0151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:00.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f6496640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66f0074100 0x7f66f0151220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41140/0 (socket says 172.21.15.94:41140) 2024-04-25T12:22:00.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f6496640 1 -- 172.21.15.94:0/709389332 learned_addr learned my addr 172.21.15.94:0/709389332 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:22:00.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f6c97640 1 --2- 172.21.15.94:0/709389332 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f66f014ffa0 0x7f66f0162400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:00.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f5c95640 1 --2- 172.21.15.94:0/709389332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66f014fbc0 0x7f66f00c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:00.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f6496640 1 -- 172.21.15.94:0/709389332 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f66f014ffa0 msgr2=0x7f66f0162400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:00.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f6496640 1 --2- 172.21.15.94:0/709389332 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f66f014ffa0 0x7f66f0162400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f6496640 1 -- 172.21.15.94:0/709389332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66f014fbc0 msgr2=0x7f66f00c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:00.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f6496640 1 --2- 172.21.15.94:0/709389332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66f014fbc0 0x7f66f00c44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.405+0000 7f66f6496640 1 -- 172.21.15.94:0/709389332 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f00c3d40 con 0x7f66f0074100 2024-04-25T12:22:00.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.409+0000 7f66f6496640 1 --2- 172.21.15.94:0/709389332 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66f0074100 0x7f66f0151220 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f66ec0ac040 tx=0x7f66ec01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:00.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.409+0000 7f66e6ffd640 1 -- 172.21.15.94:0/709389332 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec0bd5f0 con 0x7f66f0074100 2024-04-25T12:22:00.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.409+0000 7f66e6ffd640 1 -- 172.21.15.94:0/709389332 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66ec0bd7b0 con 0x7f66f0074100 2024-04-25T12:22:00.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.409+0000 7f66f86fa640 1 -- 172.21.15.94:0/709389332 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66f0150460 con 0x7f66f0074100 2024-04-25T12:22:00.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.409+0000 7f66e6ffd640 1 -- 172.21.15.94:0/709389332 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec0bdba0 con 0x7f66f0074100 2024-04-25T12:22:00.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.409+0000 7f66f86fa640 1 -- 172.21.15.94:0/709389332 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66f0150a20 con 0x7f66f0074100 2024-04-25T12:22:00.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.409+0000 7f66f86fa640 1 -- 172.21.15.94:0/709389332 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66f0075df0 con 0x7f66f0074100 2024-04-25T12:22:00.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.409+0000 7f66e6ffd640 1 -- 172.21.15.94:0/709389332 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f66ec0b33f0 con 0x7f66f0074100 2024-04-25T12:22:00.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.409+0000 7f66e6ffd640 1 --2- 172.21.15.94:0/709389332 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f66d4068380 0x7f66d406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:00.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.409+0000 7f66e6ffd640 1 -- 172.21.15.94:0/709389332 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f66ec121ba0 con 0x7f66f0074100 2024-04-25T12:22:00.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.409+0000 7f66f5c95640 1 --2- 172.21.15.94:0/709389332 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f66d4068380 0x7f66d406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:00.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.409+0000 7f66f5c95640 1 --2- 172.21.15.94:0/709389332 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f66d4068380 0x7f66d406a840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f66f01f1b10 tx=0x7f66e0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:00.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.413+0000 7f66e6ffd640 1 -- 172.21.15.94:0/709389332 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f66ec0c3060 con 0x7f66f0074100 2024-04-25T12:22:00.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.609+0000 7f66f86fa640 1 -- 172.21.15.94:0/709389332 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66f00c7df0 con 0x7f66f0074100 2024-04-25T12:22:00.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.609+0000 7f66e6ffd640 1 -- 172.21.15.94:0/709389332 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6834 (secure 0 0 0) 0x7f66ec121090 con 0x7f66f0074100 2024-04-25T12:22:00.613 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:22:00.614 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6838/1468945344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6835","nonce":1468945344},{"type":"v1","addr":"172.21.15.94:6838","nonce":1468945344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4223,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6839/3773379365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":3773379365},{"type":"v1","addr":"172.21.15.94:6839","nonce":3773379365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6835/3463503555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3463503555},{"type":"v1","addr":"172.21.15.111:6835","nonce":3463503555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/1182495659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1182495659},{"type":"v1","addr":"172.21.15.94:6837","nonce":1182495659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6833/2332499082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":2332499082},{"type":"v1","addr":"172.21.15.111:6833","nonce":2332499082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T12:21:53.517464+0000","modified":"2024-04-25T12:22:00.260152+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.111:6837/3560813143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":3560813143},{"type":"v1","addr":"172.21.15.111:6837","nonce":3560813143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T12:22:00.614 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 7 2024-04-25T12:22:00.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.613+0000 7f66f86fa640 1 -- 172.21.15.94:0/709389332 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f66d4068380 msgr2=0x7f66d406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:00.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.613+0000 7f66f86fa640 1 --2- 172.21.15.94:0/709389332 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f66d4068380 0x7f66d406a840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f66f01f1b10 tx=0x7f66e0008040 comp rx=0 tx=0).stop 2024-04-25T12:22:00.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.613+0000 7f66f86fa640 1 -- 172.21.15.94:0/709389332 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66f0074100 msgr2=0x7f66f0151220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:00.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.613+0000 7f66f86fa640 1 --2- 172.21.15.94:0/709389332 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66f0074100 0x7f66f0151220 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f66ec0ac040 tx=0x7f66ec01ad60 comp rx=0 tx=0).stop 2024-04-25T12:22:00.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.613+0000 7f66f86fa640 1 -- 172.21.15.94:0/709389332 shutdown_connections 2024-04-25T12:22:00.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.613+0000 7f66f86fa640 1 --2- 172.21.15.94:0/709389332 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f66d4068380 0x7f66d406a840 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.613+0000 7f66f86fa640 1 --2- 172.21.15.94:0/709389332 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f66f014ffa0 0x7f66f0162400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.613+0000 7f66f86fa640 1 --2- 172.21.15.94:0/709389332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66f014fbc0 0x7f66f00c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.613+0000 7f66f86fa640 1 --2- 172.21.15.94:0/709389332 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66f0074100 0x7f66f0151220 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.613+0000 7f66f86fa640 1 -- 172.21.15.94:0/709389332 >> 172.21.15.94:0/709389332 conn(0x7f66f006b9d0 msgr2=0x7f66f006c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:00.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.613+0000 7f66f86fa640 1 -- 172.21.15.94:0/709389332 shutdown_connections 2024-04-25T12:22:00.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.613+0000 7f66f86fa640 1 -- 172.21.15.94:0/709389332 wait complete. 2024-04-25T12:22:00.630 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:22:00.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.749+0000 7f828a06d640 1 Processor -- start 2024-04-25T12:22:00.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.749+0000 7f828a06d640 1 -- start start 2024-04-25T12:22:00.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.749+0000 7f828a06d640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f828414ffa0 0x7f828406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:00.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.749+0000 7f828a06d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8284074100 0x7f82840c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:00.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.749+0000 7f828a06d640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82840c5d70 con 0x7f828414fbc0 2024-04-25T12:22:00.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.749+0000 7f828a06d640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f82840c6050 con 0x7f8284074100 2024-04-25T12:22:00.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.749+0000 7f828a06d640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f82840c6330 con 0x7f828414ffa0 2024-04-25T12:22:00.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.749+0000 7f8283fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8284074100 0x7f82840c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:00.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.749+0000 7f8283fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8284074100 0x7f82840c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41144/0 (socket says 172.21.15.94:41144) 2024-04-25T12:22:00.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.749+0000 7f82837fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f828414fbc0 0x7f82840c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41798/0 (socket says 172.21.15.94:41798) 2024-04-25T12:22:00.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.749+0000 7f8283fff640 1 -- 172.21.15.94:0/541613826 learned_addr learned my addr 172.21.15.94:0/541613826 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:22:00.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.749+0000 7f827affd640 1 --2- 172.21.15.94:0/541613826 >> v2:172.21.15.111:3300/0 conn(0x7f828414ffa0 0x7f828406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:00.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.749+0000 7f8283fff640 1 -- 172.21.15.94:0/541613826 >> v2:172.21.15.111:3300/0 conn(0x7f828414ffa0 msgr2=0x7f828406f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:00.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.749+0000 7f8283fff640 1 --2- 172.21.15.94:0/541613826 >> v2:172.21.15.111:3300/0 conn(0x7f828414ffa0 0x7f828406f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.749+0000 7f8283fff640 1 -- 172.21.15.94:0/541613826 >> v1:172.21.15.94:6789/0 conn(0x7f828414fbc0 legacy=0x7f82840c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:00.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.749+0000 7f8283fff640 1 -- 172.21.15.94:0/541613826 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82840c6610 con 0x7f8284074100 2024-04-25T12:22:00.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.749+0000 7f8282ffd640 1 -- 172.21.15.94:0/541613826 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 986754439 0 0) 0x7f82840c5d70 con 0x7f828414fbc0 2024-04-25T12:22:00.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.749+0000 7f827affd640 1 --2- 172.21.15.94:0/541613826 >> v2:172.21.15.111:3300/0 conn(0x7f828414ffa0 0x7f828406f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:00.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f8283fff640 1 --2- 172.21.15.94:0/541613826 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8284074100 0x7f82840c7250 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f827c009e50 tx=0x7f827c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73948e9c6e2e31 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:00.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f8282ffd640 1 -- 172.21.15.94:0/541613826 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827c0a58e0 con 0x7f8284074100 2024-04-25T12:22:00.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f8282ffd640 1 -- 172.21.15.94:0/541613826 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f827c0a5a80 con 0x7f8284074100 2024-04-25T12:22:00.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f8282ffd640 1 -- 172.21.15.94:0/541613826 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827c0a5e50 con 0x7f8284074100 2024-04-25T12:22:00.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f828a06d640 1 -- 172.21.15.94:0/541613826 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8284074100 msgr2=0x7f82840c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:00.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f828a06d640 1 --2- 172.21.15.94:0/541613826 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8284074100 0x7f82840c7250 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f827c009e50 tx=0x7f827c01c9f0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f828a06d640 1 -- 172.21.15.94:0/541613826 shutdown_connections 2024-04-25T12:22:00.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f828a06d640 1 --2- 172.21.15.94:0/541613826 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8284074100 0x7f82840c7250 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f828a06d640 1 --2- 172.21.15.94:0/541613826 >> v2:172.21.15.111:3300/0 conn(0x7f828414ffa0 0x7f828406f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f828a06d640 1 -- 172.21.15.94:0/541613826 >> 172.21.15.94:0/541613826 conn(0x7f828406b9d0 msgr2=0x7f828406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:00.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f828a06d640 1 -- 172.21.15.94:0/541613826 shutdown_connections 2024-04-25T12:22:00.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f828a06d640 1 -- 172.21.15.94:0/541613826 wait complete. 2024-04-25T12:22:00.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f828a06d640 1 Processor -- start 2024-04-25T12:22:00.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f828a06d640 1 -- start start 2024-04-25T12:22:00.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f828a06d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8284074100 0x7f828415a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:00.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f828a06d640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f828414fbc0 0x7f8284152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:00.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f828a06d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f828414ffa0 0x7f82841525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:00.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f828a06d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f82840c8ab0 con 0x7f8284074100 2024-04-25T12:22:00.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f828a06d640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f82840c8930 con 0x7f828414ffa0 2024-04-25T12:22:00.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f828a06d640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f8284166090 con 0x7f828414fbc0 2024-04-25T12:22:00.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f82837fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8284074100 0x7f828415a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:00.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f82837fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8284074100 0x7f828415a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41154/0 (socket says 172.21.15.94:41154) 2024-04-25T12:22:00.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f82837fe640 1 -- 172.21.15.94:0/2648274044 learned_addr learned my addr 172.21.15.94:0/2648274044 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:22:00.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f827affd640 1 --2- 172.21.15.94:0/2648274044 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f828414fbc0 0x7f8284152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:00.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f8283fff640 1 --2- 172.21.15.94:0/2648274044 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f828414ffa0 0x7f82841525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:00.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f82837fe640 1 -- 172.21.15.94:0/2648274044 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f828414fbc0 msgr2=0x7f8284152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:00.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f82837fe640 1 --2- 172.21.15.94:0/2648274044 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f828414fbc0 0x7f8284152080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f82837fe640 1 -- 172.21.15.94:0/2648274044 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f828414ffa0 msgr2=0x7f82841525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:00.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f82837fe640 1 --2- 172.21.15.94:0/2648274044 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f828414ffa0 0x7f82841525c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f82837fe640 1 -- 172.21.15.94:0/2648274044 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f828414e790 con 0x7f8284074100 2024-04-25T12:22:00.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f82837fe640 1 --2- 172.21.15.94:0/2648274044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8284074100 0x7f828415a2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f827400c520 tx=0x7f827400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:00.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f8280ff9640 1 -- 172.21.15.94:0/2648274044 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8274018070 con 0x7f8284074100 2024-04-25T12:22:00.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f8280ff9640 1 -- 172.21.15.94:0/2648274044 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82740074e0 con 0x7f8284074100 2024-04-25T12:22:00.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f828a06d640 1 -- 172.21.15.94:0/2648274044 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f828415c930 con 0x7f8284074100 2024-04-25T12:22:00.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f8280ff9640 1 -- 172.21.15.94:0/2648274044 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82740049f0 con 0x7f8284074100 2024-04-25T12:22:00.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.753+0000 7f828a06d640 1 -- 172.21.15.94:0/2648274044 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f828415cef0 con 0x7f8284074100 2024-04-25T12:22:00.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.757+0000 7f828a06d640 1 -- 172.21.15.94:0/2648274044 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8284075df0 con 0x7f8284074100 2024-04-25T12:22:00.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.757+0000 7f8280ff9640 1 -- 172.21.15.94:0/2648274044 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f827401b070 con 0x7f8284074100 2024-04-25T12:22:00.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.757+0000 7f8280ff9640 1 --2- 172.21.15.94:0/2648274044 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8264068380 0x7f826406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:00.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.757+0000 7f8280ff9640 1 -- 172.21.15.94:0/2648274044 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f82740861c0 con 0x7f8284074100 2024-04-25T12:22:00.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.757+0000 7f827affd640 1 --2- 172.21.15.94:0/2648274044 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8264068380 0x7f826406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:00.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.757+0000 7f827affd640 1 --2- 172.21.15.94:0/2648274044 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8264068380 0x7f826406a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f826c006fd0 tx=0x7f826c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:00.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.761+0000 7f8280ff9640 1 -- 172.21.15.94:0/2648274044 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f828414e790 con 0x7f8284074100 2024-04-25T12:22:00.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.909+0000 7f828a06d640 1 -- 172.21.15.94:0/2648274044 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8284149c50 con 0x7f8284074100 2024-04-25T12:22:00.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.913+0000 7f8280ff9640 1 -- 172.21.15.94:0/2648274044 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18514 (secure 0 0 0) 0x7f82740563b0 con 0x7f8284074100 2024-04-25T12:22:00.917 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:22:00.917 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":26,"fsid":"7059a9e2-aec4-4b84-b942-caf531e15da3","created":"2024-04-25T12:21:29.118508+0000","modified":"2024-04-25T12:21:58.568896+0000","last_up_change":"2024-04-25T12:21:40.912605+0000","last_in_change":"2024-04-25T12:21:31.372905+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:39.781011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:51.465886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:52.470540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:56.209936+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"640a65ef-0734-468a-a8f5-9ed70cf75c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6809","nonce":2553247564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6811","nonce":2553247564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6815","nonce":2553247564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6813","nonce":2553247564}]},"public_addr":"172.21.15.94:6809/2553247564","cluster_addr":"172.21.15.94:6811/2553247564","heartbeat_back_addr":"172.21.15.94:6815/2553247564","heartbeat_front_addr":"172.21.15.94:6813/2553247564","state":["exists","up"]},{"osd":1,"uuid":"d6e886e6-c8c1-4761-9a4c-abc6961c7c81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6818","nonce":2492806478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6822","nonce":2492806478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6830","nonce":2492806478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6826","nonce":2492806478}]},"public_addr":"172.21.15.94:6818/2492806478","cluster_addr":"172.21.15.94:6822/2492806478","heartbeat_back_addr":"172.21.15.94:6830/2492806478","heartbeat_front_addr":"172.21.15.94:6826/2492806478","state":["exists","up"]},{"osd":2,"uuid":"ba20f409-ed46-43b6-b16d-43dc4622c042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6801","nonce":1485061290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6803","nonce":1485061290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6807","nonce":1485061290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6805","nonce":1485061290}]},"public_addr":"172.21.15.94:6801/1485061290","cluster_addr":"172.21.15.94:6803/1485061290","heartbeat_back_addr":"172.21.15.94:6807/1485061290","heartbeat_front_addr":"172.21.15.94:6805/1485061290","state":["exists","up"]},{"osd":3,"uuid":"85816a2b-3a3f-4ec8-8373-8230d948396f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6819","nonce":1548488434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6823","nonce":1548488434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6829","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6831","nonce":1548488434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6827","nonce":1548488434}]},"public_addr":"172.21.15.94:6819/1548488434","cluster_addr":"172.21.15.94:6823/1548488434","heartbeat_back_addr":"172.21.15.94:6831/1548488434","heartbeat_front_addr":"172.21.15.94:6827/1548488434","state":["exists","up"]},{"osd":4,"uuid":"b4a953b7-01d6-4623-9324-63135fdaf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6811","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6814","nonce":4070977083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6817","nonce":4070977083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6823","nonce":4070977083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6819","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6821","nonce":4070977083}]},"public_addr":"172.21.15.111:6814/4070977083","cluster_addr":"172.21.15.111:6817/4070977083","heartbeat_back_addr":"172.21.15.111:6823/4070977083","heartbeat_front_addr":"172.21.15.111:6821/4070977083","state":["exists","up"]},{"osd":5,"uuid":"c0acc514-427d-41bf-a965-b8463cebf045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6803","nonce":1054925605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6809","nonce":1054925605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6820","nonce":1054925605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6815","nonce":1054925605}]},"public_addr":"172.21.15.111:6803/1054925605","cluster_addr":"172.21.15.111:6809/1054925605","heartbeat_back_addr":"172.21.15.111:6820/1054925605","heartbeat_front_addr":"172.21.15.111:6815/1054925605","state":["exists","up"]},{"osd":6,"uuid":"26ff742f-5a57-44a7-a095-f04d6e87f885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6825","nonce":3619235078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6827","nonce":3619235078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6831","nonce":3619235078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6829","nonce":3619235078}]},"public_addr":"172.21.15.111:6825/3619235078","cluster_addr":"172.21.15.111:6827/3619235078","heartbeat_back_addr":"172.21.15.111:6831/3619235078","heartbeat_front_addr":"172.21.15.111:6829/3619235078","state":["exists","up"]},{"osd":7,"uuid":"9c214cba-693a-4b25-aad7-05a5b0006e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6801","nonce":558758517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6805","nonce":558758517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6813","nonce":558758517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6807","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6808","nonce":558758517}]},"public_addr":"172.21.15.111:6801/558758517","cluster_addr":"172.21.15.111:6805/558758517","heartbeat_back_addr":"172.21.15.111:6813/558758517","heartbeat_front_addr":"172.21.15.111:6808/558758517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.664958+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.853375+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.654455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:37.033852+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.968691+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.856013+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.913496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.848565+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:22:00.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.917+0000 7f828a06d640 1 -- 172.21.15.94:0/2648274044 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8264068380 msgr2=0x7f826406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:00.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.917+0000 7f828a06d640 1 --2- 172.21.15.94:0/2648274044 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8264068380 0x7f826406a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f826c006fd0 tx=0x7f826c008040 comp rx=0 tx=0).stop 2024-04-25T12:22:00.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.917+0000 7f828a06d640 1 -- 172.21.15.94:0/2648274044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8284074100 msgr2=0x7f828415a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:00.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.917+0000 7f828a06d640 1 --2- 172.21.15.94:0/2648274044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8284074100 0x7f828415a2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f827400c520 tx=0x7f827400c9e0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.917+0000 7f828a06d640 1 -- 172.21.15.94:0/2648274044 shutdown_connections 2024-04-25T12:22:00.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.917+0000 7f828a06d640 1 --2- 172.21.15.94:0/2648274044 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8264068380 0x7f826406a840 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.917+0000 7f828a06d640 1 --2- 172.21.15.94:0/2648274044 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f828414fbc0 0x7f8284152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.917+0000 7f828a06d640 1 --2- 172.21.15.94:0/2648274044 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f828414ffa0 0x7f82841525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.917+0000 7f828a06d640 1 --2- 172.21.15.94:0/2648274044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8284074100 0x7f828415a2f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:00.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.917+0000 7f828a06d640 1 -- 172.21.15.94:0/2648274044 >> 172.21.15.94:0/2648274044 conn(0x7f828406b9d0 msgr2=0x7f828406ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:00.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.917+0000 7f828a06d640 1 -- 172.21.15.94:0/2648274044 shutdown_connections 2024-04-25T12:22:00.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:00.917+0000 7f828a06d640 1 -- 172.21.15.94:0/2648274044 wait complete. 2024-04-25T12:22:01.537 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T12:21:53.517464+0000', 'modified': '2024-04-25T12:22:00.260152+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.111:6837/3560813143', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6836', 'nonce': 3560813143}, {'type': 'v1', 'addr': '172.21.15.111:6837', 'nonce': 3560813143}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4285, 'qdb_cluster': [4285]} 2024-04-25T12:22:01.538 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T12:22:01.538 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T12:22:01.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.665+0000 7fac26bc7640 1 Processor -- start 2024-04-25T12:22:01.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.665+0000 7fac26bc7640 1 -- start start 2024-04-25T12:22:01.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.665+0000 7fac26bc7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fac201596b0 0x7fac20163380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:01.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.665+0000 7fac26bc7640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fac2015f3d0 0x7fac2006cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:01.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.665+0000 7fac26bc7640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fac200c8040 0x7fac2006d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:01.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.665+0000 7fac26bc7640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fac201638c0 con 0x7fac201596b0 2024-04-25T12:22:01.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.665+0000 7fac26bc7640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fac20159a90 con 0x7fac2015f3d0 2024-04-25T12:22:01.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.665+0000 7fac26bc7640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fac2015f880 con 0x7fac200c8040 2024-04-25T12:22:01.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.665+0000 7fac24963640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fac201596b0 0x7fac20163380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:01.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.665+0000 7fac24963640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fac201596b0 0x7fac20163380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43100/0 (socket says 172.21.15.94:43100) 2024-04-25T12:22:01.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.665+0000 7fac24963640 1 -- 172.21.15.94:0/2570852349 learned_addr learned my addr 172.21.15.94:0/2570852349 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:22:01.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.665+0000 7fac25164640 1 --2- 172.21.15.94:0/2570852349 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fac200c8040 0x7fac2006d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:01.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.665+0000 7fac1ffff640 1 --2- 172.21.15.94:0/2570852349 >> v2:172.21.15.111:3300/0 conn(0x7fac2015f3d0 0x7fac2006cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:01.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.665+0000 7fac24963640 1 -- 172.21.15.94:0/2570852349 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fac200c8040 msgr2=0x7fac2006d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:01.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.665+0000 7fac24963640 1 --2- 172.21.15.94:0/2570852349 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fac200c8040 0x7fac2006d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:01.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.665+0000 7fac24963640 1 -- 172.21.15.94:0/2570852349 >> v2:172.21.15.111:3300/0 conn(0x7fac2015f3d0 msgr2=0x7fac2006cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:01.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.665+0000 7fac24963640 1 --2- 172.21.15.94:0/2570852349 >> v2:172.21.15.111:3300/0 conn(0x7fac2015f3d0 0x7fac2006cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:01.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.665+0000 7fac24963640 1 -- 172.21.15.94:0/2570852349 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac2015fb60 con 0x7fac201596b0 2024-04-25T12:22:01.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.665+0000 7fac25164640 1 --2- 172.21.15.94:0/2570852349 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fac200c8040 0x7fac2006d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:01.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.665+0000 7fac1ffff640 1 --2- 172.21.15.94:0/2570852349 >> v2:172.21.15.111:3300/0 conn(0x7fac2015f3d0 0x7fac2006cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:22:01.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.669+0000 7fac24963640 1 --2- 172.21.15.94:0/2570852349 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac201596b0 0x7fac20163380 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fac2006fb40 tx=0x7fac1801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4441302316b3072 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:01.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.669+0000 7fac1f7fe640 1 -- 172.21.15.94:0/2570852349 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac180b5070 con 0x7fac201596b0 2024-04-25T12:22:01.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.669+0000 7fac1f7fe640 1 -- 172.21.15.94:0/2570852349 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac180a89d0 con 0x7fac201596b0 2024-04-25T12:22:01.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.669+0000 7fac1f7fe640 1 -- 172.21.15.94:0/2570852349 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac180a8da0 con 0x7fac201596b0 2024-04-25T12:22:01.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.669+0000 7fac26bc7640 1 -- 172.21.15.94:0/2570852349 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac201596b0 msgr2=0x7fac20163380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:01.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.669+0000 7fac26bc7640 1 --2- 172.21.15.94:0/2570852349 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac201596b0 0x7fac20163380 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fac2006fb40 tx=0x7fac1801ed10 comp rx=0 tx=0).stop 2024-04-25T12:22:01.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.669+0000 7fac26bc7640 1 -- 172.21.15.94:0/2570852349 shutdown_connections 2024-04-25T12:22:01.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.669+0000 7fac26bc7640 1 --2- 172.21.15.94:0/2570852349 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fac200c8040 0x7fac2006d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:01.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.669+0000 7fac26bc7640 1 --2- 172.21.15.94:0/2570852349 >> v2:172.21.15.111:3300/0 conn(0x7fac2015f3d0 0x7fac2006cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:01.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.669+0000 7fac26bc7640 1 --2- 172.21.15.94:0/2570852349 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac201596b0 0x7fac20163380 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:01.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.669+0000 7fac26bc7640 1 -- 172.21.15.94:0/2570852349 >> 172.21.15.94:0/2570852349 conn(0x7fac200ca540 msgr2=0x7fac200ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:01.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.669+0000 7fac26bc7640 1 -- 172.21.15.94:0/2570852349 shutdown_connections 2024-04-25T12:22:01.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.669+0000 7fac26bc7640 1 -- 172.21.15.94:0/2570852349 wait complete. 2024-04-25T12:22:01.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.669+0000 7fac26bc7640 1 Processor -- start 2024-04-25T12:22:01.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.669+0000 7fac26bc7640 1 -- start start 2024-04-25T12:22:01.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.673+0000 7fac26bc7640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fac200c8040 0x7fac201f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:01.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.673+0000 7fac26bc7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac201596b0 0x7fac200cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:01.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.673+0000 7fac26bc7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac2015f3d0 0x7fac2014b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:01.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.673+0000 7fac26bc7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fac20072270 con 0x7fac201596b0 2024-04-25T12:22:01.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.673+0000 7fac26bc7640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fac20160120 con 0x7fac2015f3d0 2024-04-25T12:22:01.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.673+0000 7fac26bc7640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fac20072790 con 0x7fac200c8040 2024-04-25T12:22:01.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.673+0000 7fac1ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac201596b0 0x7fac200cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:01.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.673+0000 7fac1ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac201596b0 0x7fac200cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43116/0 (socket says 172.21.15.94:43116) 2024-04-25T12:22:01.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.673+0000 7fac1ffff640 1 -- 172.21.15.94:0/1940312684 learned_addr learned my addr 172.21.15.94:0/1940312684 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:22:01.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.673+0000 7fac24963640 1 --2- 172.21.15.94:0/1940312684 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fac200c8040 0x7fac201f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:01.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.673+0000 7fac25164640 1 --2- 172.21.15.94:0/1940312684 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac2015f3d0 0x7fac2014b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:01.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.673+0000 7fac1ffff640 1 -- 172.21.15.94:0/1940312684 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fac200c8040 msgr2=0x7fac201f5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:01.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.673+0000 7fac1ffff640 1 --2- 172.21.15.94:0/1940312684 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fac200c8040 0x7fac201f5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:01.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.673+0000 7fac1ffff640 1 -- 172.21.15.94:0/1940312684 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac2015f3d0 msgr2=0x7fac2014b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:01.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.673+0000 7fac1ffff640 1 --2- 172.21.15.94:0/1940312684 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac2015f3d0 0x7fac2014b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:01.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.673+0000 7fac1ffff640 1 -- 172.21.15.94:0/1940312684 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac200cb690 con 0x7fac201596b0 2024-04-25T12:22:01.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.673+0000 7fac1ffff640 1 --2- 172.21.15.94:0/1940312684 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac201596b0 0x7fac200cd300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fac1000ce30 tx=0x7fac1000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:01.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.673+0000 7fac1d7fa640 1 -- 172.21.15.94:0/1940312684 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1000f680 con 0x7fac201596b0 2024-04-25T12:22:01.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.673+0000 7fac1d7fa640 1 -- 172.21.15.94:0/1940312684 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac1000f820 con 0x7fac201596b0 2024-04-25T12:22:01.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.673+0000 7fac26bc7640 1 -- 172.21.15.94:0/1940312684 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac200cb970 con 0x7fac201596b0 2024-04-25T12:22:01.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.673+0000 7fac1d7fa640 1 -- 172.21.15.94:0/1940312684 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1000fc30 con 0x7fac201596b0 2024-04-25T12:22:01.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.673+0000 7fac26bc7640 1 -- 172.21.15.94:0/1940312684 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac2015c5b0 con 0x7fac201596b0 2024-04-25T12:22:01.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.673+0000 7fac1d7fa640 1 -- 172.21.15.94:0/1940312684 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fac10018400 con 0x7fac201596b0 2024-04-25T12:22:01.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.673+0000 7fac1d7fa640 1 --2- 172.21.15.94:0/1940312684 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fac00068380 0x7fac0006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:01.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.673+0000 7fac1d7fa640 1 -- 172.21.15.94:0/1940312684 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fac10087a10 con 0x7fac201596b0 2024-04-25T12:22:01.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.673+0000 7fac24963640 1 --2- 172.21.15.94:0/1940312684 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fac00068380 0x7fac0006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:01.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac24963640 1 --2- 172.21.15.94:0/1940312684 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fac00068380 0x7fac0006a840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fac180b2000 tx=0x7fac18008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:01.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac29d49000 1 Processor -- start 2024-04-25T12:22:01.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac29d49000 1 -- start start 2024-04-25T12:22:01.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac29d49000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e121fe190 0x557e121fe570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:01.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac29d49000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e121feab0 0x557e12239080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:01.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac29d49000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557e122395c0 0x557e122399a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:01.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac29d49000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x557e12047420 con 0x557e121fe190 2024-04-25T12:22:01.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac29d49000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x557e11fe1bf0 con 0x557e121feab0 2024-04-25T12:22:01.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac29d49000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x557e120433e0 con 0x557e122395c0 2024-04-25T12:22:01.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac24963640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e121fe190 0x557e121fe570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:01.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac24963640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e121fe190 0x557e121fe570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43132/0 (socket says 172.21.15.94:43132) 2024-04-25T12:22:01.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac24963640 1 -- 172.21.15.94:0/877165108 learned_addr learned my addr 172.21.15.94:0/877165108 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:22:01.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac24963640 1 -- 172.21.15.94:0/877165108 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557e122395c0 msgr2=0x557e122399a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:01.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac24963640 1 --2- 172.21.15.94:0/877165108 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557e122395c0 0x557e122399a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:01.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac24963640 1 -- 172.21.15.94:0/877165108 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e121feab0 msgr2=0x557e12239080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:01.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac24963640 1 --2- 172.21.15.94:0/877165108 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e121feab0 0x557e12239080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:01.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac24963640 1 -- 172.21.15.94:0/877165108 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e120ef450 con 0x557e121fe190 2024-04-25T12:22:01.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac24963640 1 --2- 172.21.15.94:0/877165108 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e121fe190 0x557e121fe570 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fac180b3040 tx=0x7fac18004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0534107928ef6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:01.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac167fc640 1 -- 172.21.15.94:0/877165108 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac180cb070 con 0x557e121fe190 2024-04-25T12:22:01.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac167fc640 1 -- 172.21.15.94:0/877165108 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac180b0600 con 0x557e121fe190 2024-04-25T12:22:01.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac167fc640 1 -- 172.21.15.94:0/877165108 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac180b5040 con 0x557e121fe190 2024-04-25T12:22:01.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac29d49000 1 -- 172.21.15.94:0/877165108 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e121fe190 msgr2=0x557e121fe570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:01.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac29d49000 1 --2- 172.21.15.94:0/877165108 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e121fe190 0x557e121fe570 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fac180b3040 tx=0x7fac18004740 comp rx=0 tx=0).stop 2024-04-25T12:22:01.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac29d49000 1 -- 172.21.15.94:0/877165108 shutdown_connections 2024-04-25T12:22:01.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac29d49000 1 --2- 172.21.15.94:0/877165108 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557e122395c0 0x557e122399a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:01.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac29d49000 1 --2- 172.21.15.94:0/877165108 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e121feab0 0x557e12239080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:01.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac29d49000 1 --2- 172.21.15.94:0/877165108 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e121fe190 0x557e121fe570 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:01.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac29d49000 1 -- 172.21.15.94:0/877165108 >> 172.21.15.94:0/877165108 conn(0x557e12235e40 msgr2=0x557e12238260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:01.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac29d49000 1 -- 172.21.15.94:0/877165108 shutdown_connections 2024-04-25T12:22:01.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac29d49000 1 -- 172.21.15.94:0/877165108 wait complete. 2024-04-25T12:22:01.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac29d49000 1 -- start start 2024-04-25T12:22:01.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac29d49000 1 Processor -- start 2024-04-25T12:22:01.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac29d49000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e121fe190 0x557e121faba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:01.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac29d49000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557e121feab0 0x557e121fb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:01.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac29d49000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e122395c0 0x557e121fb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:01.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac29d49000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x557e11fe7ec0 con 0x557e122395c0 2024-04-25T12:22:01.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac29d49000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x557e120c8120 con 0x557e121fe190 2024-04-25T12:22:01.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac29d49000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x557e12052350 con 0x557e121feab0 2024-04-25T12:22:01.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac29d49000 10 client.0 _ll_register_callbacks cb 0x557e120244d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:22:01.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac25164640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e122395c0 0x557e121fb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:01.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac25164640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e122395c0 0x557e121fb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43140/0 (socket says 172.21.15.94:43140) 2024-04-25T12:22:01.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.677+0000 7fac25164640 1 -- 172.21.15.94:0/4047503594 learned_addr learned my addr 172.21.15.94:0/4047503594 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:22:01.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.681+0000 7fac25164640 1 -- 172.21.15.94:0/4047503594 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557e121feab0 msgr2=0x557e121fb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:01.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.681+0000 7fac25164640 1 --2- 172.21.15.94:0/4047503594 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557e121feab0 0x557e121fb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:01.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.681+0000 7fac25164640 1 -- 172.21.15.94:0/4047503594 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e121fe190 msgr2=0x557e121faba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:01.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.681+0000 7fac24963640 1 --2- 172.21.15.94:0/4047503594 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e121fe190 0x557e121faba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:01.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.681+0000 7fac25164640 1 --2- 172.21.15.94:0/4047503594 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e121fe190 0x557e121faba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:01.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.681+0000 7fac25164640 1 -- 172.21.15.94:0/4047503594 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e1208cf80 con 0x557e122395c0 2024-04-25T12:22:01.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.681+0000 7fac25164640 1 --2- 172.21.15.94:0/4047503594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e122395c0 0x557e121fb620 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fac08004660 tx=0x7fac0800e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326d8f5e24094232 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:01.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.681+0000 7fabff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-04-25T12:22:01.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.681+0000 7fabff7fe640 1 -- 172.21.15.94:0/4047503594 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac08018020 con 0x557e122395c0 2024-04-25T12:22:01.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.681+0000 7fabff7fe640 1 -- 172.21.15.94:0/4047503594 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fac08013660 con 0x557e122395c0 2024-04-25T12:22:01.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.681+0000 7fac29d49000 1 -- 172.21.15.94:0/4047503594 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac180b0600 con 0x557e122395c0 2024-04-25T12:22:01.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.681+0000 7fabff7fe640 1 -- 172.21.15.94:0/4047503594 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fac08022050 con 0x557e122395c0 2024-04-25T12:22:01.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.681+0000 7fac29d49000 10 client.4431 fetch_fsmap learned FSMap version 7 2024-04-25T12:22:01.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.681+0000 7fac29d49000 1 -- 172.21.15.94:0/4047503594 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x557e12020f00 con 0x557e122395c0 2024-04-25T12:22:01.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.681+0000 7fabff7fe640 1 -- 172.21.15.94:0/4047503594 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac180b0600 con 0x557e122395c0 2024-04-25T12:22:01.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.681+0000 7fabff7fe640 1 -- 172.21.15.94:0/4047503594 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 7) ==== 4712+0+0 (secure 0 0 0) 0x7fac08025020 con 0x557e122395c0 2024-04-25T12:22:01.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.681+0000 7fac29d49000 10 client.4431 fetch_fsmap finished waiting for FSMap version 7 2024-04-25T12:22:01.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.681+0000 7fac29d49000 10 client.4431 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T12:22:01.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.681+0000 7fac29d49000 20 client.4431 populate_metadata read hostname 'smithi094' 2024-04-25T12:22:01.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.681+0000 7fac29d49000 1 --2- 172.21.15.94:0/4047503594 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x557e1224dd90 0x557e12250180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:01.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.681+0000 7fac29d49000 4 client.4431 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T12:22:01.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.681+0000 7fac29d49000 1 -- 172.21.15.94:0/4047503594 --> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e11fe0bc0 con 0x557e1224dd90 2024-04-25T12:22:01.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.681+0000 7fac24963640 1 --2- 172.21.15.94:0/4047503594 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x557e1224dd90 0x557e12250180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:01.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.681+0000 7fabff7fe640 10 client.4431 ms_handle_connect on v2:172.21.15.111:6836/3560813143 2024-04-25T12:22:01.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:01.681+0000 7fac24963640 1 --2- 172.21.15.94:0/4047503594 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x557e1224dd90 0x557e12250180 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97444878aad544af server_cookie=e24c1cb75cb5ac28 in_seq=0 out_seq=0 2024-04-25T12:22:05.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.268+0000 7fabff7fe640 1 -- 172.21.15.94:0/4047503594 <== mds.0 v2:172.21.15.111:6836/3560813143 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557e11fe0bc0 con 0x557e1224dd90 2024-04-25T12:22:05.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.268+0000 7fabff7fe640 10 client.4431 handle_command_reply: tid=0 2024-04-25T12:22:05.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.268+0000 7fac29d49000 1 client.4431 shutdown 2024-04-25T12:22:05.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.268+0000 7fac29d49000 1 -- 172.21.15.94:0/4047503594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e122395c0 msgr2=0x557e121fb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:05.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.268+0000 7fac29d49000 1 --2- 172.21.15.94:0/4047503594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e122395c0 0x557e121fb620 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fac08004660 tx=0x7fac0800e730 comp rx=0 tx=0).stop 2024-04-25T12:22:05.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.268+0000 7fac29d49000 1 -- 172.21.15.94:0/4047503594 shutdown_connections 2024-04-25T12:22:05.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.268+0000 7fac29d49000 1 --2- 172.21.15.94:0/4047503594 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x557e1224dd90 0x557e12250180 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:05.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.268+0000 7fac29d49000 1 --2- 172.21.15.94:0/4047503594 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557e121feab0 0x557e121fb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:05.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.268+0000 7fac29d49000 1 --2- 172.21.15.94:0/4047503594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e122395c0 0x557e121fb620 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:05.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.268+0000 7fac29d49000 1 --2- 172.21.15.94:0/4047503594 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e121fe190 0x557e121faba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:05.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.268+0000 7fabff7fe640 0 client.4431 ms_handle_reset on v2:172.21.15.111:6836/3560813143 2024-04-25T12:22:05.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.268+0000 7fac29d49000 1 -- 172.21.15.94:0/4047503594 >> 172.21.15.94:0/4047503594 conn(0x557e12235e40 msgr2=0x557e122371c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:05.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.268+0000 7fac29d49000 1 -- 172.21.15.94:0/4047503594 shutdown_connections 2024-04-25T12:22:05.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.268+0000 7fac29d49000 1 -- 172.21.15.94:0/4047503594 wait complete. 2024-04-25T12:22:05.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.268+0000 7fac29d49000 20 client.4431 trim_cache size 0 max 16384 2024-04-25T12:22:05.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.292+0000 7fac29d49000 1 Processor -- start 2024-04-25T12:22:05.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.292+0000 7fac29d49000 1 -- start start 2024-04-25T12:22:05.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.292+0000 7fac29d49000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557e121fe190 0x557e12233e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:05.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.292+0000 7fac29d49000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e121feab0 0x557e122343d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:05.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.292+0000 7fac29d49000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e122395c0 0x557e12250180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:05.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.292+0000 7fac29d49000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fac20202360 con 0x557e121feab0 2024-04-25T12:22:05.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.292+0000 7fac29d49000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fac202016d0 con 0x557e122395c0 2024-04-25T12:22:05.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.292+0000 7fac29d49000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fac20201cf0 con 0x557e121fe190 2024-04-25T12:22:05.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac1ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e121feab0 0x557e122343d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:05.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac1ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e121feab0 0x557e122343d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43144/0 (socket says 172.21.15.94:43144) 2024-04-25T12:22:05.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac1ffff640 1 -- 172.21.15.94:0/2544945035 learned_addr learned my addr 172.21.15.94:0/2544945035 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:22:05.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac25164640 1 --2- 172.21.15.94:0/2544945035 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e122395c0 0x557e12250180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:05.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac24963640 1 --2- 172.21.15.94:0/2544945035 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557e121fe190 0x557e12233e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:05.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac1ffff640 1 -- 172.21.15.94:0/2544945035 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557e121fe190 msgr2=0x557e12233e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:05.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac1ffff640 1 --2- 172.21.15.94:0/2544945035 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557e121fe190 0x557e12233e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:05.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac1ffff640 1 -- 172.21.15.94:0/2544945035 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e122395c0 msgr2=0x557e12250180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:05.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac1ffff640 1 --2- 172.21.15.94:0/2544945035 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e122395c0 0x557e12250180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:05.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac1ffff640 1 -- 172.21.15.94:0/2544945035 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e11fcde80 con 0x557e121feab0 2024-04-25T12:22:05.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac1ffff640 1 --2- 172.21.15.94:0/2544945035 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e121feab0 0x557e122343d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fac1005e0a0 tx=0x7fac100570f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=106155308abac3f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:05.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac15ffb640 1 -- 172.21.15.94:0/2544945035 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac10074070 con 0x557e121feab0 2024-04-25T12:22:05.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac15ffb640 1 -- 172.21.15.94:0/2544945035 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac10060200 con 0x557e121feab0 2024-04-25T12:22:05.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac15ffb640 1 -- 172.21.15.94:0/2544945035 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac10055770 con 0x557e121feab0 2024-04-25T12:22:05.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac29d49000 1 -- 172.21.15.94:0/2544945035 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e121feab0 msgr2=0x557e122343d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:22:05.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac29d49000 1 --2- 172.21.15.94:0/2544945035 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e121feab0 0x557e122343d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fac1005e0a0 tx=0x7fac100570f0 comp rx=0 tx=0).stop 2024-04-25T12:22:05.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac29d49000 1 -- 172.21.15.94:0/2544945035 shutdown_connections 2024-04-25T12:22:05.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac29d49000 1 --2- 172.21.15.94:0/2544945035 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e122395c0 0x557e12250180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:05.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac29d49000 1 --2- 172.21.15.94:0/2544945035 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e121feab0 0x557e122343d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:05.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac29d49000 1 --2- 172.21.15.94:0/2544945035 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557e121fe190 0x557e12233e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:05.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac29d49000 1 -- 172.21.15.94:0/2544945035 >> 172.21.15.94:0/2544945035 conn(0x557e12235e40 msgr2=0x557e121f7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:22:05.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac29d49000 1 -- 172.21.15.94:0/2544945035 shutdown_connections 2024-04-25T12:22:05.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac29d49000 1 -- 172.21.15.94:0/2544945035 wait complete. 2024-04-25T12:22:05.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac29d49000 1 -- start start 2024-04-25T12:22:05.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac29d49000 1 Processor -- start 2024-04-25T12:22:05.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac29d49000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e121fe190 0x557e122528a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:05.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac29d49000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e121feab0 0x557e1226ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:05.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac29d49000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557e122395c0 0x557e1226f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:05.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac29d49000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x557e12046730 con 0x557e121fe190 2024-04-25T12:22:05.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac29d49000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x557e120139e0 con 0x557e121feab0 2024-04-25T12:22:05.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac29d49000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x557e1204ba50 con 0x557e122395c0 2024-04-25T12:22:05.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac29d49000 10 client.0 _ll_register_callbacks cb 0x7fac0800c150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:22:05.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac24963640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e121fe190 0x557e122528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:05.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac24963640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e121fe190 0x557e122528a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:43158/0 (socket says 172.21.15.94:43158) 2024-04-25T12:22:05.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.296+0000 7fac24963640 1 -- 172.21.15.94:0/3974107177 learned_addr learned my addr 172.21.15.94:0/3974107177 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:22:05.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac1ffff640 1 --2- 172.21.15.94:0/3974107177 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e121feab0 0x557e1226ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:05.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac25164640 1 --2- 172.21.15.94:0/3974107177 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557e122395c0 0x557e1226f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:05.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac24963640 1 -- 172.21.15.94:0/3974107177 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557e122395c0 msgr2=0x557e1226f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:05.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac24963640 1 --2- 172.21.15.94:0/3974107177 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557e122395c0 0x557e1226f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:05.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac24963640 1 -- 172.21.15.94:0/3974107177 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e121feab0 msgr2=0x557e1226ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:22:05.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac24963640 1 --2- 172.21.15.94:0/3974107177 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e121feab0 0x557e1226ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:22:05.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac24963640 1 -- 172.21.15.94:0/3974107177 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e1200fb30 con 0x557e121fe190 2024-04-25T12:22:05.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac1ffff640 1 --2- 172.21.15.94:0/3974107177 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e121feab0 0x557e1226ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:22:05.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac24963640 1 --2- 172.21.15.94:0/3974107177 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x557e121fe190 0x557e122528a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fac1801ed50 tx=0x7fac18009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681c9842ba2fbdc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:22:05.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fabff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-04-25T12:22:05.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fabff7fe640 1 -- 172.21.15.94:0/3974107177 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac180cb040 con 0x557e121fe190 2024-04-25T12:22:05.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fabff7fe640 1 -- 172.21.15.94:0/3974107177 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fac180b0a90 con 0x557e121fe190 2024-04-25T12:22:05.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac29d49000 1 -- 172.21.15.94:0/3974107177 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac10060200 con 0x557e121fe190 2024-04-25T12:22:05.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fabff7fe640 1 -- 172.21.15.94:0/3974107177 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fac180dd050 con 0x557e121fe190 2024-04-25T12:22:05.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac29d49000 10 client.4437 fetch_fsmap learned FSMap version 7 2024-04-25T12:22:05.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac29d49000 1 -- 172.21.15.94:0/3974107177 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x557e120c85b0 con 0x557e121fe190 2024-04-25T12:22:05.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fabff7fe640 1 -- 172.21.15.94:0/3974107177 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac10060200 con 0x557e121fe190 2024-04-25T12:22:05.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fabff7fe640 1 -- 172.21.15.94:0/3974107177 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 7) ==== 4712+0+0 (secure 0 0 0) 0x7fac180e0020 con 0x557e121fe190 2024-04-25T12:22:05.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac29d49000 10 client.4437 fetch_fsmap finished waiting for FSMap version 7 2024-04-25T12:22:05.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac29d49000 10 client.4437 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T12:22:05.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac29d49000 20 client.4437 populate_metadata read hostname 'smithi094' 2024-04-25T12:22:05.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac29d49000 1 --2- 172.21.15.94:0/3974107177 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x557e122ae170 0x557e122ae550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:22:05.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac29d49000 4 client.4437 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T12:22:05.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac29d49000 1 -- 172.21.15.94:0/3974107177 --> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] -- command(tid 0: {"prefix": "status"}) -- 0x557e12054e40 con 0x557e122ae170 2024-04-25T12:22:05.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac1ffff640 1 --2- 172.21.15.94:0/3974107177 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x557e122ae170 0x557e122ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:05.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac1ffff640 1 --2- 172.21.15.94:0/3974107177 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x557e122ae170 0x557e122ae550 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a25a3b351a688dc server_cookie=9dd62c0ab874c9a0 in_seq=0 out_seq=0 2024-04-25T12:22:05.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fabff7fe640 10 client.4437 ms_handle_connect on v2:172.21.15.111:6836/3560813143 2024-04-25T12:22:05.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac1ffff640 1 -- 172.21.15.94:0/3974107177 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x557e122ae170 msgr2=0x557e122ae550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-04-25T12:22:05.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac1ffff640 1 -- 172.21.15.94:0/3974107177 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x557e122ae170 msgr2=0x557e122ae550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:22:05.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac1ffff640 1 --2- 172.21.15.94:0/3974107177 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x557e122ae170 0x557e122ae550 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:22:05.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac1ffff640 1 --2- 172.21.15.94:0/3974107177 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x557e122ae170 0x557e122ae550 unknown :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-25T12:22:05.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac1ffff640 1 --2- 172.21.15.94:0/3974107177 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x557e122ae170 0x557e122ae550 unknown :-1 s=BANNER_CONNECTING pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:22:05.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac1ffff640 1 --2- 172.21.15.94:0/3974107177 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x557e122ae170 0x557e122ae550 crc :-1 s=SESSION_RECONNECTING pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_session_reset received session reset full=1 2024-04-25T12:22:05.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac1ffff640 1 --2- 172.21.15.94:0/3974107177 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x557e122ae170 0x557e122ae550 crc :-1 s=SESSION_RECONNECTING pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).reset_session 2024-04-25T12:22:05.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fabff7fe640 0 client.4437 ms_handle_remote_reset on v2:172.21.15.111:6836/3560813143 2024-04-25T12:22:05.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fabff7fe640 10 client.4437 ms_handle_connect on v2:172.21.15.111:6836/3560813143 2024-04-25T12:22:05.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:22:05.300+0000 7fac1ffff640 1 --2- 172.21.15.94:0/3974107177 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x557e122ae170 0x557e122ae550 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5273798aecdcf0 server_cookie=d5c5b4a5f69a95c0 in_seq=0 out_seq=0 2024-04-25T12:22:08.047 INFO:tasks.ceph.mds.b.smithi111.stderr:2024-04-25T12:22:08.043+0000 7fc186a0f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T12:22:19.584 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:22:19.588 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:22:49.650 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:22:49.653 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:23:19.755 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:23:19.759 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:23:49.802 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:23:49.806 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:24:01.559 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-04-25T12:24:02.561 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:24:02.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.687+0000 7fde3b131640 1 Processor -- start 2024-04-25T12:24:02.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.687+0000 7fde3b131640 1 -- start start 2024-04-25T12:24:02.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.691+0000 7fde3b131640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fde340c8250 0x7fde340c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:02.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.691+0000 7fde3b131640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fde340c8a70 0x7fde34152250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:02.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.691+0000 7fde3b131640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde3415b740 con 0x7fde340c8630 2024-04-25T12:24:02.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.691+0000 7fde3b131640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fde340c6490 con 0x7fde340c8250 2024-04-25T12:24:02.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.691+0000 7fde3b131640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fde340c58c0 con 0x7fde340c8a70 2024-04-25T12:24:02.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.691+0000 7fde38ecd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fde340c8250 0x7fde340c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:02.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.691+0000 7fde38ecd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fde340c8250 0x7fde340c39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56900/0 (socket says 172.21.15.94:56900) 2024-04-25T12:24:02.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.691+0000 7fde38ecd640 1 -- 172.21.15.94:0/632160984 learned_addr learned my addr 172.21.15.94:0/632160984 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:02.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.691+0000 7fde396ce640 1 --2- 172.21.15.94:0/632160984 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fde340c8a70 0x7fde34152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:02.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.691+0000 7fde38ecd640 1 -- 172.21.15.94:0/632160984 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fde340c8a70 msgr2=0x7fde34152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:02.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.691+0000 7fde38ecd640 1 --2- 172.21.15.94:0/632160984 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fde340c8a70 0x7fde34152250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:02.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.691+0000 7fde38ecd640 1 -- 172.21.15.94:0/632160984 >> v1:172.21.15.111:6789/0 conn(0x7fde340c8630 legacy=0x7fde34151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:02.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.691+0000 7fde38ecd640 1 -- 172.21.15.94:0/632160984 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde340c5b60 con 0x7fde340c8250 2024-04-25T12:24:02.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.691+0000 7fde38ecd640 1 --2- 172.21.15.94:0/632160984 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde340c8250 0x7fde340c39e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fde24009870 tx=0x7fde2401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99b02e5994da620 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:02.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.691+0000 7fde337fe640 1 -- 172.21.15.94:0/632160984 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde240b0070 con 0x7fde340c8250 2024-04-25T12:24:02.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.691+0000 7fde337fe640 1 -- 172.21.15.94:0/632160984 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde240ab600 con 0x7fde340c8250 2024-04-25T12:24:02.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.691+0000 7fde337fe640 1 -- 172.21.15.94:0/632160984 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde240ab9d0 con 0x7fde340c8250 2024-04-25T12:24:02.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde3b131640 1 -- 172.21.15.94:0/632160984 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde340c8250 msgr2=0x7fde340c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:02.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde3b131640 1 --2- 172.21.15.94:0/632160984 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde340c8250 0x7fde340c39e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fde24009870 tx=0x7fde2401c490 comp rx=0 tx=0).stop 2024-04-25T12:24:02.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde3b131640 1 -- 172.21.15.94:0/632160984 shutdown_connections 2024-04-25T12:24:02.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde3b131640 1 --2- 172.21.15.94:0/632160984 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fde340c8a70 0x7fde34152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:02.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde3b131640 1 --2- 172.21.15.94:0/632160984 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde340c8250 0x7fde340c39e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:02.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde3b131640 1 -- 172.21.15.94:0/632160984 >> 172.21.15.94:0/632160984 conn(0x7fde3406b9d0 msgr2=0x7fde3406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:02.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde3b131640 1 -- 172.21.15.94:0/632160984 shutdown_connections 2024-04-25T12:24:02.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde3b131640 1 -- 172.21.15.94:0/632160984 wait complete. 2024-04-25T12:24:02.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde3b131640 1 Processor -- start 2024-04-25T12:24:02.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde3b131640 1 -- start start 2024-04-25T12:24:02.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde3b131640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde340c8250 0x7fde34155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:02.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde3b131640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fde340c8630 0x7fde34146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:02.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde3b131640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde340c8a70 0x7fde341f4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:02.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde3b131640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fde340c6920 con 0x7fde340c8a70 2024-04-25T12:24:02.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde3b131640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fde3415b400 con 0x7fde340c8250 2024-04-25T12:24:02.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde3b131640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fde340681d0 con 0x7fde340c8630 2024-04-25T12:24:02.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde396ce640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde340c8a70 0x7fde341f4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:02.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde396ce640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde340c8a70 0x7fde341f4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56916/0 (socket says 172.21.15.94:56916) 2024-04-25T12:24:02.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde396ce640 1 -- 172.21.15.94:0/1037747002 learned_addr learned my addr 172.21.15.94:0/1037747002 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:02.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde38ecd640 1 --2- 172.21.15.94:0/1037747002 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde340c8250 0x7fde34155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:02.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde33fff640 1 --2- 172.21.15.94:0/1037747002 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fde340c8630 0x7fde34146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:02.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde396ce640 1 -- 172.21.15.94:0/1037747002 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fde340c8630 msgr2=0x7fde34146ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:02.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde396ce640 1 --2- 172.21.15.94:0/1037747002 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fde340c8630 0x7fde34146ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:02.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde396ce640 1 -- 172.21.15.94:0/1037747002 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde340c8250 msgr2=0x7fde34155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:02.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde396ce640 1 --2- 172.21.15.94:0/1037747002 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde340c8250 0x7fde34155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:02.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde396ce640 1 -- 172.21.15.94:0/1037747002 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde34145c90 con 0x7fde340c8a70 2024-04-25T12:24:02.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde33fff640 1 --2- 172.21.15.94:0/1037747002 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fde340c8630 0x7fde34146ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:02.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde396ce640 1 --2- 172.21.15.94:0/1037747002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde340c8a70 0x7fde341f4070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fde2c00cc30 tx=0x7fde2c00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:02.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde317fa640 1 -- 172.21.15.94:0/1037747002 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2c00ce40 con 0x7fde340c8a70 2024-04-25T12:24:02.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde317fa640 1 -- 172.21.15.94:0/1037747002 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde2c0039a0 con 0x7fde340c8a70 2024-04-25T12:24:02.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde3b131640 1 -- 172.21.15.94:0/1037747002 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde34145f70 con 0x7fde340c8a70 2024-04-25T12:24:02.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde317fa640 1 -- 172.21.15.94:0/1037747002 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2c003d50 con 0x7fde340c8a70 2024-04-25T12:24:02.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.695+0000 7fde3b131640 1 -- 172.21.15.94:0/1037747002 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde341f7a60 con 0x7fde340c8a70 2024-04-25T12:24:02.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.699+0000 7fde3b131640 1 -- 172.21.15.94:0/1037747002 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde34075df0 con 0x7fde340c8a70 2024-04-25T12:24:02.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.699+0000 7fde317fa640 1 -- 172.21.15.94:0/1037747002 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fde2c003f30 con 0x7fde340c8a70 2024-04-25T12:24:02.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.699+0000 7fde317fa640 1 --2- 172.21.15.94:0/1037747002 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fde200683b0 0x7fde2006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:02.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.699+0000 7fde317fa640 1 -- 172.21.15.94:0/1037747002 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fde2c0872d0 con 0x7fde340c8a70 2024-04-25T12:24:02.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.699+0000 7fde38ecd640 1 --2- 172.21.15.94:0/1037747002 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fde200683b0 0x7fde2006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:02.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.699+0000 7fde38ecd640 1 --2- 172.21.15.94:0/1037747002 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fde200683b0 0x7fde2006a870 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fde3415c520 tx=0x7fde24008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:02.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.703+0000 7fde317fa640 1 -- 172.21.15.94:0/1037747002 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fde2c014030 con 0x7fde340c8a70 2024-04-25T12:24:02.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.895+0000 7fde3b131640 1 -- 172.21.15.94:0/1037747002 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde34071e50 con 0x7fde340c8a70 2024-04-25T12:24:02.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.895+0000 7fde317fa640 1 -- 172.21.15.94:0/1037747002 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6834 (secure 0 0 0) 0x7fde2c057410 con 0x7fde340c8a70 2024-04-25T12:24:02.900 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:02.900 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6838/1468945344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6835","nonce":1468945344},{"type":"v1","addr":"172.21.15.94:6838","nonce":1468945344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4223,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6839/3773379365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":3773379365},{"type":"v1","addr":"172.21.15.94:6839","nonce":3773379365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6835/3463503555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3463503555},{"type":"v1","addr":"172.21.15.111:6835","nonce":3463503555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/1182495659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1182495659},{"type":"v1","addr":"172.21.15.94:6837","nonce":1182495659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6833/2332499082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":2332499082},{"type":"v1","addr":"172.21.15.111:6833","nonce":2332499082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T12:21:53.517464+0000","modified":"2024-04-25T12:22:00.260152+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.111:6837/3560813143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":3560813143},{"type":"v1","addr":"172.21.15.111:6837","nonce":3560813143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T12:24:02.900 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 7 2024-04-25T12:24:02.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.895+0000 7fde3b131640 1 -- 172.21.15.94:0/1037747002 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fde200683b0 msgr2=0x7fde2006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:02.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.895+0000 7fde3b131640 1 --2- 172.21.15.94:0/1037747002 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fde200683b0 0x7fde2006a870 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fde3415c520 tx=0x7fde24008040 comp rx=0 tx=0).stop 2024-04-25T12:24:02.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.895+0000 7fde3b131640 1 -- 172.21.15.94:0/1037747002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde340c8a70 msgr2=0x7fde341f4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:02.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.895+0000 7fde3b131640 1 --2- 172.21.15.94:0/1037747002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde340c8a70 0x7fde341f4070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fde2c00cc30 tx=0x7fde2c00a5c0 comp rx=0 tx=0).stop 2024-04-25T12:24:02.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.895+0000 7fde3b131640 1 -- 172.21.15.94:0/1037747002 shutdown_connections 2024-04-25T12:24:02.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.895+0000 7fde3b131640 1 --2- 172.21.15.94:0/1037747002 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fde200683b0 0x7fde2006a870 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:02.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.895+0000 7fde3b131640 1 --2- 172.21.15.94:0/1037747002 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fde340c8630 0x7fde34146ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:02.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.895+0000 7fde3b131640 1 --2- 172.21.15.94:0/1037747002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde340c8a70 0x7fde341f4070 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:02.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.895+0000 7fde3b131640 1 --2- 172.21.15.94:0/1037747002 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde340c8250 0x7fde34155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:02.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.895+0000 7fde3b131640 1 -- 172.21.15.94:0/1037747002 >> 172.21.15.94:0/1037747002 conn(0x7fde3406b9d0 msgr2=0x7fde34150400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:02.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.899+0000 7fde3b131640 1 -- 172.21.15.94:0/1037747002 shutdown_connections 2024-04-25T12:24:02.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:02.899+0000 7fde3b131640 1 -- 172.21.15.94:0/1037747002 wait complete. 2024-04-25T12:24:03.521 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T12:21:53.517464+0000', 'modified': '2024-04-25T12:22:00.260152+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.111:6837/3560813143', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6836', 'nonce': 3560813143}, {'type': 'v1', 'addr': '172.21.15.111:6837', 'nonce': 3560813143}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4285, 'qdb_cluster': [4285]} 2024-04-25T12:24:03.521 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T12:24:03.521 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T12:24:03.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.647+0000 7f47516f9640 1 Processor -- start 2024-04-25T12:24:03.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.647+0000 7f47516f9640 1 -- start start 2024-04-25T12:24:03.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.647+0000 7f47516f9640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f474c0c5f20 0x7f474c0c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.647+0000 7f47516f9640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f474c0c6300 0x7f474c152c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.647+0000 7f47516f9640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f474c0ca960 con 0x7f474c0c9c10 2024-04-25T12:24:03.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.647+0000 7f47516f9640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f474c0c7f30 con 0x7f474c0c5f20 2024-04-25T12:24:03.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.647+0000 7f47516f9640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f474c0ca0c0 con 0x7f474c0c6300 2024-04-25T12:24:03.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.647+0000 7f474affd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f474c0c5f20 0x7f474c0c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:03.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.647+0000 7f474affd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f474c0c5f20 0x7f474c0c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56918/0 (socket says 172.21.15.94:56918) 2024-04-25T12:24:03.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.647+0000 7f474affd640 1 -- 172.21.15.94:0/1141081426 learned_addr learned my addr 172.21.15.94:0/1141081426 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:03.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.651+0000 7f474b7fe640 1 --2- 172.21.15.94:0/1141081426 >> v2:172.21.15.111:3300/0 conn(0x7f474c0c6300 0x7f474c152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:03.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.651+0000 7f474affd640 1 -- 172.21.15.94:0/1141081426 >> v2:172.21.15.111:3300/0 conn(0x7f474c0c6300 msgr2=0x7f474c152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:03.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.651+0000 7f474affd640 1 --2- 172.21.15.94:0/1141081426 >> v2:172.21.15.111:3300/0 conn(0x7f474c0c6300 0x7f474c152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.651+0000 7f474affd640 1 -- 172.21.15.94:0/1141081426 >> v1:172.21.15.111:6789/0 conn(0x7f474c0c9c10 legacy=0x7f474c0c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:03.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.651+0000 7f474affd640 1 -- 172.21.15.94:0/1141081426 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f474c0ca3a0 con 0x7f474c0c5f20 2024-04-25T12:24:03.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.651+0000 7f474affd640 1 --2- 172.21.15.94:0/1141081426 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f474c0c5f20 0x7f474c0c86f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f474c159ed0 tx=0x7f473c01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a98995026af96 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:03.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.651+0000 7f474a7fc640 1 -- 172.21.15.94:0/1141081426 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473c0b5070 con 0x7f474c0c5f20 2024-04-25T12:24:03.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.651+0000 7f474a7fc640 1 -- 172.21.15.94:0/1141081426 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f473c0a89d0 con 0x7f474c0c5f20 2024-04-25T12:24:03.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.651+0000 7f474a7fc640 1 -- 172.21.15.94:0/1141081426 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473c0a8da0 con 0x7f474c0c5f20 2024-04-25T12:24:03.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.651+0000 7f47516f9640 1 -- 172.21.15.94:0/1141081426 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f474c0c5f20 msgr2=0x7f474c0c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:03.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.651+0000 7f47516f9640 1 --2- 172.21.15.94:0/1141081426 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f474c0c5f20 0x7f474c0c86f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f474c159ed0 tx=0x7f473c01ecd0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.651+0000 7f47516f9640 1 -- 172.21.15.94:0/1141081426 shutdown_connections 2024-04-25T12:24:03.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.651+0000 7f47516f9640 1 --2- 172.21.15.94:0/1141081426 >> v2:172.21.15.111:3300/0 conn(0x7f474c0c6300 0x7f474c152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.651+0000 7f47516f9640 1 --2- 172.21.15.94:0/1141081426 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f474c0c5f20 0x7f474c0c86f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.651+0000 7f47516f9640 1 -- 172.21.15.94:0/1141081426 >> 172.21.15.94:0/1141081426 conn(0x7f474c0676a0 msgr2=0x7f474c067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:03.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.651+0000 7f47516f9640 1 -- 172.21.15.94:0/1141081426 shutdown_connections 2024-04-25T12:24:03.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.651+0000 7f47516f9640 1 -- 172.21.15.94:0/1141081426 wait complete. 2024-04-25T12:24:03.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.655+0000 7f47516f9640 1 Processor -- start 2024-04-25T12:24:03.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.655+0000 7f47516f9640 1 -- start start 2024-04-25T12:24:03.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.655+0000 7f47516f9640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f474c0c5f20 0x7f474c1eedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.655+0000 7f47516f9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f474c0c6300 0x7f474c15b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.655+0000 7f47516f9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f474c0c9c10 0x7f474c15c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.655+0000 7f47516f9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f474c0c98d0 con 0x7f474c0c6300 2024-04-25T12:24:03.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.655+0000 7f47516f9640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f474c0c81d0 con 0x7f474c0c9c10 2024-04-25T12:24:03.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.655+0000 7f47516f9640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f474c0c8c30 con 0x7f474c0c5f20 2024-04-25T12:24:03.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.655+0000 7f47427fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f474c0c6300 0x7f474c15b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:03.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.655+0000 7f47427fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f474c0c6300 0x7f474c15b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56926/0 (socket says 172.21.15.94:56926) 2024-04-25T12:24:03.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.655+0000 7f47427fc640 1 -- 172.21.15.94:0/1691986569 learned_addr learned my addr 172.21.15.94:0/1691986569 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:03.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.655+0000 7f474b7fe640 1 --2- 172.21.15.94:0/1691986569 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f474c0c9c10 0x7f474c15c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:03.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.655+0000 7f47427fc640 1 -- 172.21.15.94:0/1691986569 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f474c0c5f20 msgr2=0x7f474c1eedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:03.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.655+0000 7f47427fc640 1 --2- 172.21.15.94:0/1691986569 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f474c0c5f20 0x7f474c1eedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.655+0000 7f47427fc640 1 -- 172.21.15.94:0/1691986569 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f474c0c9c10 msgr2=0x7f474c15c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:03.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.655+0000 7f47427fc640 1 --2- 172.21.15.94:0/1691986569 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f474c0c9c10 0x7f474c15c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.655+0000 7f47427fc640 1 -- 172.21.15.94:0/1691986569 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f474c15bab0 con 0x7f474c0c6300 2024-04-25T12:24:03.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.655+0000 7f47427fc640 1 --2- 172.21.15.94:0/1691986569 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f474c0c6300 0x7f474c15b570 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f473400b440 tx=0x7f473400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:03.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.655+0000 7f4743fff640 1 -- 172.21.15.94:0/1691986569 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734015020 con 0x7f474c0c6300 2024-04-25T12:24:03.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.655+0000 7f4743fff640 1 -- 172.21.15.94:0/1691986569 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4734011890 con 0x7f474c0c6300 2024-04-25T12:24:03.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.655+0000 7f47516f9640 1 -- 172.21.15.94:0/1691986569 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f474c15a170 con 0x7f474c0c6300 2024-04-25T12:24:03.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.655+0000 7f4743fff640 1 -- 172.21.15.94:0/1691986569 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734011c80 con 0x7f474c0c6300 2024-04-25T12:24:03.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.655+0000 7f47516f9640 1 -- 172.21.15.94:0/1691986569 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f474c15a730 con 0x7f474c0c6300 2024-04-25T12:24:03.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f4743fff640 1 -- 172.21.15.94:0/1691986569 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4734018020 con 0x7f474c0c6300 2024-04-25T12:24:03.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f4743fff640 1 --2- 172.21.15.94:0/1691986569 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f472c068380 0x7f472c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f474affd640 1 --2- 172.21.15.94:0/1691986569 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f472c068380 0x7f472c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:03.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f4743fff640 1 -- 172.21.15.94:0/1691986569 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f4734086cd0 con 0x7f474c0c6300 2024-04-25T12:24:03.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f474affd640 1 --2- 172.21.15.94:0/1691986569 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f472c068380 0x7f472c06a840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f473c0b2000 tx=0x7f473c004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:03.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f475487b000 1 Processor -- start 2024-04-25T12:24:03.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f475487b000 1 -- start start 2024-04-25T12:24:03.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f475487b000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55db11a80190 0x55db11a80570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f475487b000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55db11a80ab0 0x55db11abb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f475487b000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11abb5c0 0x55db11abb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f475487b000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55db118c9420 con 0x55db11abb5c0 2024-04-25T12:24:03.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f475487b000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55db11863bf0 con 0x55db11a80ab0 2024-04-25T12:24:03.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f475487b000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x55db118c53e0 con 0x55db11a80190 2024-04-25T12:24:03.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f474b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11abb5c0 0x55db11abb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:03.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f474b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11abb5c0 0x55db11abb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56940/0 (socket says 172.21.15.94:56940) 2024-04-25T12:24:03.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f474b7fe640 1 -- 172.21.15.94:0/2290368328 learned_addr learned my addr 172.21.15.94:0/2290368328 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:03.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f474affd640 1 --2- 172.21.15.94:0/2290368328 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55db11a80190 0x55db11a80570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:03.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f47427fc640 1 --2- 172.21.15.94:0/2290368328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55db11a80ab0 0x55db11abb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:03.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f474b7fe640 1 -- 172.21.15.94:0/2290368328 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55db11a80190 msgr2=0x55db11a80570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:03.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f474b7fe640 1 --2- 172.21.15.94:0/2290368328 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55db11a80190 0x55db11a80570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f474b7fe640 1 -- 172.21.15.94:0/2290368328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55db11a80ab0 msgr2=0x55db11abb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:03.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f474b7fe640 1 --2- 172.21.15.94:0/2290368328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55db11a80ab0 0x55db11abb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f474b7fe640 1 -- 172.21.15.94:0/2290368328 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db11971450 con 0x55db11abb5c0 2024-04-25T12:24:03.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f474b7fe640 1 --2- 172.21.15.94:0/2290368328 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11abb5c0 0x55db11abb9a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4744007400 tx=0x7f47440078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=377f0bbb8dbb12ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:03.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f4740ff9640 1 -- 172.21.15.94:0/2290368328 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47440147e0 con 0x55db11abb5c0 2024-04-25T12:24:03.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f4740ff9640 1 -- 172.21.15.94:0/2290368328 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f474401a070 con 0x55db11abb5c0 2024-04-25T12:24:03.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f4740ff9640 1 -- 172.21.15.94:0/2290368328 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4744014ba0 con 0x55db11abb5c0 2024-04-25T12:24:03.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f475487b000 1 -- 172.21.15.94:0/2290368328 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11abb5c0 msgr2=0x55db11abb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:03.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f475487b000 1 --2- 172.21.15.94:0/2290368328 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11abb5c0 0x55db11abb9a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4744007400 tx=0x7f47440078c0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f475487b000 1 -- 172.21.15.94:0/2290368328 shutdown_connections 2024-04-25T12:24:03.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f475487b000 1 --2- 172.21.15.94:0/2290368328 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11abb5c0 0x55db11abb9a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f475487b000 1 --2- 172.21.15.94:0/2290368328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55db11a80ab0 0x55db11abb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f475487b000 1 --2- 172.21.15.94:0/2290368328 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55db11a80190 0x55db11a80570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f475487b000 1 -- 172.21.15.94:0/2290368328 >> 172.21.15.94:0/2290368328 conn(0x55db11ab7e40 msgr2=0x55db11aba260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:03.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f475487b000 1 -- 172.21.15.94:0/2290368328 shutdown_connections 2024-04-25T12:24:03.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.659+0000 7f475487b000 1 -- 172.21.15.94:0/2290368328 wait complete. 2024-04-25T12:24:03.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f475487b000 1 -- start start 2024-04-25T12:24:03.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f475487b000 1 Processor -- start 2024-04-25T12:24:03.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f475487b000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55db11a80190 0x55db11a7cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f475487b000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55db11a80ab0 0x55db11a7d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f475487b000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11abb5c0 0x55db11a7d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f475487b000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55db11869ec0 con 0x55db11abb5c0 2024-04-25T12:24:03.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f475487b000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55db1194a120 con 0x55db11a80190 2024-04-25T12:24:03.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f475487b000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x55db118d4350 con 0x55db11a80ab0 2024-04-25T12:24:03.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f475487b000 10 client.0 _ll_register_callbacks cb 0x55db118a64d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:24:03.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f474b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11abb5c0 0x55db11a7d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:03.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f474b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11abb5c0 0x55db11a7d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56954/0 (socket says 172.21.15.94:56954) 2024-04-25T12:24:03.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f474b7fe640 1 -- 172.21.15.94:0/4010825835 learned_addr learned my addr 172.21.15.94:0/4010825835 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:03.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f474affd640 1 --2- 172.21.15.94:0/4010825835 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55db11a80190 0x55db11a7cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:03.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f47427fc640 1 --2- 172.21.15.94:0/4010825835 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55db11a80ab0 0x55db11a7d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:03.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f474b7fe640 1 -- 172.21.15.94:0/4010825835 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55db11a80ab0 msgr2=0x55db11a7d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:03.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f474b7fe640 1 --2- 172.21.15.94:0/4010825835 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55db11a80ab0 0x55db11a7d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f474b7fe640 1 -- 172.21.15.94:0/4010825835 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55db11a80190 msgr2=0x55db11a7cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:03.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f474b7fe640 1 --2- 172.21.15.94:0/4010825835 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55db11a80190 0x55db11a7cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f474b7fe640 1 -- 172.21.15.94:0/4010825835 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db1190ef80 con 0x55db11abb5c0 2024-04-25T12:24:03.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f474b7fe640 1 --2- 172.21.15.94:0/4010825835 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11abb5c0 0x55db11a7d6a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4744017040 tx=0x7f4744004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd1739d78b8d877 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:03.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f4729ffb640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-04-25T12:24:03.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f4729ffb640 1 -- 172.21.15.94:0/4010825835 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474402d060 con 0x55db11abb5c0 2024-04-25T12:24:03.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f4729ffb640 1 -- 172.21.15.94:0/4010825835 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f4744015670 con 0x55db11abb5c0 2024-04-25T12:24:03.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f475487b000 1 -- 172.21.15.94:0/4010825835 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f474401a070 con 0x55db11abb5c0 2024-04-25T12:24:03.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f4729ffb640 1 -- 172.21.15.94:0/4010825835 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f4744033050 con 0x55db11abb5c0 2024-04-25T12:24:03.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f475487b000 10 client.4455 fetch_fsmap learned FSMap version 7 2024-04-25T12:24:03.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f475487b000 1 -- 172.21.15.94:0/4010825835 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55db118a2f00 con 0x55db11abb5c0 2024-04-25T12:24:03.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f4729ffb640 1 -- 172.21.15.94:0/4010825835 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f474401a070 con 0x55db11abb5c0 2024-04-25T12:24:03.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f4729ffb640 1 -- 172.21.15.94:0/4010825835 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 7) ==== 4712+0+0 (secure 0 0 0) 0x7f4744036020 con 0x55db11abb5c0 2024-04-25T12:24:03.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f475487b000 10 client.4455 fetch_fsmap finished waiting for FSMap version 7 2024-04-25T12:24:03.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f475487b000 10 client.4455 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T12:24:03.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f475487b000 20 client.4455 populate_metadata read hostname 'smithi094' 2024-04-25T12:24:03.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f475487b000 1 --2- 172.21.15.94:0/4010825835 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x55db11acfd90 0x55db11ad2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f475487b000 4 client.4455 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T12:24:03.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f475487b000 1 -- 172.21.15.94:0/4010825835 --> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db11862bc0 con 0x55db11acfd90 2024-04-25T12:24:03.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f474affd640 1 --2- 172.21.15.94:0/4010825835 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x55db11acfd90 0x55db11ad2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:03.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f4729ffb640 10 client.4455 ms_handle_connect on v2:172.21.15.111:6836/3560813143 2024-04-25T12:24:03.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.663+0000 7f474affd640 1 --2- 172.21.15.94:0/4010825835 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x55db11acfd90 0x55db11ad2180 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2454e3f2712fa42a server_cookie=62a16c191cfbb7a4 in_seq=0 out_seq=0 2024-04-25T12:24:03.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.667+0000 7f4729ffb640 1 -- 172.21.15.94:0/4010825835 <== mds.0 v2:172.21.15.111:6836/3560813143 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55db11862bc0 con 0x55db11acfd90 2024-04-25T12:24:03.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.667+0000 7f4729ffb640 10 client.4455 handle_command_reply: tid=0 2024-04-25T12:24:03.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.667+0000 7f475487b000 1 client.4455 shutdown 2024-04-25T12:24:03.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.667+0000 7f475487b000 1 -- 172.21.15.94:0/4010825835 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11abb5c0 msgr2=0x55db11a7d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:03.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.667+0000 7f475487b000 1 --2- 172.21.15.94:0/4010825835 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11abb5c0 0x55db11a7d6a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4744017040 tx=0x7f4744004ac0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.667+0000 7f475487b000 1 -- 172.21.15.94:0/4010825835 shutdown_connections 2024-04-25T12:24:03.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.667+0000 7f475487b000 1 --2- 172.21.15.94:0/4010825835 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x55db11acfd90 0x55db11ad2180 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.667+0000 7f475487b000 1 --2- 172.21.15.94:0/4010825835 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55db11a80ab0 0x55db11a7d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.667+0000 7f475487b000 1 --2- 172.21.15.94:0/4010825835 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11abb5c0 0x55db11a7d6a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.667+0000 7f4729ffb640 0 client.4455 ms_handle_reset on v2:172.21.15.111:6836/3560813143 2024-04-25T12:24:03.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.667+0000 7f475487b000 1 --2- 172.21.15.94:0/4010825835 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55db11a80190 0x55db11a7cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.667+0000 7f475487b000 1 -- 172.21.15.94:0/4010825835 >> 172.21.15.94:0/4010825835 conn(0x55db11ab7e40 msgr2=0x55db11ab91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:03.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.667+0000 7f475487b000 1 -- 172.21.15.94:0/4010825835 shutdown_connections 2024-04-25T12:24:03.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.667+0000 7f475487b000 1 -- 172.21.15.94:0/4010825835 wait complete. 2024-04-25T12:24:03.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.667+0000 7f475487b000 20 client.4455 trim_cache size 0 max 16384 2024-04-25T12:24:03.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.683+0000 7f475487b000 1 Processor -- start 2024-04-25T12:24:03.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.683+0000 7f475487b000 1 -- start start 2024-04-25T12:24:03.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f475487b000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55db11a80190 0x55db11ab6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f475487b000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55db11a80ab0 0x55db11ab6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f475487b000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11abb5c0 0x55db11b300f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f475487b000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f474c1fb470 con 0x55db11abb5c0 2024-04-25T12:24:03.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f475487b000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f474c1fbb40 con 0x55db11a80ab0 2024-04-25T12:24:03.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f475487b000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x55db118959e0 con 0x55db11a80190 2024-04-25T12:24:03.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f474b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11abb5c0 0x55db11b300f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:03.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f474b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11abb5c0 0x55db11b300f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56962/0 (socket says 172.21.15.94:56962) 2024-04-25T12:24:03.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f474b7fe640 1 -- 172.21.15.94:0/646214109 learned_addr learned my addr 172.21.15.94:0/646214109 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:03.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f47427fc640 1 --2- 172.21.15.94:0/646214109 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55db11a80ab0 0x55db11ab6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:03.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f474affd640 1 --2- 172.21.15.94:0/646214109 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55db11a80190 0x55db11ab6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:03.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f474b7fe640 1 -- 172.21.15.94:0/646214109 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55db11a80190 msgr2=0x55db11ab6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:03.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f474b7fe640 1 --2- 172.21.15.94:0/646214109 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55db11a80190 0x55db11ab6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f474b7fe640 1 -- 172.21.15.94:0/646214109 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55db11a80ab0 msgr2=0x55db11ab6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:03.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f474b7fe640 1 --2- 172.21.15.94:0/646214109 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55db11a80ab0 0x55db11ab6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f474b7fe640 1 -- 172.21.15.94:0/646214109 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db1184fe80 con 0x55db11abb5c0 2024-04-25T12:24:03.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f47427fc640 1 --2- 172.21.15.94:0/646214109 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55db11a80ab0 0x55db11ab6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:03.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f474b7fe640 1 --2- 172.21.15.94:0/646214109 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11abb5c0 0x55db11b300f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4744009730 tx=0x7f4744020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a3c8cd47198aba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:03.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f472bfff640 1 -- 172.21.15.94:0/646214109 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47440148f0 con 0x55db11abb5c0 2024-04-25T12:24:03.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f472bfff640 1 -- 172.21.15.94:0/646214109 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f474401a040 con 0x55db11abb5c0 2024-04-25T12:24:03.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f472bfff640 1 -- 172.21.15.94:0/646214109 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4744014cb0 con 0x55db11abb5c0 2024-04-25T12:24:03.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f475487b000 1 -- 172.21.15.94:0/646214109 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11abb5c0 msgr2=0x55db11b300f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:03.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f475487b000 1 --2- 172.21.15.94:0/646214109 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11abb5c0 0x55db11b300f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4744009730 tx=0x7f4744020040 comp rx=0 tx=0).stop 2024-04-25T12:24:03.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f475487b000 1 -- 172.21.15.94:0/646214109 shutdown_connections 2024-04-25T12:24:03.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f475487b000 1 --2- 172.21.15.94:0/646214109 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11abb5c0 0x55db11b300f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f475487b000 1 --2- 172.21.15.94:0/646214109 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55db11a80ab0 0x55db11ab6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f475487b000 1 --2- 172.21.15.94:0/646214109 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55db11a80190 0x55db11ab6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f475487b000 1 -- 172.21.15.94:0/646214109 >> 172.21.15.94:0/646214109 conn(0x55db11ab7e40 msgr2=0x55db11ad53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:03.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f475487b000 1 -- 172.21.15.94:0/646214109 shutdown_connections 2024-04-25T12:24:03.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f475487b000 1 -- 172.21.15.94:0/646214109 wait complete. 2024-04-25T12:24:03.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f475487b000 1 -- start start 2024-04-25T12:24:03.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f475487b000 1 Processor -- start 2024-04-25T12:24:03.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f475487b000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55db11a80190 0x55db11ad3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f475487b000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11a80ab0 0x55db11b34170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f475487b000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55db11abb5c0 0x55db11b346b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f475487b000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55db118cda50 con 0x55db11a80ab0 2024-04-25T12:24:03.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f475487b000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55db118c8730 con 0x55db11a80190 2024-04-25T12:24:03.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f475487b000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x55db118d6630 con 0x55db11abb5c0 2024-04-25T12:24:03.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f475487b000 10 client.0 _ll_register_callbacks cb 0x7f4744009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:24:03.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f47427fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11a80ab0 0x55db11b34170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:03.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f47427fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11a80ab0 0x55db11b34170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56978/0 (socket says 172.21.15.94:56978) 2024-04-25T12:24:03.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f47427fc640 1 -- 172.21.15.94:0/986654518 learned_addr learned my addr 172.21.15.94:0/986654518 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:03.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f47427fc640 1 -- 172.21.15.94:0/986654518 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55db11abb5c0 msgr2=0x55db11b346b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:03.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f47427fc640 1 --2- 172.21.15.94:0/986654518 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55db11abb5c0 0x55db11b346b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f47427fc640 1 -- 172.21.15.94:0/986654518 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55db11a80190 msgr2=0x55db11ad3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:03.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f47427fc640 1 --2- 172.21.15.94:0/986654518 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55db11a80190 0x55db11ad3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f47427fc640 1 -- 172.21.15.94:0/986654518 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db11891b30 con 0x55db11a80ab0 2024-04-25T12:24:03.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f47427fc640 1 --2- 172.21.15.94:0/986654518 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11a80ab0 0x55db11b34170 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4734056690 tx=0x7f4734011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d769896b483314 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:03.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f4729ffb640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-04-25T12:24:03.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f4729ffb640 1 -- 172.21.15.94:0/986654518 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734082030 con 0x55db11a80ab0 2024-04-25T12:24:03.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f4729ffb640 1 -- 172.21.15.94:0/986654518 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f4734055b50 con 0x55db11a80ab0 2024-04-25T12:24:03.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.687+0000 7f475487b000 1 -- 172.21.15.94:0/986654518 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f474401a040 con 0x55db11a80ab0 2024-04-25T12:24:03.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f4729ffb640 1 -- 172.21.15.94:0/986654518 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f4734075050 con 0x55db11a80ab0 2024-04-25T12:24:03.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f475487b000 10 client.4461 fetch_fsmap learned FSMap version 7 2024-04-25T12:24:03.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f475487b000 1 -- 172.21.15.94:0/986654518 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55db1194a5b0 con 0x55db11a80ab0 2024-04-25T12:24:03.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f4729ffb640 1 -- 172.21.15.94:0/986654518 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f474401a040 con 0x55db11a80ab0 2024-04-25T12:24:03.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f4729ffb640 1 -- 172.21.15.94:0/986654518 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 7) ==== 4712+0+0 (secure 0 0 0) 0x7f4734052450 con 0x55db11a80ab0 2024-04-25T12:24:03.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f475487b000 10 client.4461 fetch_fsmap finished waiting for FSMap version 7 2024-04-25T12:24:03.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f475487b000 10 client.4461 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T12:24:03.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f475487b000 20 client.4461 populate_metadata read hostname 'smithi094' 2024-04-25T12:24:03.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f475487b000 1 --2- 172.21.15.94:0/986654518 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x55db11b32d40 0x55db11b33120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f475487b000 4 client.4461 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T12:24:03.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f475487b000 1 -- 172.21.15.94:0/986654518 --> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] -- command(tid 0: {"prefix": "status"}) -- 0x55db118d6e40 con 0x55db11b32d40 2024-04-25T12:24:03.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f474affd640 1 --2- 172.21.15.94:0/986654518 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x55db11b32d40 0x55db11b33120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:03.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f4729ffb640 10 client.4461 ms_handle_connect on v2:172.21.15.111:6836/3560813143 2024-04-25T12:24:03.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f474affd640 1 --2- 172.21.15.94:0/986654518 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x55db11b32d40 0x55db11b33120 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=450587d3c81bcb08 server_cookie=71a63659e7dd80d6 in_seq=0 out_seq=0 2024-04-25T12:24:03.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f4729ffb640 1 -- 172.21.15.94:0/986654518 <== mds.0 v2:172.21.15.111:6836/3560813143 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55db118d6e40 con 0x55db11b32d40 2024-04-25T12:24:03.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f4729ffb640 10 client.4461 handle_command_reply: tid=0 2024-04-25T12:24:03.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f475487b000 1 client.4461 shutdown 2024-04-25T12:24:03.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f475487b000 1 -- 172.21.15.94:0/986654518 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11a80ab0 msgr2=0x55db11b34170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:03.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f475487b000 1 --2- 172.21.15.94:0/986654518 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11a80ab0 0x55db11b34170 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4734056690 tx=0x7f4734011f60 comp rx=0 tx=0).stop 2024-04-25T12:24:03.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f475487b000 1 -- 172.21.15.94:0/986654518 shutdown_connections 2024-04-25T12:24:03.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f475487b000 1 --2- 172.21.15.94:0/986654518 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x55db11b32d40 0x55db11b33120 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f475487b000 1 --2- 172.21.15.94:0/986654518 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55db11abb5c0 0x55db11b346b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f475487b000 1 --2- 172.21.15.94:0/986654518 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55db11a80ab0 0x55db11b34170 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f4729ffb640 0 client.4461 ms_handle_reset on v2:172.21.15.111:6836/3560813143 2024-04-25T12:24:03.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f475487b000 1 --2- 172.21.15.94:0/986654518 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55db11a80190 0x55db11ad3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f475487b000 1 -- 172.21.15.94:0/986654518 >> 172.21.15.94:0/986654518 conn(0x55db11ab7e40 msgr2=0x55db11ad49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:03.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f475487b000 1 -- 172.21.15.94:0/986654518 shutdown_connections 2024-04-25T12:24:03.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f475487b000 1 -- 172.21.15.94:0/986654518 wait complete. 2024-04-25T12:24:03.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f475487b000 20 client.4461 trim_cache size 0 max 16384 2024-04-25T12:24:03.702 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-25T12:24:03.702 INFO:teuthology.orchestra.run.smithi094.stdout: "cluster_fsid": "7059a9e2-aec4-4b84-b942-caf531e15da3", 2024-04-25T12:24:03.702 INFO:teuthology.orchestra.run.smithi094.stdout: "whoami": 0, 2024-04-25T12:24:03.702 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 4285, 2024-04-25T12:24:03.702 INFO:teuthology.orchestra.run.smithi094.stdout: "want_state": "up:active", 2024-04-25T12:24:03.702 INFO:teuthology.orchestra.run.smithi094.stdout: "state": "up:active", 2024-04-25T12:24:03.702 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs", 2024-04-25T12:24:03.703 INFO:teuthology.orchestra.run.smithi094.stdout: "rank_uptime": 129.50138328599999, 2024-04-25T12:24:03.703 INFO:teuthology.orchestra.run.smithi094.stdout: "mdsmap_epoch": 6, 2024-04-25T12:24:03.703 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch": 28, 2024-04-25T12:24:03.703 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch_barrier": 26, 2024-04-25T12:24:03.703 INFO:teuthology.orchestra.run.smithi094.stdout: "uptime": 136.53250962199999 2024-04-25T12:24:03.703 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-25T12:24:03.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f47516f9640 1 -- 172.21.15.94:0/1691986569 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f472c068380 msgr2=0x7f472c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:03.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f47516f9640 1 --2- 172.21.15.94:0/1691986569 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f472c068380 0x7f472c06a840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f473c0b2000 tx=0x7f473c004740 comp rx=0 tx=0).stop 2024-04-25T12:24:03.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f47516f9640 1 -- 172.21.15.94:0/1691986569 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f474c0c6300 msgr2=0x7f474c15b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:03.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f47516f9640 1 --2- 172.21.15.94:0/1691986569 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f474c0c6300 0x7f474c15b570 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f473400b440 tx=0x7f473400b900 comp rx=0 tx=0).stop 2024-04-25T12:24:03.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f47516f9640 1 -- 172.21.15.94:0/1691986569 shutdown_connections 2024-04-25T12:24:03.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f47516f9640 1 --2- 172.21.15.94:0/1691986569 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f472c068380 0x7f472c06a840 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f47516f9640 1 --2- 172.21.15.94:0/1691986569 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f474c0c9c10 0x7f474c15c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f47516f9640 1 --2- 172.21.15.94:0/1691986569 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f474c0c6300 0x7f474c15b570 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f47516f9640 1 --2- 172.21.15.94:0/1691986569 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f474c0c5f20 0x7f474c1eedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f47516f9640 1 -- 172.21.15.94:0/1691986569 >> 172.21.15.94:0/1691986569 conn(0x7f474c0676a0 msgr2=0x7f474c14fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:03.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f47516f9640 1 -- 172.21.15.94:0/1691986569 shutdown_connections 2024-04-25T12:24:03.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.691+0000 7f47516f9640 1 -- 172.21.15.94:0/1691986569 wait complete. 2024-04-25T12:24:03.712 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T12:24:03.713 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T12:24:03.713 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T12:24:03.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.819+0000 7f5d53a56640 1 Processor -- start 2024-04-25T12:24:03.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.819+0000 7f5d53a56640 1 -- start start 2024-04-25T12:24:03.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d53a56640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f5d4c14fbc0 0x7f5d4c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d53a56640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5d4c074100 0x7f5d4c0c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d53a56640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d4c0c5d70 con 0x7f5d4c14ffa0 2024-04-25T12:24:03.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d53a56640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f5d4c0c6050 con 0x7f5d4c14fbc0 2024-04-25T12:24:03.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d53a56640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f5d4c0c6330 con 0x7f5d4c074100 2024-04-25T12:24:03.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d50ff1640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f5d4c14ffa0 0x7f5d4c0c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41894/0 (socket says 172.21.15.94:41894) 2024-04-25T12:24:03.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d50ff1640 1 -- 172.21.15.94:0/2348494058 learned_addr learned my addr 172.21.15.94:0/2348494058 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:03.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d517f2640 1 --2- 172.21.15.94:0/2348494058 >> v2:172.21.15.111:3300/0 conn(0x7f5d4c14fbc0 0x7f5d4c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:03.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d51ff3640 1 --2- 172.21.15.94:0/2348494058 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5d4c074100 0x7f5d4c0c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:03.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d43fff640 1 -- 172.21.15.94:0/2348494058 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1265235795 0 0) 0x7f5d4c0c5d70 con 0x7f5d4c14ffa0 2024-04-25T12:24:03.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d43fff640 1 -- 172.21.15.94:0/2348494058 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d38003530 con 0x7f5d4c14ffa0 2024-04-25T12:24:03.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d43fff640 1 -- 172.21.15.94:0/2348494058 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3047464670 0 0) 0x7f5d38003530 con 0x7f5d4c14ffa0 2024-04-25T12:24:03.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d43fff640 1 -- 172.21.15.94:0/2348494058 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5d4c074100 msgr2=0x7f5d4c0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:03.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d43fff640 1 --2- 172.21.15.94:0/2348494058 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5d4c074100 0x7f5d4c0c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d43fff640 1 -- 172.21.15.94:0/2348494058 >> v2:172.21.15.111:3300/0 conn(0x7f5d4c14fbc0 msgr2=0x7f5d4c06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:03.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d43fff640 1 --2- 172.21.15.94:0/2348494058 >> v2:172.21.15.111:3300/0 conn(0x7f5d4c14fbc0 0x7f5d4c06f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d43fff640 1 -- 172.21.15.94:0/2348494058 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4c0c6610 con 0x7f5d4c14ffa0 2024-04-25T12:24:03.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d43fff640 1 -- 172.21.15.94:0/2348494058 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7f5d48001a00 con 0x7f5d4c14ffa0 2024-04-25T12:24:03.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d43fff640 1 -- 172.21.15.94:0/2348494058 >> v1:172.21.15.94:6789/0 conn(0x7f5d4c14ffa0 legacy=0x7f5d4c0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:03.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d43fff640 1 --2- 172.21.15.94:0/2348494058 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5d380039c0 0x7f5d38003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d43fff640 1 --2- 172.21.15.94:0/2348494058 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5d4c074100 0x7f5d38004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d43fff640 1 --2- 172.21.15.94:0/2348494058 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d38004d50 0x7f5d380051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d43fff640 1 -- 172.21.15.94:0/2348494058 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c0c6050 con 0x7f5d38004d50 2024-04-25T12:24:03.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d43fff640 1 -- 172.21.15.94:0/2348494058 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c0c6330 con 0x7f5d380039c0 2024-04-25T12:24:03.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d43fff640 1 -- 172.21.15.94:0/2348494058 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f5d3800b9d0 con 0x7f5d4c074100 2024-04-25T12:24:03.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d51ff3640 1 --2- 172.21.15.94:0/2348494058 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d38004d50 0x7f5d380051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:03.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d517f2640 1 --2- 172.21.15.94:0/2348494058 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5d380039c0 0x7f5d38003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:03.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d50ff1640 1 --2- 172.21.15.94:0/2348494058 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5d4c074100 0x7f5d38004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:03.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d51ff3640 1 -- 172.21.15.94:0/2348494058 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5d4c074100 msgr2=0x7f5d38004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:03.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d51ff3640 1 --2- 172.21.15.94:0/2348494058 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5d4c074100 0x7f5d38004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d51ff3640 1 -- 172.21.15.94:0/2348494058 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5d380039c0 msgr2=0x7f5d38003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:03.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d51ff3640 1 --2- 172.21.15.94:0/2348494058 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5d380039c0 0x7f5d38003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.823+0000 7f5d51ff3640 1 -- 172.21.15.94:0/2348494058 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d38003530 con 0x7f5d38004d50 2024-04-25T12:24:03.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d51ff3640 1 --2- 172.21.15.94:0/2348494058 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d38004d50 0x7f5d380051d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009ab0 tx=0x7f5d4401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccb4558173e55e66 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:03.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d43fff640 1 -- 172.21.15.94:0/2348494058 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d440b2070 con 0x7f5d38004d50 2024-04-25T12:24:03.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d43fff640 1 -- 172.21.15.94:0/2348494058 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d440a5600 con 0x7f5d38004d50 2024-04-25T12:24:03.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d43fff640 1 -- 172.21.15.94:0/2348494058 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d440096b0 con 0x7f5d38004d50 2024-04-25T12:24:03.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d53a56640 1 -- 172.21.15.94:0/2348494058 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d38004d50 msgr2=0x7f5d380051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:03.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d53a56640 1 --2- 172.21.15.94:0/2348494058 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d38004d50 0x7f5d380051d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009ab0 tx=0x7f5d4401ca10 comp rx=0 tx=0).stop 2024-04-25T12:24:03.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d51ff3640 1 -- 172.21.15.94:0/2348494058 reap_dead start 2024-04-25T12:24:03.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d53a56640 1 -- 172.21.15.94:0/2348494058 shutdown_connections 2024-04-25T12:24:03.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d53a56640 1 -- 172.21.15.94:0/2348494058 >> 172.21.15.94:0/2348494058 conn(0x7f5d4c06b9d0 msgr2=0x7f5d4c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:03.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d53a56640 1 -- 172.21.15.94:0/2348494058 shutdown_connections 2024-04-25T12:24:03.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d53a56640 1 -- 172.21.15.94:0/2348494058 wait complete. 2024-04-25T12:24:03.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d53a56640 1 Processor -- start 2024-04-25T12:24:03.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d53a56640 1 -- start start 2024-04-25T12:24:03.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d53a56640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5d38004d50 0x7f5d4c1450f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d53a56640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d4c15ccf0 0x7f5d4c142000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d53a56640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5d4c15d150 0x7f5d4c142540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d53a56640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c068350 con 0x7f5d4c15ccf0 2024-04-25T12:24:03.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d53a56640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c0681d0 con 0x7f5d38004d50 2024-04-25T12:24:03.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d53a56640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f5d4c0c8930 con 0x7f5d4c15d150 2024-04-25T12:24:03.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d50ff1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d4c15ccf0 0x7f5d4c142000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:03.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d50ff1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d4c15ccf0 0x7f5d4c142000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56990/0 (socket says 172.21.15.94:56990) 2024-04-25T12:24:03.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d50ff1640 1 -- 172.21.15.94:0/2220779891 learned_addr learned my addr 172.21.15.94:0/2220779891 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:03.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d517f2640 1 --2- 172.21.15.94:0/2220779891 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5d38004d50 0x7f5d4c1450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:03.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d51ff3640 1 --2- 172.21.15.94:0/2220779891 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5d4c15d150 0x7f5d4c142540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:03.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d50ff1640 1 -- 172.21.15.94:0/2220779891 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5d4c15d150 msgr2=0x7f5d4c142540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:03.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d50ff1640 1 --2- 172.21.15.94:0/2220779891 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5d4c15d150 0x7f5d4c142540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d50ff1640 1 -- 172.21.15.94:0/2220779891 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5d38004d50 msgr2=0x7f5d4c1450f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:03.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d50ff1640 1 --2- 172.21.15.94:0/2220779891 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5d38004d50 0x7f5d4c1450f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:03.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d50ff1640 1 -- 172.21.15.94:0/2220779891 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4c14a440 con 0x7f5d4c15ccf0 2024-04-25T12:24:03.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d51ff3640 1 --2- 172.21.15.94:0/2220779891 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5d4c15d150 0x7f5d4c142540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:03.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d50ff1640 1 --2- 172.21.15.94:0/2220779891 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d4c15ccf0 0x7f5d4c142000 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5d48007b30 tx=0x7f5d4800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:03.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d41ffb640 1 -- 172.21.15.94:0/2220779891 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d48004b70 con 0x7f5d4c15ccf0 2024-04-25T12:24:03.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d41ffb640 1 -- 172.21.15.94:0/2220779891 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d48004d10 con 0x7f5d4c15ccf0 2024-04-25T12:24:03.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d53a56640 1 -- 172.21.15.94:0/2220779891 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d4c15ca10 con 0x7f5d4c15ccf0 2024-04-25T12:24:03.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d41ffb640 1 -- 172.21.15.94:0/2220779891 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d48005020 con 0x7f5d4c15ccf0 2024-04-25T12:24:03.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.827+0000 7f5d53a56640 1 -- 172.21.15.94:0/2220779891 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d4c14a990 con 0x7f5d4c15ccf0 2024-04-25T12:24:03.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.831+0000 7f5d53a56640 1 -- 172.21.15.94:0/2220779891 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d4c075df0 con 0x7f5d4c15ccf0 2024-04-25T12:24:03.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.831+0000 7f5d41ffb640 1 -- 172.21.15.94:0/2220779891 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5d4801a030 con 0x7f5d4c15ccf0 2024-04-25T12:24:03.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.831+0000 7f5d41ffb640 1 --2- 172.21.15.94:0/2220779891 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5d300683b0 0x7f5d3006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:03.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.831+0000 7f5d41ffb640 1 -- 172.21.15.94:0/2220779891 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f5d48086d00 con 0x7f5d4c15ccf0 2024-04-25T12:24:03.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.831+0000 7f5d517f2640 1 --2- 172.21.15.94:0/2220779891 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5d300683b0 0x7f5d3006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:03.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.831+0000 7f5d517f2640 1 --2- 172.21.15.94:0/2220779891 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5d300683b0 0x7f5d3006a870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c009b20 tx=0x7f5d3c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:03.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:03.835+0000 7f5d41ffb640 1 -- 172.21.15.94:0/2220779891 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5d48021020 con 0x7f5d4c15ccf0 2024-04-25T12:24:04.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:04.027+0000 7f5d53a56640 1 -- 172.21.15.94:0/2220779891 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5d4c14e360 con 0x7f5d4c15ccf0 2024-04-25T12:24:04.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:04.027+0000 7f5d41ffb640 1 -- 172.21.15.94:0/2220779891 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f5d48056f60 con 0x7f5d4c15ccf0 2024-04-25T12:24:04.033 INFO:teuthology.orchestra.run.smithi094.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T12:24:04.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:04.031+0000 7f5d53a56640 1 -- 172.21.15.94:0/2220779891 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5d300683b0 msgr2=0x7f5d3006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:04.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:04.031+0000 7f5d53a56640 1 --2- 172.21.15.94:0/2220779891 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5d300683b0 0x7f5d3006a870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c009b20 tx=0x7f5d3c008040 comp rx=0 tx=0).stop 2024-04-25T12:24:04.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:04.031+0000 7f5d53a56640 1 -- 172.21.15.94:0/2220779891 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d4c15ccf0 msgr2=0x7f5d4c142000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:04.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:04.031+0000 7f5d53a56640 1 --2- 172.21.15.94:0/2220779891 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d4c15ccf0 0x7f5d4c142000 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5d48007b30 tx=0x7f5d4800e530 comp rx=0 tx=0).stop 2024-04-25T12:24:04.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:04.031+0000 7f5d53a56640 1 -- 172.21.15.94:0/2220779891 shutdown_connections 2024-04-25T12:24:04.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:04.031+0000 7f5d53a56640 1 --2- 172.21.15.94:0/2220779891 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5d300683b0 0x7f5d3006a870 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:04.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:04.031+0000 7f5d53a56640 1 --2- 172.21.15.94:0/2220779891 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5d4c15d150 0x7f5d4c142540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:04.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:04.031+0000 7f5d53a56640 1 --2- 172.21.15.94:0/2220779891 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d4c15ccf0 0x7f5d4c142000 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:04.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:04.031+0000 7f5d53a56640 1 --2- 172.21.15.94:0/2220779891 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5d38004d50 0x7f5d4c1450f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:04.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:04.031+0000 7f5d53a56640 1 -- 172.21.15.94:0/2220779891 >> 172.21.15.94:0/2220779891 conn(0x7f5d4c06b9d0 msgr2=0x7f5d4c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:04.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:04.031+0000 7f5d53a56640 1 -- 172.21.15.94:0/2220779891 shutdown_connections 2024-04-25T12:24:04.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:04.031+0000 7f5d53a56640 1 -- 172.21.15.94:0/2220779891 wait complete. 2024-04-25T12:24:04.051 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T12:24:04.051 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T12:24:04.051 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi094.front.sepia.ceph.com 2024-04-25T12:24:04.051 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-25T12:24:04.051 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T12:24:04.051 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T12:24:04.051 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T12:24:04.051 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T12:24:04.051 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T12:24:04.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:04.052 DEBUG:teuthology.orchestra.run.smithi094:> ip addr 2024-04-25T12:24:04.057 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T12:24:04.058 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T12:24:04.058 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T12:24:04.058 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-04-25T12:24:04.058 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2024-04-25T12:24:04.058 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-04-25T12:24:04.058 INFO:teuthology.orchestra.run.smithi094.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T12:24:04.058 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4c brd ff:ff:ff:ff:ff:ff 2024-04-25T12:24:04.058 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f0 2024-04-25T12:24:04.058 INFO:teuthology.orchestra.run.smithi094.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T12:24:04.058 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4d brd ff:ff:ff:ff:ff:ff 2024-04-25T12:24:04.058 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f1 2024-04-25T12:24:04.058 INFO:teuthology.orchestra.run.smithi094.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T12:24:04.059 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:62 brd ff:ff:ff:ff:ff:ff 2024-04-25T12:24:04.059 INFO:teuthology.orchestra.run.smithi094.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T12:24:04.059 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:63 brd ff:ff:ff:ff:ff:ff 2024-04-25T12:24:04.059 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.21.15.94/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T12:24:04.059 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft 42374sec preferred_lft 42374sec 2024-04-25T12:24:04.059 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::ec4:7aff:fe8f:d763/64 scope link 2024-04-25T12:24:04.059 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-04-25T12:24:04.059 INFO:teuthology.orchestra.run.smithi094.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T12:24:04.059 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 02:42:62:f0:0e:70 brd ff:ff:ff:ff:ff:ff 2024-04-25T12:24:04.059 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T12:24:04.059 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-04-25T12:24:04.060 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T12:24:04.060 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:24:04.060 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-04-25T12:24:04.060 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link add name ceph-brx type bridge 2024-04-25T12:24:04.060 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip addr flush dev ceph-brx 2024-04-25T12:24:04.060 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set ceph-brx up 2024-04-25T12:24:04.060 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T12:24:04.060 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-04-25T12:24:04.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:24:04.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:24:04.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:04.171 DEBUG:teuthology.orchestra.run.smithi094:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T12:24:04.227 INFO:teuthology.orchestra.run.smithi094.stdout:1 2024-04-25T12:24:04.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:04.228 DEBUG:teuthology.orchestra.run.smithi094:> route 2024-04-25T12:24:04.307 INFO:teuthology.orchestra.run.smithi094.stdout:Kernel IP routing table 2024-04-25T12:24:04.307 INFO:teuthology.orchestra.run.smithi094.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T12:24:04.308 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T12:24:04.308 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T12:24:04.308 INFO:teuthology.orchestra.run.smithi094.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T12:24:04.308 INFO:teuthology.orchestra.run.smithi094.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T12:24:04.308 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T12:24:04.308 INFO:teuthology.orchestra.run.smithi094.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T12:24:04.308 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T12:24:04.308 INFO:teuthology.orchestra.run.smithi094.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T12:24:04.308 INFO:teuthology.orchestra.run.smithi094.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T12:24:04.309 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:24:04.309 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-04-25T12:24:04.309 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T12:24:04.309 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T12:24:04.309 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T12:24:04.309 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-04-25T12:24:04.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:24:04.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:24:04.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:04.426 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2024-04-25T12:24:04.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:04.479 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list-id 2024-04-25T12:24:04.526 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:24:04.526 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-04-25T12:24:04.527 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T12:24:04.527 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-25T12:24:04.527 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-04-25T12:24:04.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:24:04.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:24:04.642 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-25T12:24:04.645 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:24:04.646 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-04-25T12:24:04.646 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-25T12:24:04.646 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T12:24:04.646 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-25T12:24:04.646 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-25T12:24:04.646 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-25T12:24:04.646 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-04-25T12:24:04.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:24:04.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:24:04.742 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:24:04.742 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-04-25T12:24:04.742 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set brx.0 up 2024-04-25T12:24:04.742 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T12:24:04.742 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-04-25T12:24:04.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:24:04.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:24:04.854 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-25T12:24:04.854 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T12:24:04.854 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-25T12:24:04.902 INFO:teuthology.orchestra.run.smithi094.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T12:24:04.902 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T12:24:04.902 DEBUG:teuthology.orchestra.run.smithi094:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-25T12:24:04.949 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-04-25T12:24:05.012 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T12:24:05.059 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-04-25T12:24:05.059 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-04-25T12:24:05.059 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-04-25T12:24:05.060 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-04-25T12:24:05.060 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-04-25T12:24:05.060 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-04-25T12:24:05.060 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-04-25T12:24:05.060 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-04-25T12:24:05.060 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-04-25T12:24:05.060 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-04-25T12:24:05.060 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-04-25T12:24:05.060 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-04-25T12:24:05.060 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T12:24:05.060 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-04-25T12:24:05.060 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-04-25T12:24:05.061 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-04-25T12:24:05.061 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-04-25T12:24:05.061 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-04-25T12:24:05.061 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-04-25T12:24:05.061 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-04-25T12:24:05.061 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T12:24:05.061 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-04-25T12:24:05.061 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-04-25T12:24:05.061 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-04-25T12:24:05.061 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T12:24:05.061 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T12:24:05.061 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T12:24:05.061 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T12:24:05.062 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-04-25T12:24:05.062 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T12:24:05.062 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T12:24:05.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:05.063 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-04-25T12:24:05.111 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T12:24:05.112 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-25T12:24:05.155 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-04-25T12:24:05.169 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T12:24:05.219 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-04-25T12:24:05.219 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-04-25T12:24:05.219 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-04-25T12:24:05.219 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-04-25T12:24:05.219 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-04-25T12:24:05.219 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-04-25T12:24:05.219 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-04-25T12:24:05.219 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-04-25T12:24:05.219 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-04-25T12:24:05.219 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-04-25T12:24:05.219 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-04-25T12:24:05.219 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-04-25T12:24:05.219 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T12:24:05.220 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-04-25T12:24:05.220 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-04-25T12:24:05.220 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-04-25T12:24:05.220 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-04-25T12:24:05.220 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-04-25T12:24:05.220 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-04-25T12:24:05.220 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-04-25T12:24:05.220 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T12:24:05.220 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-04-25T12:24:05.220 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-04-25T12:24:05.220 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-04-25T12:24:05.220 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T12:24:05.220 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T12:24:05.220 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T12:24:05.220 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T12:24:05.220 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-04-25T12:24:05.221 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T12:24:05.221 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T12:24:05.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:05.221 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-04-25T12:24:05.237 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi094.stderr:2024-04-25T12:24:05.231+0000 7f3450a88580 -1 init, newargv = 0x55961fd71f50 newargc=15 2024-04-25T12:24:05.237 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi094.stderr:ceph-fuse[32723]: starting ceph client 2024-04-25T12:24:05.246 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi094.stderr:ceph-fuse[32723]: starting fuse 2024-04-25T12:24:06.343 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-04-25T12:24:06.361 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T12:24:06.409 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-04-25T12:24:06.409 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-04-25T12:24:06.409 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-04-25T12:24:06.409 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-04-25T12:24:06.409 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-04-25T12:24:06.409 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-04-25T12:24:06.409 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-04-25T12:24:06.409 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-04-25T12:24:06.409 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-04-25T12:24:06.410 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-04-25T12:24:06.410 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-04-25T12:24:06.410 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-04-25T12:24:06.410 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T12:24:06.410 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-04-25T12:24:06.410 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-04-25T12:24:06.410 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-04-25T12:24:06.410 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-04-25T12:24:06.410 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-04-25T12:24:06.410 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-04-25T12:24:06.410 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-04-25T12:24:06.410 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T12:24:06.410 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-04-25T12:24:06.411 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-04-25T12:24:06.411 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-04-25T12:24:06.411 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T12:24:06.411 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T12:24:06.411 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T12:24:06.411 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T12:24:06.411 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-04-25T12:24:06.411 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T12:24:06.411 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T12:24:06.411 INFO:teuthology.orchestra.run.smithi094.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-25T12:24:06.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:06.412 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-04-25T12:24:06.458 INFO:teuthology.orchestra.run.smithi094.stdout:45 2024-04-25T12:24:06.459 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-25T12:24:06.459 DEBUG:teuthology.orchestra.run.smithi094:> sudo stdin-killer -- python3 -c ' 2024-04-25T12:24:06.459 DEBUG:teuthology.orchestra.run.smithi094:> import glob 2024-04-25T12:24:06.459 DEBUG:teuthology.orchestra.run.smithi094:> import re 2024-04-25T12:24:06.459 DEBUG:teuthology.orchestra.run.smithi094:> import os 2024-04-25T12:24:06.459 DEBUG:teuthology.orchestra.run.smithi094:> import subprocess 2024-04-25T12:24:06.459 DEBUG:teuthology.orchestra.run.smithi094:> 2024-04-25T12:24:06.459 DEBUG:teuthology.orchestra.run.smithi094:> def _find_admin_socket(client_name): 2024-04-25T12:24:06.459 DEBUG:teuthology.orchestra.run.smithi094:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-25T12:24:06.459 DEBUG:teuthology.orchestra.run.smithi094:> files = glob.glob(asok_path) 2024-04-25T12:24:06.459 DEBUG:teuthology.orchestra.run.smithi094:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-25T12:24:06.460 DEBUG:teuthology.orchestra.run.smithi094:> 2024-04-25T12:24:06.460 DEBUG:teuthology.orchestra.run.smithi094:> # Given a non-glob path, it better be there 2024-04-25T12:24:06.460 DEBUG:teuthology.orchestra.run.smithi094:> if "*" not in asok_path: 2024-04-25T12:24:06.460 DEBUG:teuthology.orchestra.run.smithi094:> assert(len(files) == 1) 2024-04-25T12:24:06.460 DEBUG:teuthology.orchestra.run.smithi094:> return files[0] 2024-04-25T12:24:06.460 DEBUG:teuthology.orchestra.run.smithi094:> 2024-04-25T12:24:06.460 DEBUG:teuthology.orchestra.run.smithi094:> for f in files: 2024-04-25T12:24:06.460 DEBUG:teuthology.orchestra.run.smithi094:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T12:24:06.460 DEBUG:teuthology.orchestra.run.smithi094:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T12:24:06.460 DEBUG:teuthology.orchestra.run.smithi094:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T12:24:06.460 DEBUG:teuthology.orchestra.run.smithi094:> contents = proc_f.read() 2024-04-25T12:24:06.460 DEBUG:teuthology.orchestra.run.smithi094:> if mountpoint in contents: 2024-04-25T12:24:06.460 DEBUG:teuthology.orchestra.run.smithi094:> return f 2024-04-25T12:24:06.461 DEBUG:teuthology.orchestra.run.smithi094:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T12:24:06.461 DEBUG:teuthology.orchestra.run.smithi094:> 2024-04-25T12:24:06.461 DEBUG:teuthology.orchestra.run.smithi094:> print(_find_admin_socket("client.admin")) 2024-04-25T12:24:06.461 DEBUG:teuthology.orchestra.run.smithi094:> ' 2024-04-25T12:24:06.581 INFO:teuthology.orchestra.run.smithi094.stdout:/var/run/ceph/ceph-client.admin.32723.asok 2024-04-25T12:24:06.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:24:06.593 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.32723.asok 2024-04-25T12:24:06.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:06.593 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.32723.asok status 2024-04-25T12:24:06.747 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-25T12:24:06.748 INFO:teuthology.orchestra.run.smithi094.stdout: "metadata": { 2024-04-25T12:24:06.748 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_sha1": "d69f13d827952bb07bb9b7973bca14f97d764d6f", 2024-04-25T12:24:06.748 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_version": "ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev)", 2024-04-25T12:24:06.748 INFO:teuthology.orchestra.run.smithi094.stdout: "entity_id": "admin", 2024-04-25T12:24:06.748 INFO:teuthology.orchestra.run.smithi094.stdout: "hostname": "smithi094", 2024-04-25T12:24:06.748 INFO:teuthology.orchestra.run.smithi094.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-25T12:24:06.748 INFO:teuthology.orchestra.run.smithi094.stdout: "pid": "32723", 2024-04-25T12:24:06.748 INFO:teuthology.orchestra.run.smithi094.stdout: "root": "/" 2024-04-25T12:24:06.748 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-25T12:24:06.748 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_count": 0, 2024-04-25T12:24:06.748 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_pinned_count": 0, 2024-04-25T12:24:06.749 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 4473, 2024-04-25T12:24:06.749 INFO:teuthology.orchestra.run.smithi094.stdout: "inst": { 2024-04-25T12:24:06.749 INFO:teuthology.orchestra.run.smithi094.stdout: "name": { 2024-04-25T12:24:06.749 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "client", 2024-04-25T12:24:06.749 INFO:teuthology.orchestra.run.smithi094.stdout: "num": 4473 2024-04-25T12:24:06.749 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-25T12:24:06.749 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-04-25T12:24:06.749 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-04-25T12:24:06.750 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2024-04-25T12:24:06.750 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 1359710462 2024-04-25T12:24:06.750 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-25T12:24:06.750 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-25T12:24:06.750 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-04-25T12:24:06.750 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-04-25T12:24:06.751 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2024-04-25T12:24:06.751 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 1359710462 2024-04-25T12:24:06.751 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-25T12:24:06.751 INFO:teuthology.orchestra.run.smithi094.stdout: "inst_str": "client.4473 192.168.0.1:0/1359710462", 2024-04-25T12:24:06.751 INFO:teuthology.orchestra.run.smithi094.stdout: "addr_str": "192.168.0.1:0/1359710462", 2024-04-25T12:24:06.751 INFO:teuthology.orchestra.run.smithi094.stdout: "inode_count": 1, 2024-04-25T12:24:06.751 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_epoch": 6, 2024-04-25T12:24:06.751 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch": 28, 2024-04-25T12:24:06.751 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch_barrier": 0, 2024-04-25T12:24:06.751 INFO:teuthology.orchestra.run.smithi094.stdout: "blocklisted": false, 2024-04-25T12:24:06.751 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs" 2024-04-25T12:24:06.751 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-25T12:24:06.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:06.761 DEBUG:teuthology.orchestra.run.smithi094:> stat --file-system '--printf=%T 2024-04-25T12:24:06.761 DEBUG:teuthology.orchestra.run.smithi094:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-25T12:24:06.768 INFO:teuthology.orchestra.run.smithi094.stdout:fuseblk 2024-04-25T12:24:06.768 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-25T12:24:06.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:06.768 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-25T12:24:06.826 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-25T12:24:06.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T12:24:07.490 INFO:teuthology.orchestra.run.smithi094.stdout:# file: . 2024-04-25T12:24:07.490 INFO:teuthology.orchestra.run.smithi094.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-25T12:24:07.490 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:07.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:24:07.498 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:24:07.498 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T12:24:07.505 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:24:07.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.671+0000 7f6a15e43640 1 Processor -- start 2024-04-25T12:24:07.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.671+0000 7f6a15e43640 1 -- start start 2024-04-25T12:24:07.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.671+0000 7f6a15e43640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6a1014ffa0 0x7f6a1006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:07.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.671+0000 7f6a15e43640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6a10074100 0x7f6a100c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:07.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.671+0000 7f6a15e43640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a100c5d70 con 0x7f6a1014fbc0 2024-04-25T12:24:07.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.671+0000 7f6a15e43640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f6a100c6050 con 0x7f6a1014ffa0 2024-04-25T12:24:07.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.671+0000 7f6a15e43640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6a100c6330 con 0x7f6a10074100 2024-04-25T12:24:07.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.671+0000 7f6a0f7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f6a1014fbc0 0x7f6a100c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41904/0 (socket says 172.21.15.94:41904) 2024-04-25T12:24:07.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.671+0000 7f6a0effd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6a1014ffa0 0x7f6a1006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:07.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.671+0000 7f6a0f7fe640 1 -- 172.21.15.94:0/1754202458 learned_addr learned my addr 172.21.15.94:0/1754202458 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:07.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.671+0000 7f6a0ffff640 1 --2- 172.21.15.94:0/1754202458 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6a10074100 0x7f6a100c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:07.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.671+0000 7f6a0effd640 1 -- 172.21.15.94:0/1754202458 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6a10074100 msgr2=0x7f6a100c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:07.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.671+0000 7f6a0effd640 1 --2- 172.21.15.94:0/1754202458 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6a10074100 0x7f6a100c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:07.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.671+0000 7f6a0effd640 1 -- 172.21.15.94:0/1754202458 >> v1:172.21.15.94:6789/0 conn(0x7f6a1014fbc0 legacy=0x7f6a100c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:07.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.671+0000 7f6a0effd640 1 -- 172.21.15.94:0/1754202458 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a100c6610 con 0x7f6a1014ffa0 2024-04-25T12:24:07.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.671+0000 7f6a0e7fc640 1 -- 172.21.15.94:0/1754202458 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2319019589 0 0) 0x7f6a100c5d70 con 0x7f6a1014fbc0 2024-04-25T12:24:07.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.671+0000 7f6a0ffff640 1 --2- 172.21.15.94:0/1754202458 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6a10074100 0x7f6a100c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:07.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.675+0000 7f6a0effd640 1 --2- 172.21.15.94:0/1754202458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a1014ffa0 0x7f6a1006f700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6a040097c0 tx=0x7f6a0401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b9f85451d61266 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:07.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.675+0000 7f6a0e7fc640 1 -- 172.21.15.94:0/1754202458 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a040aa620 con 0x7f6a1014ffa0 2024-04-25T12:24:07.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.675+0000 7f6a0e7fc640 1 -- 172.21.15.94:0/1754202458 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a040af070 con 0x7f6a1014ffa0 2024-04-25T12:24:07.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.675+0000 7f6a0e7fc640 1 -- 172.21.15.94:0/1754202458 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a040aa9e0 con 0x7f6a1014ffa0 2024-04-25T12:24:07.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.675+0000 7f6a15e43640 1 -- 172.21.15.94:0/1754202458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a1014ffa0 msgr2=0x7f6a1006f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:07.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.675+0000 7f6a15e43640 1 --2- 172.21.15.94:0/1754202458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a1014ffa0 0x7f6a1006f700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6a040097c0 tx=0x7f6a0401c4a0 comp rx=0 tx=0).stop 2024-04-25T12:24:07.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.675+0000 7f6a15e43640 1 -- 172.21.15.94:0/1754202458 shutdown_connections 2024-04-25T12:24:07.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.675+0000 7f6a15e43640 1 --2- 172.21.15.94:0/1754202458 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6a10074100 0x7f6a100c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:07.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.675+0000 7f6a15e43640 1 --2- 172.21.15.94:0/1754202458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a1014ffa0 0x7f6a1006f700 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:07.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.675+0000 7f6a15e43640 1 -- 172.21.15.94:0/1754202458 >> 172.21.15.94:0/1754202458 conn(0x7f6a1006b9d0 msgr2=0x7f6a1006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:07.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.675+0000 7f6a15e43640 1 -- 172.21.15.94:0/1754202458 shutdown_connections 2024-04-25T12:24:07.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.675+0000 7f6a15e43640 1 -- 172.21.15.94:0/1754202458 wait complete. 2024-04-25T12:24:07.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.675+0000 7f6a15e43640 1 Processor -- start 2024-04-25T12:24:07.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.675+0000 7f6a15e43640 1 -- start start 2024-04-25T12:24:07.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f6a15e43640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6a10074100 0x7f6a101f5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:07.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f6a15e43640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6a1014fbc0 0x7f6a10140f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:07.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f6a15e43640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a1014ffa0 0x7f6a10141450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:07.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f6a15e43640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6a100c8ab0 con 0x7f6a1014ffa0 2024-04-25T12:24:07.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f6a15e43640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6a100c8930 con 0x7f6a10074100 2024-04-25T12:24:07.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f6a15e43640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6a10166090 con 0x7f6a1014fbc0 2024-04-25T12:24:07.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f6a0ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a1014ffa0 0x7f6a10141450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:07.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f6a0ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a1014ffa0 0x7f6a10141450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57016/0 (socket says 172.21.15.94:57016) 2024-04-25T12:24:07.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f6a0ffff640 1 -- 172.21.15.94:0/2540842501 learned_addr learned my addr 172.21.15.94:0/2540842501 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:07.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f6a0effd640 1 --2- 172.21.15.94:0/2540842501 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6a1014fbc0 0x7f6a10140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:07.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f6a0f7fe640 1 --2- 172.21.15.94:0/2540842501 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6a10074100 0x7f6a101f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:07.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f6a0ffff640 1 -- 172.21.15.94:0/2540842501 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6a1014fbc0 msgr2=0x7f6a10140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:07.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f6a0ffff640 1 --2- 172.21.15.94:0/2540842501 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6a1014fbc0 0x7f6a10140f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:07.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f6a0ffff640 1 -- 172.21.15.94:0/2540842501 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6a10074100 msgr2=0x7f6a101f5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:07.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f6a0ffff640 1 --2- 172.21.15.94:0/2540842501 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6a10074100 0x7f6a101f5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:07.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f6a0ffff640 1 -- 172.21.15.94:0/2540842501 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a10159c40 con 0x7f6a1014ffa0 2024-04-25T12:24:07.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f6a0f7fe640 1 --2- 172.21.15.94:0/2540842501 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6a10074100 0x7f6a101f5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:07.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f6a0ffff640 1 --2- 172.21.15.94:0/2540842501 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a1014ffa0 0x7f6a10141450 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800cea0 tx=0x7f6a0800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:07.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f69f7fff640 1 -- 172.21.15.94:0/2540842501 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a08003ba0 con 0x7f6a1014ffa0 2024-04-25T12:24:07.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f69f7fff640 1 -- 172.21.15.94:0/2540842501 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a08003d60 con 0x7f6a1014ffa0 2024-04-25T12:24:07.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f6a15e43640 1 -- 172.21.15.94:0/2540842501 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a101f6050 con 0x7f6a1014ffa0 2024-04-25T12:24:07.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f69f7fff640 1 -- 172.21.15.94:0/2540842501 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0800d880 con 0x7f6a1014ffa0 2024-04-25T12:24:07.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f6a15e43640 1 -- 172.21.15.94:0/2540842501 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a1015c7d0 con 0x7f6a1014ffa0 2024-04-25T12:24:07.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f6a15e43640 1 -- 172.21.15.94:0/2540842501 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a10075df0 con 0x7f6a1014ffa0 2024-04-25T12:24:07.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f69f7fff640 1 -- 172.21.15.94:0/2540842501 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6a0800da20 con 0x7f6a1014ffa0 2024-04-25T12:24:07.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f69f7fff640 1 --2- 172.21.15.94:0/2540842501 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f69fc068380 0x7f69fc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:07.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f69f7fff640 1 -- 172.21.15.94:0/2540842501 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f6a080878b0 con 0x7f6a1014ffa0 2024-04-25T12:24:07.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.679+0000 7f6a0f7fe640 1 --2- 172.21.15.94:0/2540842501 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f69fc068380 0x7f69fc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:07.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.683+0000 7f6a0f7fe640 1 --2- 172.21.15.94:0/2540842501 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f69fc068380 0x7f69fc06a840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6a00000f70 tx=0x7f6a00009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:07.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.687+0000 7f69f7fff640 1 -- 172.21.15.94:0/2540842501 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6a080579f0 con 0x7f6a1014ffa0 2024-04-25T12:24:07.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.847+0000 7f6a15e43640 1 -- 172.21.15.94:0/2540842501 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a1015c9a0 con 0x7f6a1014ffa0 2024-04-25T12:24:07.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.847+0000 7f69f7fff640 1 -- 172.21.15.94:0/2540842501 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18873 (secure 0 0 0) 0x7f6a080572f0 con 0x7f6a1014ffa0 2024-04-25T12:24:07.853 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:07.853 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"7059a9e2-aec4-4b84-b942-caf531e15da3","created":"2024-04-25T12:21:29.118508+0000","modified":"2024-04-25T12:22:34.871807+0000","last_up_change":"2024-04-25T12:21:40.912605+0000","last_in_change":"2024-04-25T12:21:31.372905+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:39.781011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:51.465886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:52.470540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:56.209936+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"640a65ef-0734-468a-a8f5-9ed70cf75c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6809","nonce":2553247564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6811","nonce":2553247564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6815","nonce":2553247564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6813","nonce":2553247564}]},"public_addr":"172.21.15.94:6809/2553247564","cluster_addr":"172.21.15.94:6811/2553247564","heartbeat_back_addr":"172.21.15.94:6815/2553247564","heartbeat_front_addr":"172.21.15.94:6813/2553247564","state":["exists","up"]},{"osd":1,"uuid":"d6e886e6-c8c1-4761-9a4c-abc6961c7c81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6818","nonce":2492806478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6822","nonce":2492806478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6830","nonce":2492806478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6826","nonce":2492806478}]},"public_addr":"172.21.15.94:6818/2492806478","cluster_addr":"172.21.15.94:6822/2492806478","heartbeat_back_addr":"172.21.15.94:6830/2492806478","heartbeat_front_addr":"172.21.15.94:6826/2492806478","state":["exists","up"]},{"osd":2,"uuid":"ba20f409-ed46-43b6-b16d-43dc4622c042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6801","nonce":1485061290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6803","nonce":1485061290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6807","nonce":1485061290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6805","nonce":1485061290}]},"public_addr":"172.21.15.94:6801/1485061290","cluster_addr":"172.21.15.94:6803/1485061290","heartbeat_back_addr":"172.21.15.94:6807/1485061290","heartbeat_front_addr":"172.21.15.94:6805/1485061290","state":["exists","up"]},{"osd":3,"uuid":"85816a2b-3a3f-4ec8-8373-8230d948396f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6819","nonce":1548488434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6823","nonce":1548488434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6829","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6831","nonce":1548488434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6827","nonce":1548488434}]},"public_addr":"172.21.15.94:6819/1548488434","cluster_addr":"172.21.15.94:6823/1548488434","heartbeat_back_addr":"172.21.15.94:6831/1548488434","heartbeat_front_addr":"172.21.15.94:6827/1548488434","state":["exists","up"]},{"osd":4,"uuid":"b4a953b7-01d6-4623-9324-63135fdaf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6811","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6814","nonce":4070977083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6817","nonce":4070977083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6823","nonce":4070977083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6819","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6821","nonce":4070977083}]},"public_addr":"172.21.15.111:6814/4070977083","cluster_addr":"172.21.15.111:6817/4070977083","heartbeat_back_addr":"172.21.15.111:6823/4070977083","heartbeat_front_addr":"172.21.15.111:6821/4070977083","state":["exists","up"]},{"osd":5,"uuid":"c0acc514-427d-41bf-a965-b8463cebf045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6803","nonce":1054925605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6809","nonce":1054925605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6820","nonce":1054925605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6815","nonce":1054925605}]},"public_addr":"172.21.15.111:6803/1054925605","cluster_addr":"172.21.15.111:6809/1054925605","heartbeat_back_addr":"172.21.15.111:6820/1054925605","heartbeat_front_addr":"172.21.15.111:6815/1054925605","state":["exists","up"]},{"osd":6,"uuid":"26ff742f-5a57-44a7-a095-f04d6e87f885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6825","nonce":3619235078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6827","nonce":3619235078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6831","nonce":3619235078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6829","nonce":3619235078}]},"public_addr":"172.21.15.111:6825/3619235078","cluster_addr":"172.21.15.111:6827/3619235078","heartbeat_back_addr":"172.21.15.111:6831/3619235078","heartbeat_front_addr":"172.21.15.111:6829/3619235078","state":["exists","up"]},{"osd":7,"uuid":"9c214cba-693a-4b25-aad7-05a5b0006e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6801","nonce":558758517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6805","nonce":558758517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6813","nonce":558758517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6807","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6808","nonce":558758517}]},"public_addr":"172.21.15.111:6801/558758517","cluster_addr":"172.21.15.111:6805/558758517","heartbeat_back_addr":"172.21.15.111:6813/558758517","heartbeat_front_addr":"172.21.15.111:6808/558758517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.664958+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.853375+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.654455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:37.033852+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.968691+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.856013+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.913496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.848565+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:24:07.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.851+0000 7f6a15e43640 1 -- 172.21.15.94:0/2540842501 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f69fc068380 msgr2=0x7f69fc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:07.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.851+0000 7f6a15e43640 1 --2- 172.21.15.94:0/2540842501 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f69fc068380 0x7f69fc06a840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6a00000f70 tx=0x7f6a00009040 comp rx=0 tx=0).stop 2024-04-25T12:24:07.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.851+0000 7f6a15e43640 1 -- 172.21.15.94:0/2540842501 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a1014ffa0 msgr2=0x7f6a10141450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:07.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.851+0000 7f6a15e43640 1 --2- 172.21.15.94:0/2540842501 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a1014ffa0 0x7f6a10141450 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800cea0 tx=0x7f6a0800cf90 comp rx=0 tx=0).stop 2024-04-25T12:24:07.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.851+0000 7f6a15e43640 1 -- 172.21.15.94:0/2540842501 shutdown_connections 2024-04-25T12:24:07.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.851+0000 7f6a15e43640 1 --2- 172.21.15.94:0/2540842501 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f69fc068380 0x7f69fc06a840 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:07.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.851+0000 7f6a15e43640 1 --2- 172.21.15.94:0/2540842501 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6a1014fbc0 0x7f6a10140f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:07.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.851+0000 7f6a15e43640 1 --2- 172.21.15.94:0/2540842501 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a1014ffa0 0x7f6a10141450 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:07.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.851+0000 7f6a15e43640 1 --2- 172.21.15.94:0/2540842501 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6a10074100 0x7f6a101f5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:07.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.851+0000 7f6a15e43640 1 -- 172.21.15.94:0/2540842501 >> 172.21.15.94:0/2540842501 conn(0x7f6a1006b9d0 msgr2=0x7f6a1014b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:07.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.851+0000 7f6a15e43640 1 -- 172.21.15.94:0/2540842501 shutdown_connections 2024-04-25T12:24:07.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.851+0000 7f6a15e43640 1 -- 172.21.15.94:0/2540842501 wait complete. 2024-04-25T12:24:07.872 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T12:21:39.781011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T12:21:51.465886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T12:21:52.470540+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T12:21:56.209936+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T12:24:07.873 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T12:24:07.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.987+0000 7f15c1a60640 1 Processor -- start 2024-04-25T12:24:07.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.987+0000 7f15c1a60640 1 -- start start 2024-04-25T12:24:07.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.987+0000 7f15c1a60640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f15bc0c8630 0x7f15bc151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:07.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.987+0000 7f15c1a60640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f15bc0c8a70 0x7f15bc152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:07.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.987+0000 7f15c1a60640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15bc15b740 con 0x7f15bc0c8250 2024-04-25T12:24:07.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.987+0000 7f15c1a60640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f15bc0c6490 con 0x7f15bc0c8630 2024-04-25T12:24:07.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.987+0000 7f15c1a60640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f15bc1525c0 con 0x7f15bc0c8a70 2024-04-25T12:24:07.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.987+0000 7f15baffd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f15bc0c8250 0x7f15bc0c39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41920/0 (socket says 172.21.15.94:41920) 2024-04-25T12:24:07.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.987+0000 7f15baffd640 1 -- 172.21.15.94:0/2441729103 learned_addr learned my addr 172.21.15.94:0/2441729103 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:07.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15ba7fc640 1 --2- 172.21.15.94:0/2441729103 >> v2:172.21.15.111:3300/0 conn(0x7f15bc0c8630 0x7f15bc151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:07.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15b9ffb640 1 -- 172.21.15.94:0/2441729103 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1602881815 0 0) 0x7f15bc15b740 con 0x7f15bc0c8250 2024-04-25T12:24:07.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15bb7fe640 1 --2- 172.21.15.94:0/2441729103 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f15bc0c8a70 0x7f15bc152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:07.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15b9ffb640 1 -- 172.21.15.94:0/2441729103 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15a4003530 con 0x7f15bc0c8250 2024-04-25T12:24:07.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15b9ffb640 1 -- 172.21.15.94:0/2441729103 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3806800568 0 0) 0x7f15a4003530 con 0x7f15bc0c8250 2024-04-25T12:24:07.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15b9ffb640 1 -- 172.21.15.94:0/2441729103 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f15bc0c8a70 msgr2=0x7f15bc152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:07.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15b9ffb640 1 --2- 172.21.15.94:0/2441729103 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f15bc0c8a70 0x7f15bc152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:07.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15b9ffb640 1 -- 172.21.15.94:0/2441729103 >> v2:172.21.15.111:3300/0 conn(0x7f15bc0c8630 msgr2=0x7f15bc151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:07.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15b9ffb640 1 --2- 172.21.15.94:0/2441729103 >> v2:172.21.15.111:3300/0 conn(0x7f15bc0c8630 0x7f15bc151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:07.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15b9ffb640 1 -- 172.21.15.94:0/2441729103 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15bc0c40f0 con 0x7f15bc0c8250 2024-04-25T12:24:07.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15b9ffb640 1 -- 172.21.15.94:0/2441729103 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7f15b4001a00 con 0x7f15bc0c8250 2024-04-25T12:24:07.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15ba7fc640 1 --2- 172.21.15.94:0/2441729103 >> v2:172.21.15.111:3300/0 conn(0x7f15bc0c8630 0x7f15bc151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:24:07.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15b9ffb640 1 -- 172.21.15.94:0/2441729103 >> v1:172.21.15.94:6789/0 conn(0x7f15bc0c8250 legacy=0x7f15bc0c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:07.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15b9ffb640 1 --2- 172.21.15.94:0/2441729103 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f15a40039c0 0x7f15a4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:07.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15b9ffb640 1 --2- 172.21.15.94:0/2441729103 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f15bc0c8a70 0x7f15a4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:07.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15b9ffb640 1 --2- 172.21.15.94:0/2441729103 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f15a4004d50 0x7f15a40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:07.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15b9ffb640 1 -- 172.21.15.94:0/2441729103 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f15bc0c6490 con 0x7f15a40039c0 2024-04-25T12:24:07.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15b9ffb640 1 -- 172.21.15.94:0/2441729103 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f15bc1525c0 con 0x7f15a4004d50 2024-04-25T12:24:07.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15b9ffb640 1 -- 172.21.15.94:0/2441729103 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f15a400ba80 con 0x7f15bc0c8a70 2024-04-25T12:24:07.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15baffd640 1 --2- 172.21.15.94:0/2441729103 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f15a40039c0 0x7f15a4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:07.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15bb7fe640 1 --2- 172.21.15.94:0/2441729103 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f15a4004d50 0x7f15a40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:07.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15baffd640 1 -- 172.21.15.94:0/2441729103 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f15bc0c8a70 msgr2=0x7f15a4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:07.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15baffd640 1 --2- 172.21.15.94:0/2441729103 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f15bc0c8a70 0x7f15a4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:07.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15baffd640 1 -- 172.21.15.94:0/2441729103 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f15a4004d50 msgr2=0x7f15a40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:07.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15baffd640 1 --2- 172.21.15.94:0/2441729103 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f15a4004d50 0x7f15a40051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:07.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15baffd640 1 -- 172.21.15.94:0/2441729103 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a4003530 con 0x7f15a40039c0 2024-04-25T12:24:08.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15baffd640 1 --2- 172.21.15.94:0/2441729103 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f15a40039c0 0x7f15a4003de0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f15b400a870 tx=0x7f15b401d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8979f03b232ffa9d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:08.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15b9ffb640 1 -- 172.21.15.94:0/2441729103 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b400a4c0 con 0x7f15a40039c0 2024-04-25T12:24:08.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15b9ffb640 1 -- 172.21.15.94:0/2441729103 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15b40ad630 con 0x7f15a40039c0 2024-04-25T12:24:08.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15b9ffb640 1 -- 172.21.15.94:0/2441729103 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b40ada20 con 0x7f15a40039c0 2024-04-25T12:24:08.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15c1a60640 1 -- 172.21.15.94:0/2441729103 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f15a40039c0 msgr2=0x7f15a4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:08.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15c1a60640 1 --2- 172.21.15.94:0/2441729103 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f15a40039c0 0x7f15a4003de0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f15b400a870 tx=0x7f15b401d3a0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15bb7fe640 1 -- 172.21.15.94:0/2441729103 reap_dead start 2024-04-25T12:24:08.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15c1a60640 1 -- 172.21.15.94:0/2441729103 shutdown_connections 2024-04-25T12:24:08.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15c1a60640 1 -- 172.21.15.94:0/2441729103 >> 172.21.15.94:0/2441729103 conn(0x7f15bc06b9d0 msgr2=0x7f15bc06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:08.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15c1a60640 1 -- 172.21.15.94:0/2441729103 shutdown_connections 2024-04-25T12:24:08.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.991+0000 7f15c1a60640 1 -- 172.21.15.94:0/2441729103 wait complete. 2024-04-25T12:24:08.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.995+0000 7f15c1a60640 1 Processor -- start 2024-04-25T12:24:08.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.995+0000 7f15c1a60640 1 -- start start 2024-04-25T12:24:08.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.995+0000 7f15c1a60640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f15a40039c0 0x7f15bc147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:08.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.995+0000 7f15c1a60640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f15bc0c6fe0 0x7f15bc0c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:08.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.995+0000 7f15c1a60640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f15bc15a0b0 0x7f15bc15a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:08.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.995+0000 7f15c1a60640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f15bc0721a0 con 0x7f15a40039c0 2024-04-25T12:24:08.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.995+0000 7f15c1a60640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f15bc0c58c0 con 0x7f15bc15a0b0 2024-04-25T12:24:08.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.995+0000 7f15c1a60640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f15bc15b400 con 0x7f15bc0c6fe0 2024-04-25T12:24:08.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.995+0000 7f15baffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f15a40039c0 0x7f15bc147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:08.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.995+0000 7f15baffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f15a40039c0 0x7f15bc147720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57046/0 (socket says 172.21.15.94:57046) 2024-04-25T12:24:08.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.995+0000 7f15baffd640 1 -- 172.21.15.94:0/2210300237 learned_addr learned my addr 172.21.15.94:0/2210300237 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:08.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.995+0000 7f15baffd640 1 -- 172.21.15.94:0/2210300237 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f15bc0c6fe0 msgr2=0x7f15bc0c7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:08.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.995+0000 7f15baffd640 1 --2- 172.21.15.94:0/2210300237 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f15bc0c6fe0 0x7f15bc0c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.995+0000 7f15baffd640 1 -- 172.21.15.94:0/2210300237 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f15bc15a0b0 msgr2=0x7f15bc15a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:08.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.995+0000 7f15baffd640 1 --2- 172.21.15.94:0/2210300237 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f15bc15a0b0 0x7f15bc15a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.995+0000 7f15baffd640 1 -- 172.21.15.94:0/2210300237 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15bc074050 con 0x7f15a40039c0 2024-04-25T12:24:08.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.995+0000 7f15baffd640 1 --2- 172.21.15.94:0/2210300237 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f15a40039c0 0x7f15bc147720 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f15b401d1d0 tx=0x7f15a4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:08.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.995+0000 7f15a3fff640 1 -- 172.21.15.94:0/2210300237 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b40ad430 con 0x7f15a40039c0 2024-04-25T12:24:08.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.995+0000 7f15a3fff640 1 -- 172.21.15.94:0/2210300237 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15b4004b70 con 0x7f15a40039c0 2024-04-25T12:24:08.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.995+0000 7f15c1a60640 1 -- 172.21.15.94:0/2210300237 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15bc0c7980 con 0x7f15a40039c0 2024-04-25T12:24:08.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.995+0000 7f15a3fff640 1 -- 172.21.15.94:0/2210300237 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b4001740 con 0x7f15a40039c0 2024-04-25T12:24:08.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.995+0000 7f15c1a60640 1 -- 172.21.15.94:0/2210300237 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15bc072940 con 0x7f15a40039c0 2024-04-25T12:24:08.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.995+0000 7f15c1a60640 1 -- 172.21.15.94:0/2210300237 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15bc075df0 con 0x7f15a40039c0 2024-04-25T12:24:08.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.999+0000 7f15a3fff640 1 -- 172.21.15.94:0/2210300237 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f15b40b5070 con 0x7f15a40039c0 2024-04-25T12:24:08.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.999+0000 7f15a3fff640 1 --2- 172.21.15.94:0/2210300237 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f15a80683b0 0x7f15a806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:08.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.999+0000 7f15a3fff640 1 -- 172.21.15.94:0/2210300237 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f15b4120ee0 con 0x7f15a40039c0 2024-04-25T12:24:08.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.999+0000 7f15ba7fc640 1 --2- 172.21.15.94:0/2210300237 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f15a80683b0 0x7f15a806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:08.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:07.999+0000 7f15ba7fc640 1 --2- 172.21.15.94:0/2210300237 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f15a80683b0 0x7f15a806a870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f15bc14ca10 tx=0x7f15b0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:08.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.003+0000 7f15a3fff640 1 -- 172.21.15.94:0/2210300237 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f15b40bd060 con 0x7f15a40039c0 2024-04-25T12:24:08.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.155+0000 7f15c1a60640 1 -- 172.21.15.94:0/2210300237 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f15bc155840 con 0x7f15a40039c0 2024-04-25T12:24:08.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.155+0000 7f15a3fff640 1 -- 172.21.15.94:0/2210300237 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7f15b40170b0 con 0x7f15a40039c0 2024-04-25T12:24:08.159 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2024-04-25T12:24:08.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.155+0000 7f15c1a60640 1 -- 172.21.15.94:0/2210300237 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f15a80683b0 msgr2=0x7f15a806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:08.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.155+0000 7f15c1a60640 1 --2- 172.21.15.94:0/2210300237 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f15a80683b0 0x7f15a806a870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f15bc14ca10 tx=0x7f15b0008040 comp rx=0 tx=0).stop 2024-04-25T12:24:08.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.155+0000 7f15c1a60640 1 -- 172.21.15.94:0/2210300237 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f15a40039c0 msgr2=0x7f15bc147720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:08.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.155+0000 7f15c1a60640 1 --2- 172.21.15.94:0/2210300237 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f15a40039c0 0x7f15bc147720 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f15b401d1d0 tx=0x7f15a4005840 comp rx=0 tx=0).stop 2024-04-25T12:24:08.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.155+0000 7f15c1a60640 1 -- 172.21.15.94:0/2210300237 shutdown_connections 2024-04-25T12:24:08.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.155+0000 7f15c1a60640 1 --2- 172.21.15.94:0/2210300237 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f15a80683b0 0x7f15a806a870 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.155+0000 7f15c1a60640 1 --2- 172.21.15.94:0/2210300237 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f15bc0c6fe0 0x7f15bc0c7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.155+0000 7f15c1a60640 1 --2- 172.21.15.94:0/2210300237 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f15bc15a0b0 0x7f15bc15a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.155+0000 7f15c1a60640 1 --2- 172.21.15.94:0/2210300237 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f15a40039c0 0x7f15bc147720 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.155+0000 7f15c1a60640 1 -- 172.21.15.94:0/2210300237 >> 172.21.15.94:0/2210300237 conn(0x7f15bc06b9d0 msgr2=0x7f15bc0c42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:08.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.155+0000 7f15c1a60640 1 -- 172.21.15.94:0/2210300237 shutdown_connections 2024-04-25T12:24:08.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.155+0000 7f15c1a60640 1 -- 172.21.15.94:0/2210300237 wait complete. 2024-04-25T12:24:08.176 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T12:24:08.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.295+0000 7f7ec1b90640 1 Processor -- start 2024-04-25T12:24:08.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.295+0000 7f7ec1b90640 1 -- start start 2024-04-25T12:24:08.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7ec1b90640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f7ebc155350 0x7f7ebc0c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:08.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7ec1b90640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7ebc15b0b0 0x7f7ebc15b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:08.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7ec1b90640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ebc15beb0 con 0x7f7ebc0cda50 2024-04-25T12:24:08.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7ec1b90640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f7ebc0cca40 con 0x7f7ebc155350 2024-04-25T12:24:08.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7ec1b90640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f7ebc0ccc90 con 0x7f7ebc15b0b0 2024-04-25T12:24:08.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7ebaffd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f7ebc0cda50 0x7f7ebc0cb7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41922/0 (socket says 172.21.15.94:41922) 2024-04-25T12:24:08.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7ebaffd640 1 -- 172.21.15.94:0/1111542358 learned_addr learned my addr 172.21.15.94:0/1111542358 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:08.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7eba7fc640 1 -- 172.21.15.94:0/1111542358 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4012722148 0 0) 0x7f7ebc15beb0 con 0x7f7ebc0cda50 2024-04-25T12:24:08.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7ebb7fe640 1 --2- 172.21.15.94:0/1111542358 >> v2:172.21.15.111:3300/0 conn(0x7f7ebc155350 0x7f7ebc0c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:08.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7eba7fc640 1 -- 172.21.15.94:0/1111542358 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ea4003530 con 0x7f7ebc0cda50 2024-04-25T12:24:08.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7ebbfff640 1 --2- 172.21.15.94:0/1111542358 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7ebc15b0b0 0x7f7ebc15b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:08.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7eba7fc640 1 -- 172.21.15.94:0/1111542358 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2655848991 0 0) 0x7f7ea4003530 con 0x7f7ebc0cda50 2024-04-25T12:24:08.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7eba7fc640 1 -- 172.21.15.94:0/1111542358 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7ebc15b0b0 msgr2=0x7f7ebc15b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:08.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7eba7fc640 1 --2- 172.21.15.94:0/1111542358 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7ebc15b0b0 0x7f7ebc15b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7eba7fc640 1 -- 172.21.15.94:0/1111542358 >> v2:172.21.15.111:3300/0 conn(0x7f7ebc155350 msgr2=0x7f7ebc0c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:08.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7eba7fc640 1 --2- 172.21.15.94:0/1111542358 >> v2:172.21.15.111:3300/0 conn(0x7f7ebc155350 0x7f7ebc0c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7eba7fc640 1 -- 172.21.15.94:0/1111542358 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ebc0ccf70 con 0x7f7ebc0cda50 2024-04-25T12:24:08.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7eba7fc640 1 -- 172.21.15.94:0/1111542358 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7f7eb0001680 con 0x7f7ebc0cda50 2024-04-25T12:24:08.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7eba7fc640 1 -- 172.21.15.94:0/1111542358 >> v1:172.21.15.94:6789/0 conn(0x7f7ebc0cda50 legacy=0x7f7ebc0cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:08.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7eba7fc640 1 --2- 172.21.15.94:0/1111542358 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ea40039c0 0x7f7ea4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:08.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7eba7fc640 1 --2- 172.21.15.94:0/1111542358 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ea4004810 0x7f7ea4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:08.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7eba7fc640 1 --2- 172.21.15.94:0/1111542358 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7ebc15b0b0 0x7f7ea40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:08.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7eba7fc640 1 -- 172.21.15.94:0/1111542358 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7ebc0cca40 con 0x7f7ea40039c0 2024-04-25T12:24:08.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7eba7fc640 1 -- 172.21.15.94:0/1111542358 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7ebc0ccc90 con 0x7f7ea4004810 2024-04-25T12:24:08.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7eba7fc640 1 -- 172.21.15.94:0/1111542358 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f7ea400bab0 con 0x7f7ebc15b0b0 2024-04-25T12:24:08.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7ebb7fe640 1 --2- 172.21.15.94:0/1111542358 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ea40039c0 0x7f7ea4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:08.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7ebbfff640 1 --2- 172.21.15.94:0/1111542358 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7ebc15b0b0 0x7f7ea40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:08.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7ebaffd640 1 --2- 172.21.15.94:0/1111542358 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ea4004810 0x7f7ea4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:08.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7ebb7fe640 1 -- 172.21.15.94:0/1111542358 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7ebc15b0b0 msgr2=0x7f7ea40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:08.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7ebb7fe640 1 --2- 172.21.15.94:0/1111542358 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7ebc15b0b0 0x7f7ea40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7ebb7fe640 1 -- 172.21.15.94:0/1111542358 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ea4004810 msgr2=0x7f7ea4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:08.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7ebb7fe640 1 --2- 172.21.15.94:0/1111542358 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ea4004810 0x7f7ea4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7ebb7fe640 1 -- 172.21.15.94:0/1111542358 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea4003530 con 0x7f7ea40039c0 2024-04-25T12:24:08.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7ebaffd640 1 --2- 172.21.15.94:0/1111542358 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ea4004810 0x7f7ea4004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:24:08.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.299+0000 7f7ebbfff640 1 --2- 172.21.15.94:0/1111542358 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7ebc15b0b0 0x7f7ea40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:24:08.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ebb7fe640 1 --2- 172.21.15.94:0/1111542358 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ea40039c0 0x7f7ea4003de0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7eac009ae0 tx=0x7f7eac01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71419d6fd0898ecb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:08.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7eba7fc640 1 -- 172.21.15.94:0/1111542358 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac0096b0 con 0x7f7ea40039c0 2024-04-25T12:24:08.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7eba7fc640 1 -- 172.21.15.94:0/1111542358 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eac0a64c0 con 0x7f7ea40039c0 2024-04-25T12:24:08.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7eba7fc640 1 -- 172.21.15.94:0/1111542358 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac0a68b0 con 0x7f7ea40039c0 2024-04-25T12:24:08.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ec1b90640 1 -- 172.21.15.94:0/1111542358 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ea40039c0 msgr2=0x7f7ea4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:08.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ec1b90640 1 --2- 172.21.15.94:0/1111542358 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ea40039c0 0x7f7ea4003de0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7eac009ae0 tx=0x7f7eac01cab0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ebbfff640 1 -- 172.21.15.94:0/1111542358 reap_dead start 2024-04-25T12:24:08.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ec1b90640 1 -- 172.21.15.94:0/1111542358 shutdown_connections 2024-04-25T12:24:08.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ec1b90640 1 -- 172.21.15.94:0/1111542358 >> 172.21.15.94:0/1111542358 conn(0x7f7ebc06cc30 msgr2=0x7f7ebc06d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:08.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ec1b90640 1 -- 172.21.15.94:0/1111542358 shutdown_connections 2024-04-25T12:24:08.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ec1b90640 1 -- 172.21.15.94:0/1111542358 wait complete. 2024-04-25T12:24:08.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ec1b90640 1 Processor -- start 2024-04-25T12:24:08.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ec1b90640 1 -- start start 2024-04-25T12:24:08.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ec1b90640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ea40039c0 0x7f7ebc150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:08.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ec1b90640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7ebc0d01b0 0x7f7ebc1471e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:08.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ec1b90640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ebc151550 0x7f7ebc1e3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:08.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ec1b90640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7ebc155730 con 0x7f7ea40039c0 2024-04-25T12:24:08.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ec1b90640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7ebc0cd530 con 0x7f7ebc151550 2024-04-25T12:24:08.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ec1b90640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f7ebc15e860 con 0x7f7ebc0d01b0 2024-04-25T12:24:08.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ebb7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ea40039c0 0x7f7ebc150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:08.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ebb7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ea40039c0 0x7f7ebc150b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57064/0 (socket says 172.21.15.94:57064) 2024-04-25T12:24:08.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ebb7fe640 1 -- 172.21.15.94:0/2659354481 learned_addr learned my addr 172.21.15.94:0/2659354481 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:08.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ebbfff640 1 --2- 172.21.15.94:0/2659354481 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ebc151550 0x7f7ebc1e3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:08.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ebb7fe640 1 -- 172.21.15.94:0/2659354481 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7ebc0d01b0 msgr2=0x7f7ebc1471e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:08.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ebaffd640 1 --2- 172.21.15.94:0/2659354481 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7ebc0d01b0 0x7f7ebc1471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:08.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ebb7fe640 1 --2- 172.21.15.94:0/2659354481 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7ebc0d01b0 0x7f7ebc1471e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ebb7fe640 1 -- 172.21.15.94:0/2659354481 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ebc151550 msgr2=0x7f7ebc1e3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:08.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ebb7fe640 1 --2- 172.21.15.94:0/2659354481 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ebc151550 0x7f7ebc1e3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ebb7fe640 1 -- 172.21.15.94:0/2659354481 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ebc0d0710 con 0x7f7ea40039c0 2024-04-25T12:24:08.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.303+0000 7f7ebbfff640 1 --2- 172.21.15.94:0/2659354481 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ebc151550 0x7f7ebc1e3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:08.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.307+0000 7f7ebb7fe640 1 --2- 172.21.15.94:0/2659354481 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ea40039c0 0x7f7ebc150b40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0b0040 tx=0x7f7ea4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:08.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.307+0000 7f7ea3fff640 1 -- 172.21.15.94:0/2659354481 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac004020 con 0x7f7ea40039c0 2024-04-25T12:24:08.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.307+0000 7f7ea3fff640 1 -- 172.21.15.94:0/2659354481 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eac0041c0 con 0x7f7ea40039c0 2024-04-25T12:24:08.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.307+0000 7f7ec1b90640 1 -- 172.21.15.94:0/2659354481 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ebc1e56b0 con 0x7f7ea40039c0 2024-04-25T12:24:08.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.307+0000 7f7ea3fff640 1 -- 172.21.15.94:0/2659354481 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac004390 con 0x7f7ea40039c0 2024-04-25T12:24:08.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.307+0000 7f7ec1b90640 1 -- 172.21.15.94:0/2659354481 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ebc0cfe40 con 0x7f7ea40039c0 2024-04-25T12:24:08.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.307+0000 7f7ec1b90640 1 -- 172.21.15.94:0/2659354481 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ebc075df0 con 0x7f7ea40039c0 2024-04-25T12:24:08.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.307+0000 7f7ea3fff640 1 -- 172.21.15.94:0/2659354481 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7eac0c1020 con 0x7f7ea40039c0 2024-04-25T12:24:08.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.307+0000 7f7ea3fff640 1 --2- 172.21.15.94:0/2659354481 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7ea80683b0 0x7f7ea806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:08.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.307+0000 7f7ea3fff640 1 -- 172.21.15.94:0/2659354481 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f7eac1214b0 con 0x7f7ea40039c0 2024-04-25T12:24:08.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.307+0000 7f7ebaffd640 1 --2- 172.21.15.94:0/2659354481 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7ea80683b0 0x7f7ea806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:08.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.307+0000 7f7ebaffd640 1 --2- 172.21.15.94:0/2659354481 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7ea80683b0 0x7f7ea806a870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0001c40 tx=0x7f7eb0001bb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:08.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.311+0000 7f7ea3fff640 1 -- 172.21.15.94:0/2659354481 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7eac0167c0 con 0x7f7ea40039c0 2024-04-25T12:24:08.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.471+0000 7f7ec1b90640 1 -- 172.21.15.94:0/2659354481 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7ebc0c6ec0 con 0x7f7ea40039c0 2024-04-25T12:24:08.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.475+0000 7f7ea3fff640 1 -- 172.21.15.94:0/2659354481 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7f7eac0f1710 con 0x7f7ea40039c0 2024-04-25T12:24:08.478 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2024-04-25T12:24:08.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.475+0000 7f7ec1b90640 1 -- 172.21.15.94:0/2659354481 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7ea80683b0 msgr2=0x7f7ea806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:08.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.475+0000 7f7ec1b90640 1 --2- 172.21.15.94:0/2659354481 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7ea80683b0 0x7f7ea806a870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0001c40 tx=0x7f7eb0001bb0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.475+0000 7f7ec1b90640 1 -- 172.21.15.94:0/2659354481 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ea40039c0 msgr2=0x7f7ebc150b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:08.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.475+0000 7f7ec1b90640 1 --2- 172.21.15.94:0/2659354481 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ea40039c0 0x7f7ebc150b40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0b0040 tx=0x7f7ea4005840 comp rx=0 tx=0).stop 2024-04-25T12:24:08.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.475+0000 7f7ec1b90640 1 -- 172.21.15.94:0/2659354481 shutdown_connections 2024-04-25T12:24:08.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.475+0000 7f7ec1b90640 1 --2- 172.21.15.94:0/2659354481 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7ea80683b0 0x7f7ea806a870 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.475+0000 7f7ec1b90640 1 --2- 172.21.15.94:0/2659354481 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7ebc0d01b0 0x7f7ebc1471e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.475+0000 7f7ec1b90640 1 --2- 172.21.15.94:0/2659354481 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ebc151550 0x7f7ebc1e3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.475+0000 7f7ec1b90640 1 --2- 172.21.15.94:0/2659354481 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ea40039c0 0x7f7ebc150b40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.475+0000 7f7ec1b90640 1 -- 172.21.15.94:0/2659354481 >> 172.21.15.94:0/2659354481 conn(0x7f7ebc06cc30 msgr2=0x7f7ebc159950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:08.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.475+0000 7f7ec1b90640 1 -- 172.21.15.94:0/2659354481 shutdown_connections 2024-04-25T12:24:08.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.475+0000 7f7ec1b90640 1 -- 172.21.15.94:0/2659354481 wait complete. 2024-04-25T12:24:08.496 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T12:24:08.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.615+0000 7fb57dc3d640 1 Processor -- start 2024-04-25T12:24:08.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.615+0000 7fb57dc3d640 1 -- start start 2024-04-25T12:24:08.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.615+0000 7fb57dc3d640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb5780c55c0 0x7fb5780cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:08.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.615+0000 7fb57dc3d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb578163570 0x7fb5780cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:08.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.615+0000 7fb57dc3d640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb578073a50 con 0x7fb5781597e0 2024-04-25T12:24:08.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.615+0000 7fb57dc3d640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fb578073d30 con 0x7fb578163570 2024-04-25T12:24:08.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.615+0000 7fb57dc3d640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fb578162a90 con 0x7fb5780c55c0 2024-04-25T12:24:08.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.615+0000 7fb5777fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fb5781597e0 0x7fb57815f3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41924/0 (socket says 172.21.15.94:41924) 2024-04-25T12:24:08.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.615+0000 7fb577fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb578163570 0x7fb5780cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:08.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.615+0000 7fb5777fe640 1 -- 172.21.15.94:0/175186170 learned_addr learned my addr 172.21.15.94:0/175186170 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:08.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.615+0000 7fb576ffd640 1 --2- 172.21.15.94:0/175186170 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb5780c55c0 0x7fb5780cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:08.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.615+0000 7fb5767fc640 1 -- 172.21.15.94:0/175186170 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2047029148 0 0) 0x7fb578073a50 con 0x7fb5781597e0 2024-04-25T12:24:08.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.615+0000 7fb5767fc640 1 -- 172.21.15.94:0/175186170 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb560003530 con 0x7fb5781597e0 2024-04-25T12:24:08.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.615+0000 7fb577fff640 1 -- 172.21.15.94:0/175186170 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb5780c55c0 msgr2=0x7fb5780cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:08.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.615+0000 7fb577fff640 1 --2- 172.21.15.94:0/175186170 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb5780c55c0 0x7fb5780cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.615+0000 7fb577fff640 1 -- 172.21.15.94:0/175186170 >> v1:172.21.15.94:6789/0 conn(0x7fb5781597e0 legacy=0x7fb57815f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:08.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.615+0000 7fb577fff640 1 -- 172.21.15.94:0/175186170 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb578162d70 con 0x7fb578163570 2024-04-25T12:24:08.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb577fff640 1 --2- 172.21.15.94:0/175186170 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb578163570 0x7fb5780cb860 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb570009d90 tx=0x7fb57001f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70f58388497d6eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:08.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb5767fc640 1 -- 172.21.15.94:0/175186170 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5700b4070 con 0x7fb578163570 2024-04-25T12:24:08.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb5767fc640 1 -- 172.21.15.94:0/175186170 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5700af600 con 0x7fb578163570 2024-04-25T12:24:08.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb5767fc640 1 -- 172.21.15.94:0/175186170 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5700af9b0 con 0x7fb578163570 2024-04-25T12:24:08.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb57dc3d640 1 -- 172.21.15.94:0/175186170 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb578163570 msgr2=0x7fb5780cb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:08.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb57dc3d640 1 --2- 172.21.15.94:0/175186170 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb578163570 0x7fb5780cb860 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb570009d90 tx=0x7fb57001f150 comp rx=0 tx=0).stop 2024-04-25T12:24:08.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb57dc3d640 1 -- 172.21.15.94:0/175186170 shutdown_connections 2024-04-25T12:24:08.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb57dc3d640 1 --2- 172.21.15.94:0/175186170 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb578163570 0x7fb5780cb860 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb57dc3d640 1 --2- 172.21.15.94:0/175186170 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb5780c55c0 0x7fb5780cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb57dc3d640 1 -- 172.21.15.94:0/175186170 >> 172.21.15.94:0/175186170 conn(0x7fb5780676a0 msgr2=0x7fb578067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:08.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb57dc3d640 1 -- 172.21.15.94:0/175186170 shutdown_connections 2024-04-25T12:24:08.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb57dc3d640 1 -- 172.21.15.94:0/175186170 wait complete. 2024-04-25T12:24:08.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb57dc3d640 1 Processor -- start 2024-04-25T12:24:08.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb57dc3d640 1 -- start start 2024-04-25T12:24:08.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb57dc3d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb5780c55c0 0x7fb5780cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:08.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb57dc3d640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb5781597e0 0x7fb5780cd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:08.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb57dc3d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb578163570 0x7fb57814e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:08.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb57dc3d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb57806d560 con 0x7fb578163570 2024-04-25T12:24:08.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb57dc3d640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb578074130 con 0x7fb5780c55c0 2024-04-25T12:24:08.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb57dc3d640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fb578160b40 con 0x7fb5781597e0 2024-04-25T12:24:08.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb577fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb578163570 0x7fb57814e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:08.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb577fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb578163570 0x7fb57814e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57070/0 (socket says 172.21.15.94:57070) 2024-04-25T12:24:08.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb577fff640 1 -- 172.21.15.94:0/3969600674 learned_addr learned my addr 172.21.15.94:0/3969600674 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:08.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb5777fe640 1 --2- 172.21.15.94:0/3969600674 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb5780c55c0 0x7fb5780cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:08.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb577fff640 1 -- 172.21.15.94:0/3969600674 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb5781597e0 msgr2=0x7fb5780cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:08.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb577fff640 1 --2- 172.21.15.94:0/3969600674 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb5781597e0 0x7fb5780cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb577fff640 1 -- 172.21.15.94:0/3969600674 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb5780c55c0 msgr2=0x7fb5780cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:08.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.619+0000 7fb577fff640 1 --2- 172.21.15.94:0/3969600674 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb5780c55c0 0x7fb5780cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.623+0000 7fb577fff640 1 -- 172.21.15.94:0/3969600674 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5781f53e0 con 0x7fb578163570 2024-04-25T12:24:08.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.623+0000 7fb577fff640 1 --2- 172.21.15.94:0/3969600674 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb578163570 0x7fb57814e430 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb57001cd80 tx=0x7fb57001bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:08.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.623+0000 7fb55ffff640 1 -- 172.21.15.94:0/3969600674 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5700b4040 con 0x7fb578163570 2024-04-25T12:24:08.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.623+0000 7fb55ffff640 1 -- 172.21.15.94:0/3969600674 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5700c1070 con 0x7fb578163570 2024-04-25T12:24:08.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.623+0000 7fb57dc3d640 1 -- 172.21.15.94:0/3969600674 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5781f56c0 con 0x7fb578163570 2024-04-25T12:24:08.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.623+0000 7fb55ffff640 1 -- 172.21.15.94:0/3969600674 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb570009450 con 0x7fb578163570 2024-04-25T12:24:08.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.623+0000 7fb57dc3d640 1 -- 172.21.15.94:0/3969600674 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5781f5c80 con 0x7fb578163570 2024-04-25T12:24:08.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.623+0000 7fb57dc3d640 1 -- 172.21.15.94:0/3969600674 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb578075df0 con 0x7fb578163570 2024-04-25T12:24:08.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.623+0000 7fb55ffff640 1 -- 172.21.15.94:0/3969600674 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb5700ba6b0 con 0x7fb578163570 2024-04-25T12:24:08.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.623+0000 7fb55ffff640 1 --2- 172.21.15.94:0/3969600674 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fb564068380 0x7fb56406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:08.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.623+0000 7fb55ffff640 1 -- 172.21.15.94:0/3969600674 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fb570125660 con 0x7fb578163570 2024-04-25T12:24:08.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.623+0000 7fb5777fe640 1 --2- 172.21.15.94:0/3969600674 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fb564068380 0x7fb56406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:08.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.623+0000 7fb5777fe640 1 --2- 172.21.15.94:0/3969600674 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fb564068380 0x7fb56406a840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb56c007fd0 tx=0x7fb56c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:08.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.627+0000 7fb55ffff640 1 -- 172.21.15.94:0/3969600674 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb570018cb0 con 0x7fb578163570 2024-04-25T12:24:08.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.787+0000 7fb57dc3d640 1 -- 172.21.15.94:0/3969600674 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb5781568d0 con 0x7fb578163570 2024-04-25T12:24:08.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.787+0000 7fb55ffff640 1 -- 172.21.15.94:0/3969600674 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7fb5700f5950 con 0x7fb578163570 2024-04-25T12:24:08.793 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2024-04-25T12:24:08.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.791+0000 7fb57dc3d640 1 -- 172.21.15.94:0/3969600674 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fb564068380 msgr2=0x7fb56406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:08.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.791+0000 7fb57dc3d640 1 --2- 172.21.15.94:0/3969600674 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fb564068380 0x7fb56406a840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb56c007fd0 tx=0x7fb56c009040 comp rx=0 tx=0).stop 2024-04-25T12:24:08.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.791+0000 7fb57dc3d640 1 -- 172.21.15.94:0/3969600674 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb578163570 msgr2=0x7fb57814e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:08.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.791+0000 7fb57dc3d640 1 --2- 172.21.15.94:0/3969600674 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb578163570 0x7fb57814e430 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb57001cd80 tx=0x7fb57001bef0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.791+0000 7fb57dc3d640 1 -- 172.21.15.94:0/3969600674 shutdown_connections 2024-04-25T12:24:08.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.791+0000 7fb57dc3d640 1 --2- 172.21.15.94:0/3969600674 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fb564068380 0x7fb56406a840 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.791+0000 7fb57dc3d640 1 --2- 172.21.15.94:0/3969600674 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb5781597e0 0x7fb5780cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.791+0000 7fb57dc3d640 1 --2- 172.21.15.94:0/3969600674 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb578163570 0x7fb57814e430 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.791+0000 7fb57dc3d640 1 --2- 172.21.15.94:0/3969600674 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb5780c55c0 0x7fb5780cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.791+0000 7fb57dc3d640 1 -- 172.21.15.94:0/3969600674 >> 172.21.15.94:0/3969600674 conn(0x7fb5780676a0 msgr2=0x7fb578151c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:08.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.791+0000 7fb57dc3d640 1 -- 172.21.15.94:0/3969600674 shutdown_connections 2024-04-25T12:24:08.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.791+0000 7fb57dc3d640 1 -- 172.21.15.94:0/3969600674 wait complete. 2024-04-25T12:24:08.812 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T12:24:08.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.923+0000 7f7071396640 1 Processor -- start 2024-04-25T12:24:08.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.923+0000 7f7071396640 1 -- start start 2024-04-25T12:24:08.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.923+0000 7f7071396640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f706c155350 0x7f706c0c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:08.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.923+0000 7f7071396640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f706c0cda50 0x7f706c0cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:08.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.923+0000 7f7071396640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f706c0cbcf0 0x7f706c15b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:08.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.923+0000 7f7071396640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f706c0cca40 con 0x7f706c0cbcf0 2024-04-25T12:24:08.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.923+0000 7f7071396640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f706c15beb0 con 0x7f706c155350 2024-04-25T12:24:08.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.923+0000 7f7071396640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f706c0ccc90 con 0x7f706c0cda50 2024-04-25T12:24:08.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.927+0000 7f706b7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f706c0cbcf0 0x7f706c15b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:08.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.927+0000 7f706b7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f706c0cbcf0 0x7f706c15b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57076/0 (socket says 172.21.15.94:57076) 2024-04-25T12:24:08.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.927+0000 7f706b7fe640 1 -- 172.21.15.94:0/3537626082 learned_addr learned my addr 172.21.15.94:0/3537626082 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:08.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.927+0000 7f706affd640 1 --2- 172.21.15.94:0/3537626082 >> v2:172.21.15.111:3300/0 conn(0x7f706c155350 0x7f706c0c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:08.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.927+0000 7f706a7fc640 1 --2- 172.21.15.94:0/3537626082 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f706c0cda50 0x7f706c0cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:08.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.927+0000 7f706b7fe640 1 -- 172.21.15.94:0/3537626082 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f706c0cda50 msgr2=0x7f706c0cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:08.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.927+0000 7f706b7fe640 1 --2- 172.21.15.94:0/3537626082 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f706c0cda50 0x7f706c0cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.927+0000 7f706b7fe640 1 -- 172.21.15.94:0/3537626082 >> v2:172.21.15.111:3300/0 conn(0x7f706c155350 msgr2=0x7f706c0c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:08.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.927+0000 7f706b7fe640 1 --2- 172.21.15.94:0/3537626082 >> v2:172.21.15.111:3300/0 conn(0x7f706c155350 0x7f706c0c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.927+0000 7f706b7fe640 1 -- 172.21.15.94:0/3537626082 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f706c0ccf70 con 0x7f706c0cbcf0 2024-04-25T12:24:08.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.927+0000 7f706b7fe640 1 --2- 172.21.15.94:0/3537626082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f706c0cbcf0 0x7f706c15b0b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f706c0d1a60 tx=0x7f706401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d0c442f6cad4b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:08.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.927+0000 7f7069ffb640 1 -- 172.21.15.94:0/3537626082 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70640b4070 con 0x7f706c0cbcf0 2024-04-25T12:24:08.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.927+0000 7f7069ffb640 1 -- 172.21.15.94:0/3537626082 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70640af400 con 0x7f706c0cbcf0 2024-04-25T12:24:08.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.927+0000 7f7069ffb640 1 -- 172.21.15.94:0/3537626082 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70640af7d0 con 0x7f706c0cbcf0 2024-04-25T12:24:08.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.927+0000 7f7071396640 1 -- 172.21.15.94:0/3537626082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f706c0cbcf0 msgr2=0x7f706c15b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:08.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.927+0000 7f7071396640 1 --2- 172.21.15.94:0/3537626082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f706c0cbcf0 0x7f706c15b0b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f706c0d1a60 tx=0x7f706401f1e0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.927+0000 7f7071396640 1 -- 172.21.15.94:0/3537626082 shutdown_connections 2024-04-25T12:24:08.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.927+0000 7f7071396640 1 --2- 172.21.15.94:0/3537626082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f706c0cbcf0 0x7f706c15b0b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.927+0000 7f7071396640 1 --2- 172.21.15.94:0/3537626082 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f706c0cda50 0x7f706c0cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.927+0000 7f7071396640 1 --2- 172.21.15.94:0/3537626082 >> v2:172.21.15.111:3300/0 conn(0x7f706c155350 0x7f706c0c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.927+0000 7f7071396640 1 -- 172.21.15.94:0/3537626082 >> 172.21.15.94:0/3537626082 conn(0x7f706c06cc30 msgr2=0x7f706c06d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:08.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.927+0000 7f7071396640 1 -- 172.21.15.94:0/3537626082 shutdown_connections 2024-04-25T12:24:08.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.927+0000 7f7071396640 1 -- 172.21.15.94:0/3537626082 wait complete. 2024-04-25T12:24:08.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f7071396640 1 Processor -- start 2024-04-25T12:24:08.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f7071396640 1 -- start start 2024-04-25T12:24:08.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f7071396640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f706c0cbcf0 0x7f706c159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:08.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f7071396640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f706c0cda50 0x7f706c0c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:08.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f7071396640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f706c155350 0x7f706c15a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:08.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f7071396640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f706c155730 con 0x7f706c0cda50 2024-04-25T12:24:08.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f7071396640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f706c0cd530 con 0x7f706c155350 2024-04-25T12:24:08.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f7071396640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f706c15e860 con 0x7f706c0cbcf0 2024-04-25T12:24:08.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f706a7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f706c0cda50 0x7f706c0c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:08.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f706a7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f706c0cda50 0x7f706c0c6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57082/0 (socket says 172.21.15.94:57082) 2024-04-25T12:24:08.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f706a7fc640 1 -- 172.21.15.94:0/2589705900 learned_addr learned my addr 172.21.15.94:0/2589705900 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:08.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f706affd640 1 --2- 172.21.15.94:0/2589705900 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f706c0cbcf0 0x7f706c159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:08.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f706b7fe640 1 --2- 172.21.15.94:0/2589705900 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f706c155350 0x7f706c15a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:08.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f706a7fc640 1 -- 172.21.15.94:0/2589705900 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f706c0cbcf0 msgr2=0x7f706c159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:08.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f706a7fc640 1 --2- 172.21.15.94:0/2589705900 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f706c0cbcf0 0x7f706c159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f706a7fc640 1 -- 172.21.15.94:0/2589705900 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f706c155350 msgr2=0x7f706c15a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:08.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f706a7fc640 1 --2- 172.21.15.94:0/2589705900 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f706c155350 0x7f706c15a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:08.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f706a7fc640 1 -- 172.21.15.94:0/2589705900 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f706c15a1b0 con 0x7f706c0cda50 2024-04-25T12:24:08.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f706affd640 1 --2- 172.21.15.94:0/2589705900 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f706c0cbcf0 0x7f706c159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:08.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f706b7fe640 1 --2- 172.21.15.94:0/2589705900 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f706c155350 0x7f706c15a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:08.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f706a7fc640 1 --2- 172.21.15.94:0/2589705900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f706c0cda50 0x7f706c0c6d60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f706000d830 tx=0x7f706000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:08.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f70537fe640 1 -- 172.21.15.94:0/2589705900 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7060018020 con 0x7f706c0cda50 2024-04-25T12:24:08.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f70537fe640 1 -- 172.21.15.94:0/2589705900 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70600096a0 con 0x7f706c0cda50 2024-04-25T12:24:08.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f7071396640 1 -- 172.21.15.94:0/2589705900 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f706c1f1b30 con 0x7f706c0cda50 2024-04-25T12:24:08.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f70537fe640 1 -- 172.21.15.94:0/2589705900 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7060009a50 con 0x7f706c0cda50 2024-04-25T12:24:08.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f7071396640 1 -- 172.21.15.94:0/2589705900 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f706c1f4350 con 0x7f706c0cda50 2024-04-25T12:24:08.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.931+0000 7f7071396640 1 -- 172.21.15.94:0/2589705900 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f706c075df0 con 0x7f706c0cda50 2024-04-25T12:24:08.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.935+0000 7f70537fe640 1 -- 172.21.15.94:0/2589705900 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f706001b020 con 0x7f706c0cda50 2024-04-25T12:24:08.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.935+0000 7f70537fe640 1 --2- 172.21.15.94:0/2589705900 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f70580683b0 0x7f705806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:08.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.935+0000 7f70537fe640 1 -- 172.21.15.94:0/2589705900 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f7060087540 con 0x7f706c0cda50 2024-04-25T12:24:08.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.935+0000 7f706affd640 1 --2- 172.21.15.94:0/2589705900 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f70580683b0 0x7f705806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:08.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.935+0000 7f706affd640 1 --2- 172.21.15.94:0/2589705900 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f70580683b0 0x7f705806a870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f705c0097a0 tx=0x7f705c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:08.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:08.939+0000 7f70537fe640 1 -- 172.21.15.94:0/2589705900 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7060022020 con 0x7f706c0cda50 2024-04-25T12:24:09.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.087+0000 7f7071396640 1 -- 172.21.15.94:0/2589705900 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f706c0cc610 con 0x7f706c0cda50 2024-04-25T12:24:09.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.087+0000 7f70537fe640 1 -- 172.21.15.94:0/2589705900 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7f7060011340 con 0x7f706c0cda50 2024-04-25T12:24:09.094 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2024-04-25T12:24:09.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.091+0000 7f7071396640 1 -- 172.21.15.94:0/2589705900 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f70580683b0 msgr2=0x7f705806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:09.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.091+0000 7f7071396640 1 --2- 172.21.15.94:0/2589705900 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f70580683b0 0x7f705806a870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f705c0097a0 tx=0x7f705c008040 comp rx=0 tx=0).stop 2024-04-25T12:24:09.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.091+0000 7f7071396640 1 -- 172.21.15.94:0/2589705900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f706c0cda50 msgr2=0x7f706c0c6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:09.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.091+0000 7f7071396640 1 --2- 172.21.15.94:0/2589705900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f706c0cda50 0x7f706c0c6d60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f706000d830 tx=0x7f706000dcf0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.091+0000 7f7071396640 1 -- 172.21.15.94:0/2589705900 shutdown_connections 2024-04-25T12:24:09.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.091+0000 7f7071396640 1 --2- 172.21.15.94:0/2589705900 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f70580683b0 0x7f705806a870 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.091+0000 7f7071396640 1 --2- 172.21.15.94:0/2589705900 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f706c155350 0x7f706c15a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.091+0000 7f7071396640 1 --2- 172.21.15.94:0/2589705900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f706c0cda50 0x7f706c0c6d60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.091+0000 7f7071396640 1 --2- 172.21.15.94:0/2589705900 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f706c0cbcf0 0x7f706c159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.091+0000 7f7071396640 1 -- 172.21.15.94:0/2589705900 >> 172.21.15.94:0/2589705900 conn(0x7f706c06cc30 msgr2=0x7f706c15eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:09.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.091+0000 7f7071396640 1 -- 172.21.15.94:0/2589705900 shutdown_connections 2024-04-25T12:24:09.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.091+0000 7f7071396640 1 -- 172.21.15.94:0/2589705900 wait complete. 2024-04-25T12:24:09.112 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T12:24:09.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.227+0000 7f87d0845640 1 Processor -- start 2024-04-25T12:24:09.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.227+0000 7f87d0845640 1 -- start start 2024-04-25T12:24:09.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.227+0000 7f87d0845640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f87cc0723d0 0x7f87cc0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:09.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.227+0000 7f87d0845640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f87cc067b00 0x7f87cc152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:09.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.227+0000 7f87d0845640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f87cc153220 0x7f87cc06ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:09.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.227+0000 7f87d0845640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f87cc153660 con 0x7f87cc067b00 2024-04-25T12:24:09.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.227+0000 7f87d0845640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f87cc0742d0 con 0x7f87cc0723d0 2024-04-25T12:24:09.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.227+0000 7f87d0845640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f87cc074550 con 0x7f87cc153220 2024-04-25T12:24:09.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.227+0000 7f87c3fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f87cc067b00 0x7f87cc152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:09.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.227+0000 7f87c3fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f87cc067b00 0x7f87cc152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57084/0 (socket says 172.21.15.94:57084) 2024-04-25T12:24:09.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.227+0000 7f87c3fff640 1 -- 172.21.15.94:0/120229178 learned_addr learned my addr 172.21.15.94:0/120229178 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:09.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.227+0000 7f87ca59c640 1 --2- 172.21.15.94:0/120229178 >> v2:172.21.15.111:3300/0 conn(0x7f87cc0723d0 0x7f87cc0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:09.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.227+0000 7f87cad9d640 1 --2- 172.21.15.94:0/120229178 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f87cc153220 0x7f87cc06ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:09.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.227+0000 7f87c3fff640 1 -- 172.21.15.94:0/120229178 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f87cc153220 msgr2=0x7f87cc06ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:09.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.227+0000 7f87c3fff640 1 --2- 172.21.15.94:0/120229178 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f87cc153220 0x7f87cc06ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.227+0000 7f87c3fff640 1 -- 172.21.15.94:0/120229178 >> v2:172.21.15.111:3300/0 conn(0x7f87cc0723d0 msgr2=0x7f87cc0727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:09.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.227+0000 7f87c3fff640 1 --2- 172.21.15.94:0/120229178 >> v2:172.21.15.111:3300/0 conn(0x7f87cc0723d0 0x7f87cc0727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.227+0000 7f87c3fff640 1 -- 172.21.15.94:0/120229178 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87cc159a60 con 0x7f87cc067b00 2024-04-25T12:24:09.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87c3fff640 1 --2- 172.21.15.94:0/120229178 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87cc067b00 0x7f87cc152ce0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f87cc075820 tx=0x7f87b401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2d618cfe0c178f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:09.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87c9d9b640 1 -- 172.21.15.94:0/120229178 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b40b0070 con 0x7f87cc067b00 2024-04-25T12:24:09.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87c9d9b640 1 -- 172.21.15.94:0/120229178 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b40ab600 con 0x7f87cc067b00 2024-04-25T12:24:09.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87c9d9b640 1 -- 172.21.15.94:0/120229178 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b40ab9d0 con 0x7f87cc067b00 2024-04-25T12:24:09.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87d0845640 1 -- 172.21.15.94:0/120229178 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87cc067b00 msgr2=0x7f87cc152ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:09.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87d0845640 1 --2- 172.21.15.94:0/120229178 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87cc067b00 0x7f87cc152ce0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f87cc075820 tx=0x7f87b401c520 comp rx=0 tx=0).stop 2024-04-25T12:24:09.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87d0845640 1 -- 172.21.15.94:0/120229178 shutdown_connections 2024-04-25T12:24:09.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87d0845640 1 --2- 172.21.15.94:0/120229178 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f87cc153220 0x7f87cc06ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87d0845640 1 --2- 172.21.15.94:0/120229178 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87cc067b00 0x7f87cc152ce0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87d0845640 1 --2- 172.21.15.94:0/120229178 >> v2:172.21.15.111:3300/0 conn(0x7f87cc0723d0 0x7f87cc0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87d0845640 1 -- 172.21.15.94:0/120229178 >> 172.21.15.94:0/120229178 conn(0x7f87cc0c9a70 msgr2=0x7f87cc0c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:09.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87d0845640 1 -- 172.21.15.94:0/120229178 shutdown_connections 2024-04-25T12:24:09.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87d0845640 1 -- 172.21.15.94:0/120229178 wait complete. 2024-04-25T12:24:09.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87d0845640 1 Processor -- start 2024-04-25T12:24:09.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87d0845640 1 -- start start 2024-04-25T12:24:09.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87d0845640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f87cc067b00 0x7f87cc0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:09.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87d0845640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87cc0723d0 0x7f87cc1f78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:09.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87d0845640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87cc153220 0x7f87cc1f7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:09.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87d0845640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f87cc159d40 con 0x7f87cc0723d0 2024-04-25T12:24:09.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87d0845640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f87cc072cf0 con 0x7f87cc153220 2024-04-25T12:24:09.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87d0845640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f87cc0676a0 con 0x7f87cc067b00 2024-04-25T12:24:09.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87c3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87cc0723d0 0x7f87cc1f78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:09.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87c3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87cc0723d0 0x7f87cc1f78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57090/0 (socket says 172.21.15.94:57090) 2024-04-25T12:24:09.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87c3fff640 1 -- 172.21.15.94:0/2628263969 learned_addr learned my addr 172.21.15.94:0/2628263969 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:09.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87cad9d640 1 --2- 172.21.15.94:0/2628263969 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87cc153220 0x7f87cc1f7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:09.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87c3fff640 1 -- 172.21.15.94:0/2628263969 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f87cc067b00 msgr2=0x7f87cc0cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:09.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87ca59c640 1 --2- 172.21.15.94:0/2628263969 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f87cc067b00 0x7f87cc0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:09.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87c3fff640 1 --2- 172.21.15.94:0/2628263969 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f87cc067b00 0x7f87cc0cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87c3fff640 1 -- 172.21.15.94:0/2628263969 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87cc153220 msgr2=0x7f87cc1f7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:09.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87c3fff640 1 --2- 172.21.15.94:0/2628263969 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87cc153220 0x7f87cc1f7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87c3fff640 1 -- 172.21.15.94:0/2628263969 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87cc1f4380 con 0x7f87cc0723d0 2024-04-25T12:24:09.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87cad9d640 1 --2- 172.21.15.94:0/2628263969 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87cc153220 0x7f87cc1f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:09.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87c3fff640 1 --2- 172.21.15.94:0/2628263969 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87cc0723d0 0x7f87cc1f78f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f87b401abd0 tx=0x7f87b40192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:09.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.231+0000 7f87c2ffd640 1 -- 172.21.15.94:0/2628263969 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b40ba070 con 0x7f87cc0723d0 2024-04-25T12:24:09.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.235+0000 7f87c2ffd640 1 -- 172.21.15.94:0/2628263969 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b40b4420 con 0x7f87cc0723d0 2024-04-25T12:24:09.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.235+0000 7f87d0845640 1 -- 172.21.15.94:0/2628263969 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87cc163240 con 0x7f87cc0723d0 2024-04-25T12:24:09.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.235+0000 7f87c2ffd640 1 -- 172.21.15.94:0/2628263969 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b40b0040 con 0x7f87cc0723d0 2024-04-25T12:24:09.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.235+0000 7f87d0845640 1 -- 172.21.15.94:0/2628263969 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87cc1f4920 con 0x7f87cc0723d0 2024-04-25T12:24:09.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.235+0000 7f87d0845640 1 -- 172.21.15.94:0/2628263969 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87cc075df0 con 0x7f87cc0723d0 2024-04-25T12:24:09.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.235+0000 7f87c2ffd640 1 -- 172.21.15.94:0/2628263969 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f87b40bd070 con 0x7f87cc0723d0 2024-04-25T12:24:09.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.235+0000 7f87c2ffd640 1 --2- 172.21.15.94:0/2628263969 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f87ac068380 0x7f87ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:09.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.235+0000 7f87c2ffd640 1 -- 172.21.15.94:0/2628263969 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f87b411feb0 con 0x7f87cc0723d0 2024-04-25T12:24:09.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.235+0000 7f87ca59c640 1 --2- 172.21.15.94:0/2628263969 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f87ac068380 0x7f87ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:09.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.235+0000 7f87ca59c640 1 --2- 172.21.15.94:0/2628263969 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f87ac068380 0x7f87ac06a840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f87bc009710 tx=0x7f87bc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:09.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.239+0000 7f87c2ffd640 1 -- 172.21.15.94:0/2628263969 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f87b4016110 con 0x7f87cc0723d0 2024-04-25T12:24:09.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.399+0000 7f87d0845640 1 -- 172.21.15.94:0/2628263969 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f87cc1635b0 con 0x7f87cc0723d0 2024-04-25T12:24:09.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.399+0000 7f87c2ffd640 1 -- 172.21.15.94:0/2628263969 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7f87b40f0080 con 0x7f87cc0723d0 2024-04-25T12:24:09.407 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2024-04-25T12:24:09.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.399+0000 7f87d0845640 1 -- 172.21.15.94:0/2628263969 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f87ac068380 msgr2=0x7f87ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:09.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.399+0000 7f87d0845640 1 --2- 172.21.15.94:0/2628263969 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f87ac068380 0x7f87ac06a840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f87bc009710 tx=0x7f87bc008040 comp rx=0 tx=0).stop 2024-04-25T12:24:09.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.399+0000 7f87d0845640 1 -- 172.21.15.94:0/2628263969 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87cc0723d0 msgr2=0x7f87cc1f78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:09.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.399+0000 7f87d0845640 1 --2- 172.21.15.94:0/2628263969 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87cc0723d0 0x7f87cc1f78f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f87b401abd0 tx=0x7f87b40192c0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.399+0000 7f87d0845640 1 -- 172.21.15.94:0/2628263969 shutdown_connections 2024-04-25T12:24:09.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.399+0000 7f87d0845640 1 --2- 172.21.15.94:0/2628263969 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f87ac068380 0x7f87ac06a840 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.399+0000 7f87d0845640 1 --2- 172.21.15.94:0/2628263969 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87cc153220 0x7f87cc1f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.399+0000 7f87d0845640 1 --2- 172.21.15.94:0/2628263969 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87cc0723d0 0x7f87cc1f78f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.399+0000 7f87d0845640 1 --2- 172.21.15.94:0/2628263969 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f87cc067b00 0x7f87cc0cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.399+0000 7f87d0845640 1 -- 172.21.15.94:0/2628263969 >> 172.21.15.94:0/2628263969 conn(0x7f87cc0c9a70 msgr2=0x7f87cc0c7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:09.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.399+0000 7f87d0845640 1 -- 172.21.15.94:0/2628263969 shutdown_connections 2024-04-25T12:24:09.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.399+0000 7f87d0845640 1 -- 172.21.15.94:0/2628263969 wait complete. 2024-04-25T12:24:09.420 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:24:09.420 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T12:24:09.426 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:24:09.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.587+0000 7f0764f9f640 1 Processor -- start 2024-04-25T12:24:09.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.587+0000 7f0764f9f640 1 -- start start 2024-04-25T12:24:09.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.587+0000 7f0764f9f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f07600c5f20 0x7f07600c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:09.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.587+0000 7f0764f9f640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f07600c6300 0x7f0760152c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:09.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.587+0000 7f0764f9f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07600ca960 con 0x7f07600c9c10 2024-04-25T12:24:09.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.587+0000 7f0764f9f640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f07600c7f30 con 0x7f07600c5f20 2024-04-25T12:24:09.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.587+0000 7f0764f9f640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f07600ca0c0 con 0x7f07600c6300 2024-04-25T12:24:09.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.587+0000 7f075dd9b640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f07600c9c10 0x7f07600c91c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41926/0 (socket says 172.21.15.94:41926) 2024-04-25T12:24:09.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.587+0000 7f075dd9b640 1 -- 172.21.15.94:0/3151550669 learned_addr learned my addr 172.21.15.94:0/3151550669 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:09.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.587+0000 7f075e59c640 1 --2- 172.21.15.94:0/3151550669 >> v2:172.21.15.94:3300/0 conn(0x7f07600c5f20 0x7f07600c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:09.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.587+0000 7f075ed9d640 1 --2- 172.21.15.94:0/3151550669 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f07600c6300 0x7f0760152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:09.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.587+0000 7f075d59a640 1 -- 172.21.15.94:0/3151550669 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1070000073 0 0) 0x7f07600ca960 con 0x7f07600c9c10 2024-04-25T12:24:09.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.587+0000 7f075d59a640 1 -- 172.21.15.94:0/3151550669 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0748003530 con 0x7f07600c9c10 2024-04-25T12:24:09.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.587+0000 7f075e59c640 1 -- 172.21.15.94:0/3151550669 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f07600c6300 msgr2=0x7f0760152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:09.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.587+0000 7f075e59c640 1 --2- 172.21.15.94:0/3151550669 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f07600c6300 0x7f0760152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.587+0000 7f075e59c640 1 -- 172.21.15.94:0/3151550669 >> v1:172.21.15.94:6789/0 conn(0x7f07600c9c10 legacy=0x7f07600c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:09.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.587+0000 7f075e59c640 1 -- 172.21.15.94:0/3151550669 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07600ca3a0 con 0x7f07600c5f20 2024-04-25T12:24:09.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.587+0000 7f075ed9d640 1 --2- 172.21.15.94:0/3151550669 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f07600c6300 0x7f0760152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:24:09.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.587+0000 7f075e59c640 1 --2- 172.21.15.94:0/3151550669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07600c5f20 0x7f07600c86f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f07500097c0 tx=0x7f075001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2506b56b26944d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:09.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f075d59a640 1 -- 172.21.15.94:0/3151550669 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07500b5070 con 0x7f07600c5f20 2024-04-25T12:24:09.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f075d59a640 1 -- 172.21.15.94:0/3151550669 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07500a8990 con 0x7f07600c5f20 2024-04-25T12:24:09.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f075d59a640 1 -- 172.21.15.94:0/3151550669 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07500a8d60 con 0x7f07600c5f20 2024-04-25T12:24:09.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f0764f9f640 1 -- 172.21.15.94:0/3151550669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07600c5f20 msgr2=0x7f07600c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:09.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f0764f9f640 1 --2- 172.21.15.94:0/3151550669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07600c5f20 0x7f07600c86f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f07500097c0 tx=0x7f075001ec90 comp rx=0 tx=0).stop 2024-04-25T12:24:09.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f0764f9f640 1 -- 172.21.15.94:0/3151550669 shutdown_connections 2024-04-25T12:24:09.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f0764f9f640 1 --2- 172.21.15.94:0/3151550669 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f07600c6300 0x7f0760152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f0764f9f640 1 --2- 172.21.15.94:0/3151550669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07600c5f20 0x7f07600c86f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f0764f9f640 1 -- 172.21.15.94:0/3151550669 >> 172.21.15.94:0/3151550669 conn(0x7f07600676a0 msgr2=0x7f0760067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:09.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f0764f9f640 1 -- 172.21.15.94:0/3151550669 shutdown_connections 2024-04-25T12:24:09.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f0764f9f640 1 -- 172.21.15.94:0/3151550669 wait complete. 2024-04-25T12:24:09.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f0764f9f640 1 Processor -- start 2024-04-25T12:24:09.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f0764f9f640 1 -- start start 2024-04-25T12:24:09.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f0764f9f640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f07600c5f20 0x7f076006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:09.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f0764f9f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07600c6300 0x7f076015b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:09.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f0764f9f640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f07600c9c10 0x7f076015b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:09.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f0764f9f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f07600c98d0 con 0x7f07600c6300 2024-04-25T12:24:09.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f0764f9f640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f07600c81d0 con 0x7f07600c5f20 2024-04-25T12:24:09.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f0764f9f640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f07600c8c30 con 0x7f07600c9c10 2024-04-25T12:24:09.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f075dd9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07600c6300 0x7f076015b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:09.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f075dd9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07600c6300 0x7f076015b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57108/0 (socket says 172.21.15.94:57108) 2024-04-25T12:24:09.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f075dd9b640 1 -- 172.21.15.94:0/707891542 learned_addr learned my addr 172.21.15.94:0/707891542 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:09.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f075ed9d640 1 --2- 172.21.15.94:0/707891542 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f07600c9c10 0x7f076015b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:09.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f075e59c640 1 --2- 172.21.15.94:0/707891542 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f07600c5f20 0x7f076006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:09.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f075dd9b640 1 -- 172.21.15.94:0/707891542 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f07600c9c10 msgr2=0x7f076015b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:09.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f075dd9b640 1 --2- 172.21.15.94:0/707891542 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f07600c9c10 0x7f076015b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f075dd9b640 1 -- 172.21.15.94:0/707891542 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f07600c5f20 msgr2=0x7f076006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:09.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f075dd9b640 1 --2- 172.21.15.94:0/707891542 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f07600c5f20 0x7f076006d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f075dd9b640 1 -- 172.21.15.94:0/707891542 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07601f0f70 con 0x7f07600c6300 2024-04-25T12:24:09.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f075dd9b640 1 --2- 172.21.15.94:0/707891542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07600c6300 0x7f076015b3c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f075400c3f0 tx=0x7f075400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:09.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f074effd640 1 -- 172.21.15.94:0/707891542 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0754017070 con 0x7f07600c6300 2024-04-25T12:24:09.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f074effd640 1 -- 172.21.15.94:0/707891542 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0754005cf0 con 0x7f07600c6300 2024-04-25T12:24:09.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f0764f9f640 1 -- 172.21.15.94:0/707891542 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07601f1250 con 0x7f07600c6300 2024-04-25T12:24:09.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f074effd640 1 -- 172.21.15.94:0/707891542 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07540072f0 con 0x7f07600c6300 2024-04-25T12:24:09.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.591+0000 7f0764f9f640 1 -- 172.21.15.94:0/707891542 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07601f1810 con 0x7f07600c6300 2024-04-25T12:24:09.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.595+0000 7f0764f9f640 1 -- 172.21.15.94:0/707891542 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07601f1a10 con 0x7f07600c6300 2024-04-25T12:24:09.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.595+0000 7f074effd640 1 -- 172.21.15.94:0/707891542 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f075401a070 con 0x7f07600c6300 2024-04-25T12:24:09.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.595+0000 7f074effd640 1 --2- 172.21.15.94:0/707891542 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0740068380 0x7f074006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:09.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.595+0000 7f074effd640 1 -- 172.21.15.94:0/707891542 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f07540862a0 con 0x7f07600c6300 2024-04-25T12:24:09.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.595+0000 7f075e59c640 1 --2- 172.21.15.94:0/707891542 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0740068380 0x7f074006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:09.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.595+0000 7f075e59c640 1 --2- 172.21.15.94:0/707891542 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0740068380 0x7f074006a840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f07500b2000 tx=0x7f07500aa070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:09.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.599+0000 7f074effd640 1 -- 172.21.15.94:0/707891542 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f07601f1a10 con 0x7f07600c6300 2024-04-25T12:24:09.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.747+0000 7f0764f9f640 1 -- 172.21.15.94:0/707891542 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f076015aed0 con 0x7f07600c6300 2024-04-25T12:24:09.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.751+0000 7f074effd640 1 -- 172.21.15.94:0/707891542 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18873 (secure 0 0 0) 0x7f07540563e0 con 0x7f07600c6300 2024-04-25T12:24:09.756 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:09.756 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"7059a9e2-aec4-4b84-b942-caf531e15da3","created":"2024-04-25T12:21:29.118508+0000","modified":"2024-04-25T12:22:34.871807+0000","last_up_change":"2024-04-25T12:21:40.912605+0000","last_in_change":"2024-04-25T12:21:31.372905+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:39.781011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:51.465886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:52.470540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:56.209936+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"640a65ef-0734-468a-a8f5-9ed70cf75c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6809","nonce":2553247564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6811","nonce":2553247564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6815","nonce":2553247564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6813","nonce":2553247564}]},"public_addr":"172.21.15.94:6809/2553247564","cluster_addr":"172.21.15.94:6811/2553247564","heartbeat_back_addr":"172.21.15.94:6815/2553247564","heartbeat_front_addr":"172.21.15.94:6813/2553247564","state":["exists","up"]},{"osd":1,"uuid":"d6e886e6-c8c1-4761-9a4c-abc6961c7c81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6818","nonce":2492806478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6822","nonce":2492806478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6830","nonce":2492806478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6826","nonce":2492806478}]},"public_addr":"172.21.15.94:6818/2492806478","cluster_addr":"172.21.15.94:6822/2492806478","heartbeat_back_addr":"172.21.15.94:6830/2492806478","heartbeat_front_addr":"172.21.15.94:6826/2492806478","state":["exists","up"]},{"osd":2,"uuid":"ba20f409-ed46-43b6-b16d-43dc4622c042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6801","nonce":1485061290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6803","nonce":1485061290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6807","nonce":1485061290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6805","nonce":1485061290}]},"public_addr":"172.21.15.94:6801/1485061290","cluster_addr":"172.21.15.94:6803/1485061290","heartbeat_back_addr":"172.21.15.94:6807/1485061290","heartbeat_front_addr":"172.21.15.94:6805/1485061290","state":["exists","up"]},{"osd":3,"uuid":"85816a2b-3a3f-4ec8-8373-8230d948396f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6819","nonce":1548488434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6823","nonce":1548488434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6829","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6831","nonce":1548488434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6827","nonce":1548488434}]},"public_addr":"172.21.15.94:6819/1548488434","cluster_addr":"172.21.15.94:6823/1548488434","heartbeat_back_addr":"172.21.15.94:6831/1548488434","heartbeat_front_addr":"172.21.15.94:6827/1548488434","state":["exists","up"]},{"osd":4,"uuid":"b4a953b7-01d6-4623-9324-63135fdaf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6811","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6814","nonce":4070977083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6817","nonce":4070977083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6823","nonce":4070977083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6819","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6821","nonce":4070977083}]},"public_addr":"172.21.15.111:6814/4070977083","cluster_addr":"172.21.15.111:6817/4070977083","heartbeat_back_addr":"172.21.15.111:6823/4070977083","heartbeat_front_addr":"172.21.15.111:6821/4070977083","state":["exists","up"]},{"osd":5,"uuid":"c0acc514-427d-41bf-a965-b8463cebf045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6803","nonce":1054925605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6809","nonce":1054925605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6820","nonce":1054925605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6815","nonce":1054925605}]},"public_addr":"172.21.15.111:6803/1054925605","cluster_addr":"172.21.15.111:6809/1054925605","heartbeat_back_addr":"172.21.15.111:6820/1054925605","heartbeat_front_addr":"172.21.15.111:6815/1054925605","state":["exists","up"]},{"osd":6,"uuid":"26ff742f-5a57-44a7-a095-f04d6e87f885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6825","nonce":3619235078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6827","nonce":3619235078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6831","nonce":3619235078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6829","nonce":3619235078}]},"public_addr":"172.21.15.111:6825/3619235078","cluster_addr":"172.21.15.111:6827/3619235078","heartbeat_back_addr":"172.21.15.111:6831/3619235078","heartbeat_front_addr":"172.21.15.111:6829/3619235078","state":["exists","up"]},{"osd":7,"uuid":"9c214cba-693a-4b25-aad7-05a5b0006e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6801","nonce":558758517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6805","nonce":558758517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6813","nonce":558758517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6807","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6808","nonce":558758517}]},"public_addr":"172.21.15.111:6801/558758517","cluster_addr":"172.21.15.111:6805/558758517","heartbeat_back_addr":"172.21.15.111:6813/558758517","heartbeat_front_addr":"172.21.15.111:6808/558758517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.664958+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.853375+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.654455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:37.033852+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.968691+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.856013+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.913496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.848565+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:24:09.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.755+0000 7f0764f9f640 1 -- 172.21.15.94:0/707891542 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0740068380 msgr2=0x7f074006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:09.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.755+0000 7f0764f9f640 1 --2- 172.21.15.94:0/707891542 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0740068380 0x7f074006a840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f07500b2000 tx=0x7f07500aa070 comp rx=0 tx=0).stop 2024-04-25T12:24:09.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.755+0000 7f0764f9f640 1 -- 172.21.15.94:0/707891542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07600c6300 msgr2=0x7f076015b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:09.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.755+0000 7f0764f9f640 1 --2- 172.21.15.94:0/707891542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07600c6300 0x7f076015b3c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f075400c3f0 tx=0x7f075400c8b0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.755+0000 7f0764f9f640 1 -- 172.21.15.94:0/707891542 shutdown_connections 2024-04-25T12:24:09.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.755+0000 7f0764f9f640 1 --2- 172.21.15.94:0/707891542 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0740068380 0x7f074006a840 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.755+0000 7f0764f9f640 1 --2- 172.21.15.94:0/707891542 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f07600c9c10 0x7f076015b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.755+0000 7f0764f9f640 1 --2- 172.21.15.94:0/707891542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07600c6300 0x7f076015b3c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.755+0000 7f0764f9f640 1 --2- 172.21.15.94:0/707891542 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f07600c5f20 0x7f076006d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.755+0000 7f0764f9f640 1 -- 172.21.15.94:0/707891542 >> 172.21.15.94:0/707891542 conn(0x7f07600676a0 msgr2=0x7f07600cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:09.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.755+0000 7f0764f9f640 1 -- 172.21.15.94:0/707891542 shutdown_connections 2024-04-25T12:24:09.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.755+0000 7f0764f9f640 1 -- 172.21.15.94:0/707891542 wait complete. 2024-04-25T12:24:09.775 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T12:21:39.781011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T12:21:51.465886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T12:21:52.470540+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T12:21:56.209936+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T12:24:09.775 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T12:24:09.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.879+0000 7f5b34fa0640 1 Processor -- start 2024-04-25T12:24:09.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.879+0000 7f5b34fa0640 1 -- start start 2024-04-25T12:24:09.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b34fa0640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f5b3014fbc0 0x7f5b3006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:09.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b34fa0640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5b3014ffa0 0x7f5b300c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:09.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b34fa0640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b300c5d70 con 0x7f5b30074100 2024-04-25T12:24:09.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b34fa0640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f5b300c6050 con 0x7f5b3014fbc0 2024-04-25T12:24:09.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b34fa0640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f5b300c6330 con 0x7f5b3014ffa0 2024-04-25T12:24:09.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2ed9d640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f5b30074100 0x7f5b300c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41932/0 (socket says 172.21.15.94:41932) 2024-04-25T12:24:09.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2ed9d640 1 -- 172.21.15.94:0/3873647846 learned_addr learned my addr 172.21.15.94:0/3873647846 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:09.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2e59c640 1 --2- 172.21.15.94:0/3873647846 >> v2:172.21.15.111:3300/0 conn(0x7f5b3014fbc0 0x7f5b3006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:09.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2dd9b640 1 --2- 172.21.15.94:0/3873647846 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5b3014ffa0 0x7f5b300c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:09.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2d59a640 1 -- 172.21.15.94:0/3873647846 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 136660308 0 0) 0x7f5b300c5d70 con 0x7f5b30074100 2024-04-25T12:24:09.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2d59a640 1 -- 172.21.15.94:0/3873647846 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b18003530 con 0x7f5b30074100 2024-04-25T12:24:09.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2d59a640 1 -- 172.21.15.94:0/3873647846 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 533410618 0 0) 0x7f5b18003530 con 0x7f5b30074100 2024-04-25T12:24:09.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2d59a640 1 -- 172.21.15.94:0/3873647846 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5b3014ffa0 msgr2=0x7f5b300c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:09.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2d59a640 1 --2- 172.21.15.94:0/3873647846 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5b3014ffa0 0x7f5b300c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2d59a640 1 -- 172.21.15.94:0/3873647846 >> v2:172.21.15.111:3300/0 conn(0x7f5b3014fbc0 msgr2=0x7f5b3006f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:09.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2d59a640 1 --2- 172.21.15.94:0/3873647846 >> v2:172.21.15.111:3300/0 conn(0x7f5b3014fbc0 0x7f5b3006f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2d59a640 1 -- 172.21.15.94:0/3873647846 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b300c6610 con 0x7f5b30074100 2024-04-25T12:24:09.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2d59a640 1 -- 172.21.15.94:0/3873647846 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7f5b28001a00 con 0x7f5b30074100 2024-04-25T12:24:09.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2d59a640 1 -- 172.21.15.94:0/3873647846 >> v1:172.21.15.94:6789/0 conn(0x7f5b30074100 legacy=0x7f5b300c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:09.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2d59a640 1 --2- 172.21.15.94:0/3873647846 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5b3014ffa0 0x7f5b180039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:09.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2d59a640 1 --2- 172.21.15.94:0/3873647846 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b18003f40 0x7f5b18004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:09.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2d59a640 1 --2- 172.21.15.94:0/3873647846 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b18004d50 0x7f5b180051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:09.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2d59a640 1 -- 172.21.15.94:0/3873647846 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5b300c6050 con 0x7f5b18004d50 2024-04-25T12:24:09.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2d59a640 1 -- 172.21.15.94:0/3873647846 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5b300c6330 con 0x7f5b18003f40 2024-04-25T12:24:09.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2d59a640 1 -- 172.21.15.94:0/3873647846 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f5b1800b9d0 con 0x7f5b3014ffa0 2024-04-25T12:24:09.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2ed9d640 1 --2- 172.21.15.94:0/3873647846 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b18004d50 0x7f5b180051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:09.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2e59c640 1 --2- 172.21.15.94:0/3873647846 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5b3014ffa0 0x7f5b180039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:09.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2dd9b640 1 --2- 172.21.15.94:0/3873647846 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b18003f40 0x7f5b18004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:09.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2ed9d640 1 -- 172.21.15.94:0/3873647846 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5b3014ffa0 msgr2=0x7f5b180039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:09.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2ed9d640 1 --2- 172.21.15.94:0/3873647846 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5b3014ffa0 0x7f5b180039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2ed9d640 1 -- 172.21.15.94:0/3873647846 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b18003f40 msgr2=0x7f5b18004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:09.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2ed9d640 1 --2- 172.21.15.94:0/3873647846 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b18003f40 0x7f5b18004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2ed9d640 1 -- 172.21.15.94:0/3873647846 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b18003530 con 0x7f5b18004d50 2024-04-25T12:24:09.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2ed9d640 1 --2- 172.21.15.94:0/3873647846 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b18004d50 0x7f5b180051d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5b2800a850 tx=0x7f5b2801d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b1755b9e5d8e21 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:09.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2d59a640 1 -- 172.21.15.94:0/3873647846 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2800a4a0 con 0x7f5b18004d50 2024-04-25T12:24:09.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2d59a640 1 -- 172.21.15.94:0/3873647846 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b280ad650 con 0x7f5b18004d50 2024-04-25T12:24:09.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.883+0000 7f5b2d59a640 1 -- 172.21.15.94:0/3873647846 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b280ada40 con 0x7f5b18004d50 2024-04-25T12:24:09.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b34fa0640 1 -- 172.21.15.94:0/3873647846 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b18004d50 msgr2=0x7f5b180051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:09.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b34fa0640 1 --2- 172.21.15.94:0/3873647846 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b18004d50 0x7f5b180051d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5b2800a850 tx=0x7f5b2801d320 comp rx=0 tx=0).stop 2024-04-25T12:24:09.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b2ed9d640 1 -- 172.21.15.94:0/3873647846 reap_dead start 2024-04-25T12:24:09.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b34fa0640 1 -- 172.21.15.94:0/3873647846 shutdown_connections 2024-04-25T12:24:09.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b34fa0640 1 -- 172.21.15.94:0/3873647846 >> 172.21.15.94:0/3873647846 conn(0x7f5b3006b9d0 msgr2=0x7f5b3006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:09.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b34fa0640 1 -- 172.21.15.94:0/3873647846 shutdown_connections 2024-04-25T12:24:09.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b34fa0640 1 -- 172.21.15.94:0/3873647846 wait complete. 2024-04-25T12:24:09.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b34fa0640 1 Processor -- start 2024-04-25T12:24:09.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b34fa0640 1 -- start start 2024-04-25T12:24:09.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b34fa0640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5b18004d50 0x7f5b300c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:09.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b34fa0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b300c39e0 0x7f5b301f0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:09.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b34fa0640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b301f1490 0x7f5b30148e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:09.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b34fa0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5b30068350 con 0x7f5b300c39e0 2024-04-25T12:24:09.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b34fa0640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5b300681d0 con 0x7f5b301f1490 2024-04-25T12:24:09.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b34fa0640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f5b300c7960 con 0x7f5b18004d50 2024-04-25T12:24:09.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b2dd9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b300c39e0 0x7f5b301f0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:09.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b2dd9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b300c39e0 0x7f5b301f0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57116/0 (socket says 172.21.15.94:57116) 2024-04-25T12:24:09.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b2dd9b640 1 -- 172.21.15.94:0/886581369 learned_addr learned my addr 172.21.15.94:0/886581369 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:09.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b2e59c640 1 --2- 172.21.15.94:0/886581369 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5b18004d50 0x7f5b300c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:09.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b2ed9d640 1 --2- 172.21.15.94:0/886581369 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b301f1490 0x7f5b30148e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:09.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b2dd9b640 1 -- 172.21.15.94:0/886581369 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5b18004d50 msgr2=0x7f5b300c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:09.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b2dd9b640 1 --2- 172.21.15.94:0/886581369 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5b18004d50 0x7f5b300c52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b2dd9b640 1 -- 172.21.15.94:0/886581369 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b301f1490 msgr2=0x7f5b30148e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:09.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b2dd9b640 1 --2- 172.21.15.94:0/886581369 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b301f1490 0x7f5b30148e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:09.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b2dd9b640 1 -- 172.21.15.94:0/886581369 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b301506e0 con 0x7f5b300c39e0 2024-04-25T12:24:09.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b2dd9b640 1 --2- 172.21.15.94:0/886581369 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b300c39e0 0x7f5b301f0f50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5b24011640 tx=0x7f5b24011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:09.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b1effd640 1 -- 172.21.15.94:0/886581369 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2400f8c0 con 0x7f5b300c39e0 2024-04-25T12:24:09.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b1effd640 1 -- 172.21.15.94:0/886581369 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b2400fa60 con 0x7f5b300c39e0 2024-04-25T12:24:09.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b34fa0640 1 -- 172.21.15.94:0/886581369 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b301f1910 con 0x7f5b300c39e0 2024-04-25T12:24:09.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b1effd640 1 -- 172.21.15.94:0/886581369 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2400fe10 con 0x7f5b300c39e0 2024-04-25T12:24:09.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.887+0000 7f5b34fa0640 1 -- 172.21.15.94:0/886581369 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b300c4560 con 0x7f5b300c39e0 2024-04-25T12:24:09.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.891+0000 7f5b34fa0640 1 -- 172.21.15.94:0/886581369 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b30075df0 con 0x7f5b300c39e0 2024-04-25T12:24:09.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.891+0000 7f5b1effd640 1 -- 172.21.15.94:0/886581369 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5b24015460 con 0x7f5b300c39e0 2024-04-25T12:24:09.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.891+0000 7f5b1effd640 1 --2- 172.21.15.94:0/886581369 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5b10068380 0x7f5b1006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:09.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.891+0000 7f5b1effd640 1 -- 172.21.15.94:0/886581369 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f5b240876e0 con 0x7f5b300c39e0 2024-04-25T12:24:09.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.891+0000 7f5b2e59c640 1 --2- 172.21.15.94:0/886581369 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5b10068380 0x7f5b1006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:09.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.891+0000 7f5b2e59c640 1 --2- 172.21.15.94:0/886581369 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5b10068380 0x7f5b1006a840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5b20009a10 tx=0x7f5b20008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:09.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:09.895+0000 7f5b1effd640 1 -- 172.21.15.94:0/886581369 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5b301f1910 con 0x7f5b300c39e0 2024-04-25T12:24:10.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.043+0000 7f5b34fa0640 1 -- 172.21.15.94:0/886581369 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5b300c7df0 con 0x7f5b300c39e0 2024-04-25T12:24:10.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.043+0000 7f5b1effd640 1 -- 172.21.15.94:0/886581369 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7f5b24019030 con 0x7f5b300c39e0 2024-04-25T12:24:10.048 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2024-04-25T12:24:10.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.047+0000 7f5b34fa0640 1 -- 172.21.15.94:0/886581369 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5b10068380 msgr2=0x7f5b1006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:10.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.047+0000 7f5b34fa0640 1 --2- 172.21.15.94:0/886581369 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5b10068380 0x7f5b1006a840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5b20009a10 tx=0x7f5b20008040 comp rx=0 tx=0).stop 2024-04-25T12:24:10.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.047+0000 7f5b34fa0640 1 -- 172.21.15.94:0/886581369 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b300c39e0 msgr2=0x7f5b301f0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:10.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.047+0000 7f5b34fa0640 1 --2- 172.21.15.94:0/886581369 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b300c39e0 0x7f5b301f0f50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5b24011640 tx=0x7f5b24011b00 comp rx=0 tx=0).stop 2024-04-25T12:24:10.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.047+0000 7f5b34fa0640 1 -- 172.21.15.94:0/886581369 shutdown_connections 2024-04-25T12:24:10.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.047+0000 7f5b34fa0640 1 --2- 172.21.15.94:0/886581369 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5b10068380 0x7f5b1006a840 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.047+0000 7f5b34fa0640 1 --2- 172.21.15.94:0/886581369 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b301f1490 0x7f5b30148e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.047+0000 7f5b34fa0640 1 --2- 172.21.15.94:0/886581369 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5b300c39e0 0x7f5b301f0f50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.047+0000 7f5b34fa0640 1 --2- 172.21.15.94:0/886581369 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5b18004d50 0x7f5b300c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.047+0000 7f5b34fa0640 1 -- 172.21.15.94:0/886581369 >> 172.21.15.94:0/886581369 conn(0x7f5b3006b9d0 msgr2=0x7f5b3006ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:10.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.047+0000 7f5b34fa0640 1 -- 172.21.15.94:0/886581369 shutdown_connections 2024-04-25T12:24:10.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.047+0000 7f5b34fa0640 1 -- 172.21.15.94:0/886581369 wait complete. 2024-04-25T12:24:10.067 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T12:24:10.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.179+0000 7f5005c8a640 1 Processor -- start 2024-04-25T12:24:10.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f5005c8a640 1 -- start start 2024-04-25T12:24:10.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f5005c8a640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f500014ffa0 0x7f500006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:10.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f5005c8a640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5000074100 0x7f50000c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:10.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f5005c8a640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50000c5d70 con 0x7f500014fbc0 2024-04-25T12:24:10.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f5005c8a640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f50000c6050 con 0x7f500014ffa0 2024-04-25T12:24:10.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f5005c8a640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f50000c6330 con 0x7f5000074100 2024-04-25T12:24:10.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4fff7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f500014fbc0 0x7f50000c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41946/0 (socket says 172.21.15.94:41946) 2024-04-25T12:24:10.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4fff7fe640 1 -- 172.21.15.94:0/4073894236 learned_addr learned my addr 172.21.15.94:0/4073894236 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:10.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4ffe7fc640 1 -- 172.21.15.94:0/4073894236 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 239734069 0 0) 0x7f50000c5d70 con 0x7f500014fbc0 2024-04-25T12:24:10.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4ffeffd640 1 --2- 172.21.15.94:0/4073894236 >> v2:172.21.15.111:3300/0 conn(0x7f500014ffa0 0x7f500006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:10.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4ffffff640 1 --2- 172.21.15.94:0/4073894236 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5000074100 0x7f50000c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:10.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4ffe7fc640 1 -- 172.21.15.94:0/4073894236 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fe8003530 con 0x7f500014fbc0 2024-04-25T12:24:10.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4ffe7fc640 1 -- 172.21.15.94:0/4073894236 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 190184057 0 0) 0x7f4fe8003530 con 0x7f500014fbc0 2024-04-25T12:24:10.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4ffe7fc640 1 -- 172.21.15.94:0/4073894236 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5000074100 msgr2=0x7f50000c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:10.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4ffe7fc640 1 --2- 172.21.15.94:0/4073894236 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5000074100 0x7f50000c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4ffe7fc640 1 -- 172.21.15.94:0/4073894236 >> v2:172.21.15.111:3300/0 conn(0x7f500014ffa0 msgr2=0x7f500006f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:10.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4ffe7fc640 1 --2- 172.21.15.94:0/4073894236 >> v2:172.21.15.111:3300/0 conn(0x7f500014ffa0 0x7f500006f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4ffe7fc640 1 -- 172.21.15.94:0/4073894236 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50000c6610 con 0x7f500014fbc0 2024-04-25T12:24:10.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4ffeffd640 1 --2- 172.21.15.94:0/4073894236 >> v2:172.21.15.111:3300/0 conn(0x7f500014ffa0 0x7f500006f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:24:10.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4ffe7fc640 1 -- 172.21.15.94:0/4073894236 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7f4ff0001680 con 0x7f500014fbc0 2024-04-25T12:24:10.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4ffe7fc640 1 -- 172.21.15.94:0/4073894236 >> v1:172.21.15.94:6789/0 conn(0x7f500014fbc0 legacy=0x7f50000c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:10.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4ffe7fc640 1 --2- 172.21.15.94:0/4073894236 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4fe80039c0 0x7f4fe8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:10.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4ffe7fc640 1 --2- 172.21.15.94:0/4073894236 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4fe8004810 0x7f4fe8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:10.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4ffe7fc640 1 --2- 172.21.15.94:0/4073894236 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5000074100 0x7f4fe80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:10.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4ffe7fc640 1 -- 172.21.15.94:0/4073894236 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f50000c6050 con 0x7f4fe80039c0 2024-04-25T12:24:10.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4ffe7fc640 1 -- 172.21.15.94:0/4073894236 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f50000c6330 con 0x7f4fe8004810 2024-04-25T12:24:10.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4ffe7fc640 1 -- 172.21.15.94:0/4073894236 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f4fe800ba00 con 0x7f5000074100 2024-04-25T12:24:10.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4fff7fe640 1 --2- 172.21.15.94:0/4073894236 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4fe80039c0 0x7f4fe8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:10.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4ffffff640 1 --2- 172.21.15.94:0/4073894236 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5000074100 0x7f4fe80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:10.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4ffeffd640 1 --2- 172.21.15.94:0/4073894236 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4fe8004810 0x7f4fe8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:10.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4fff7fe640 1 -- 172.21.15.94:0/4073894236 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5000074100 msgr2=0x7f4fe80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:10.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4fff7fe640 1 --2- 172.21.15.94:0/4073894236 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5000074100 0x7f4fe80051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4fff7fe640 1 -- 172.21.15.94:0/4073894236 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4fe8004810 msgr2=0x7f4fe8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:10.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4fff7fe640 1 --2- 172.21.15.94:0/4073894236 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4fe8004810 0x7f4fe8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4fff7fe640 1 -- 172.21.15.94:0/4073894236 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe8003530 con 0x7f4fe80039c0 2024-04-25T12:24:10.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.183+0000 7f4ffeffd640 1 --2- 172.21.15.94:0/4073894236 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4fe8004810 0x7f4fe8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:10.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.187+0000 7f4fff7fe640 1 --2- 172.21.15.94:0/4073894236 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4fe80039c0 0x7f4fe8003da0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0005140 tx=0x7f4ff001d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c917899b2c616a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:10.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.187+0000 7f4ffe7fc640 1 -- 172.21.15.94:0/4073894236 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0004d40 con 0x7f4fe80039c0 2024-04-25T12:24:10.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.187+0000 7f4ffe7fc640 1 -- 172.21.15.94:0/4073894236 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff0005ae0 con 0x7f4fe80039c0 2024-04-25T12:24:10.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.187+0000 7f4ffe7fc640 1 -- 172.21.15.94:0/4073894236 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff00a5e60 con 0x7f4fe80039c0 2024-04-25T12:24:10.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.187+0000 7f5005c8a640 1 -- 172.21.15.94:0/4073894236 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4fe80039c0 msgr2=0x7f4fe8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:10.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.187+0000 7f5005c8a640 1 --2- 172.21.15.94:0/4073894236 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4fe80039c0 0x7f4fe8003da0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0005140 tx=0x7f4ff001d360 comp rx=0 tx=0).stop 2024-04-25T12:24:10.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.187+0000 7f4ffffff640 1 -- 172.21.15.94:0/4073894236 reap_dead start 2024-04-25T12:24:10.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.187+0000 7f5005c8a640 1 -- 172.21.15.94:0/4073894236 shutdown_connections 2024-04-25T12:24:10.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.187+0000 7f5005c8a640 1 -- 172.21.15.94:0/4073894236 >> 172.21.15.94:0/4073894236 conn(0x7f500006b9d0 msgr2=0x7f500006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:10.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.187+0000 7f5005c8a640 1 -- 172.21.15.94:0/4073894236 shutdown_connections 2024-04-25T12:24:10.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.187+0000 7f5005c8a640 1 -- 172.21.15.94:0/4073894236 wait complete. 2024-04-25T12:24:10.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.187+0000 7f5005c8a640 1 Processor -- start 2024-04-25T12:24:10.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.187+0000 7f5005c8a640 1 -- start start 2024-04-25T12:24:10.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.187+0000 7f5005c8a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4fe80039c0 0x7f50001f2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:10.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.187+0000 7f5005c8a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f50000cb110 0x7f50001f4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:10.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.187+0000 7f5005c8a640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f50001f4cd0 0x7f5000073660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:10.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.187+0000 7f5005c8a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f50001639f0 con 0x7f4fe80039c0 2024-04-25T12:24:10.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.187+0000 7f5005c8a640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5000163870 con 0x7f50000cb110 2024-04-25T12:24:10.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.187+0000 7f5005c8a640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f5000163b70 con 0x7f50001f4cd0 2024-04-25T12:24:10.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.187+0000 7f4fff7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4fe80039c0 0x7f50001f2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:10.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.187+0000 7f4fff7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4fe80039c0 0x7f50001f2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57130/0 (socket says 172.21.15.94:57130) 2024-04-25T12:24:10.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.187+0000 7f4fff7fe640 1 -- 172.21.15.94:0/1008480204 learned_addr learned my addr 172.21.15.94:0/1008480204 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:10.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.187+0000 7f4ffffff640 1 --2- 172.21.15.94:0/1008480204 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f50001f4cd0 0x7f5000073660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:10.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.187+0000 7f4ffeffd640 1 --2- 172.21.15.94:0/1008480204 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f50000cb110 0x7f50001f4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:10.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.191+0000 7f4fff7fe640 1 -- 172.21.15.94:0/1008480204 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f50001f4cd0 msgr2=0x7f5000073660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:10.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.191+0000 7f4fff7fe640 1 --2- 172.21.15.94:0/1008480204 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f50001f4cd0 0x7f5000073660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.191+0000 7f4fff7fe640 1 -- 172.21.15.94:0/1008480204 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f50000cb110 msgr2=0x7f50001f4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:10.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.191+0000 7f4fff7fe640 1 --2- 172.21.15.94:0/1008480204 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f50000cb110 0x7f50001f4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.191+0000 7f4fff7fe640 1 -- 172.21.15.94:0/1008480204 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50000cbc70 con 0x7f4fe80039c0 2024-04-25T12:24:10.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.191+0000 7f4fff7fe640 1 --2- 172.21.15.94:0/1008480204 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4fe80039c0 0x7f50001f2680 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4ff001cdd0 tx=0x7f4fe8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:10.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.191+0000 7f4fe7fff640 1 -- 172.21.15.94:0/1008480204 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff00018e0 con 0x7f4fe80039c0 2024-04-25T12:24:10.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.191+0000 7f4fe7fff640 1 -- 172.21.15.94:0/1008480204 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff00058e0 con 0x7f4fe80039c0 2024-04-25T12:24:10.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.191+0000 7f5005c8a640 1 -- 172.21.15.94:0/1008480204 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50000cbf10 con 0x7f4fe80039c0 2024-04-25T12:24:10.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.191+0000 7f4fe7fff640 1 -- 172.21.15.94:0/1008480204 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff00047f0 con 0x7f4fe80039c0 2024-04-25T12:24:10.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.191+0000 7f5005c8a640 1 -- 172.21.15.94:0/1008480204 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50000ca910 con 0x7f4fe80039c0 2024-04-25T12:24:10.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.191+0000 7f5005c8a640 1 -- 172.21.15.94:0/1008480204 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5000075df0 con 0x7f4fe80039c0 2024-04-25T12:24:10.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.191+0000 7f4fe7fff640 1 -- 172.21.15.94:0/1008480204 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4ff0001440 con 0x7f4fe80039c0 2024-04-25T12:24:10.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.191+0000 7f4fe7fff640 1 --2- 172.21.15.94:0/1008480204 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f4fec068380 0x7f4fec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:10.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.191+0000 7f4fe7fff640 1 -- 172.21.15.94:0/1008480204 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f4ff0120390 con 0x7f4fe80039c0 2024-04-25T12:24:10.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.191+0000 7f4ffeffd640 1 --2- 172.21.15.94:0/1008480204 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f4fec068380 0x7f4fec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:10.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.191+0000 7f4ffeffd640 1 --2- 172.21.15.94:0/1008480204 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f4fec068380 0x7f4fec06a840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f50000c8ee0 tx=0x7f4ff4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:10.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.195+0000 7f4fe7fff640 1 -- 172.21.15.94:0/1008480204 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4ff00be060 con 0x7f4fe80039c0 2024-04-25T12:24:10.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.359+0000 7f5005c8a640 1 -- 172.21.15.94:0/1008480204 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f50000c7df0 con 0x7f4fe80039c0 2024-04-25T12:24:10.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.359+0000 7f4fe7fff640 1 -- 172.21.15.94:0/1008480204 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7f4ff0017070 con 0x7f4fe80039c0 2024-04-25T12:24:10.364 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2024-04-25T12:24:10.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.363+0000 7f5005c8a640 1 -- 172.21.15.94:0/1008480204 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f4fec068380 msgr2=0x7f4fec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:10.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.363+0000 7f5005c8a640 1 --2- 172.21.15.94:0/1008480204 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f4fec068380 0x7f4fec06a840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f50000c8ee0 tx=0x7f4ff4008040 comp rx=0 tx=0).stop 2024-04-25T12:24:10.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.363+0000 7f5005c8a640 1 -- 172.21.15.94:0/1008480204 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4fe80039c0 msgr2=0x7f50001f2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:10.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.363+0000 7f5005c8a640 1 --2- 172.21.15.94:0/1008480204 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4fe80039c0 0x7f50001f2680 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4ff001cdd0 tx=0x7f4fe8005840 comp rx=0 tx=0).stop 2024-04-25T12:24:10.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.363+0000 7f5005c8a640 1 -- 172.21.15.94:0/1008480204 shutdown_connections 2024-04-25T12:24:10.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.363+0000 7f5005c8a640 1 --2- 172.21.15.94:0/1008480204 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f4fec068380 0x7f4fec06a840 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.363+0000 7f5005c8a640 1 --2- 172.21.15.94:0/1008480204 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f50001f4cd0 0x7f5000073660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.363+0000 7f5005c8a640 1 --2- 172.21.15.94:0/1008480204 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f50000cb110 0x7f50001f4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.363+0000 7f5005c8a640 1 --2- 172.21.15.94:0/1008480204 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4fe80039c0 0x7f50001f2680 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.363+0000 7f5005c8a640 1 -- 172.21.15.94:0/1008480204 >> 172.21.15.94:0/1008480204 conn(0x7f500006b9d0 msgr2=0x7f500014b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:10.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.363+0000 7f5005c8a640 1 -- 172.21.15.94:0/1008480204 shutdown_connections 2024-04-25T12:24:10.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.363+0000 7f5005c8a640 1 -- 172.21.15.94:0/1008480204 wait complete. 2024-04-25T12:24:10.383 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T12:24:10.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.491+0000 7f9ebfc32640 1 Processor -- start 2024-04-25T12:24:10.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.491+0000 7f9ebfc32640 1 -- start start 2024-04-25T12:24:10.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.491+0000 7f9ebfc32640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9eb80c8630 0x7f9eb8151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:10.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.491+0000 7f9ebfc32640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9eb815b740 con 0x7f9eb80c8a70 2024-04-25T12:24:10.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.491+0000 7f9ebfc32640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9eb80c40f0 con 0x7f9eb80c8250 2024-04-25T12:24:10.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.491+0000 7f9ebfc32640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f9eb80c6490 con 0x7f9eb80c8630 2024-04-25T12:24:10.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.495+0000 7f9ebd1cd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9eb80c8630 0x7f9eb8151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:10.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.495+0000 7f9ebe1cf640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f9eb80c8a70 0x7f9eb8152080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41948/0 (socket says 172.21.15.94:41948) 2024-04-25T12:24:10.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.495+0000 7f9ebe1cf640 1 -- 172.21.15.94:0/3177259734 learned_addr learned my addr 172.21.15.94:0/3177259734 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:10.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.495+0000 7f9ebd1cd640 1 -- 172.21.15.94:0/3177259734 >> v1:172.21.15.111:6789/0 conn(0x7f9eb80c8250 legacy=0x7f9eb80c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:10.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.495+0000 7f9ebd1cd640 1 -- 172.21.15.94:0/3177259734 >> v1:172.21.15.94:6789/0 conn(0x7f9eb80c8a70 legacy=0x7f9eb8152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:10.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.495+0000 7f9ebd1cd640 1 -- 172.21.15.94:0/3177259734 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb80c58c0 con 0x7f9eb80c8630 2024-04-25T12:24:10.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.495+0000 7f9ebc9cc640 1 -- 172.21.15.94:0/3177259734 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4013561498 0 0) 0x7f9eb815b740 con 0x7f9eb80c8a70 2024-04-25T12:24:10.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.495+0000 7f9ebd1cd640 1 --2- 172.21.15.94:0/3177259734 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9eb80c8630 0x7f9eb8151b40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80097c0 tx=0x7f9ea801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72932aa4ed5e8077 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:10.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.495+0000 7f9ebc9cc640 1 -- 172.21.15.94:0/3177259734 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea80b0070 con 0x7f9eb80c8630 2024-04-25T12:24:10.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.495+0000 7f9ebc9cc640 1 -- 172.21.15.94:0/3177259734 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ea80ab600 con 0x7f9eb80c8630 2024-04-25T12:24:10.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.495+0000 7f9ebc9cc640 1 -- 172.21.15.94:0/3177259734 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea80ab9d0 con 0x7f9eb80c8630 2024-04-25T12:24:10.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.495+0000 7f9ebfc32640 1 -- 172.21.15.94:0/3177259734 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9eb80c8630 msgr2=0x7f9eb8151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:10.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.495+0000 7f9ebfc32640 1 --2- 172.21.15.94:0/3177259734 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9eb80c8630 0x7f9eb8151b40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80097c0 tx=0x7f9ea801c410 comp rx=0 tx=0).stop 2024-04-25T12:24:10.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.495+0000 7f9ebfc32640 1 -- 172.21.15.94:0/3177259734 shutdown_connections 2024-04-25T12:24:10.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.495+0000 7f9ebfc32640 1 --2- 172.21.15.94:0/3177259734 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9eb80c8630 0x7f9eb8151b40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.495+0000 7f9ebfc32640 1 -- 172.21.15.94:0/3177259734 >> 172.21.15.94:0/3177259734 conn(0x7f9eb806b9d0 msgr2=0x7f9eb806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:10.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.495+0000 7f9ebfc32640 1 -- 172.21.15.94:0/3177259734 shutdown_connections 2024-04-25T12:24:10.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.495+0000 7f9ebfc32640 1 -- 172.21.15.94:0/3177259734 wait complete. 2024-04-25T12:24:10.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9ebfc32640 1 Processor -- start 2024-04-25T12:24:10.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9ebfc32640 1 -- start start 2024-04-25T12:24:10.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9ebfc32640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9eb80c8250 0x7f9eb80c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:10.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9ebfc32640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9eb80c8630 0x7f9eb813ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:10.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9ebfc32640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9eb80c8a70 0x7f9eb8153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:10.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9ebfc32640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb815b400 con 0x7f9eb80c8250 2024-04-25T12:24:10.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9ebfc32640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb80721a0 con 0x7f9eb80c8630 2024-04-25T12:24:10.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9ebfc32640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f9eb80c6900 con 0x7f9eb80c8a70 2024-04-25T12:24:10.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9ebd9ce640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9eb80c8250 0x7f9eb80c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:10.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9ebd9ce640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9eb80c8250 0x7f9eb80c7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57158/0 (socket says 172.21.15.94:57158) 2024-04-25T12:24:10.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9ebd9ce640 1 -- 172.21.15.94:0/3114543531 learned_addr learned my addr 172.21.15.94:0/3114543531 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:10.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9ebd1cd640 1 --2- 172.21.15.94:0/3114543531 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9eb80c8630 0x7f9eb813ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:10.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9ebe1cf640 1 --2- 172.21.15.94:0/3114543531 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9eb80c8a70 0x7f9eb8153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:10.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9ebd9ce640 1 -- 172.21.15.94:0/3114543531 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9eb80c8a70 msgr2=0x7f9eb8153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:10.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9ebd9ce640 1 --2- 172.21.15.94:0/3114543531 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9eb80c8a70 0x7f9eb8153fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9ebd9ce640 1 -- 172.21.15.94:0/3114543531 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9eb80c8630 msgr2=0x7f9eb813ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:10.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9ebd9ce640 1 --2- 172.21.15.94:0/3114543531 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9eb80c8630 0x7f9eb813ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9ebd9ce640 1 -- 172.21.15.94:0/3114543531 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb8153690 con 0x7f9eb80c8250 2024-04-25T12:24:10.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9ebd1cd640 1 --2- 172.21.15.94:0/3114543531 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9eb80c8630 0x7f9eb813ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:10.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9ebd9ce640 1 --2- 172.21.15.94:0/3114543531 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9eb80c8250 0x7f9eb80c7140 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9eb400c530 tx=0x7f9eb400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:10.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9eae7fc640 1 -- 172.21.15.94:0/3114543531 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4016020 con 0x7f9eb80c8250 2024-04-25T12:24:10.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9eae7fc640 1 -- 172.21.15.94:0/3114543531 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eb4005220 con 0x7f9eb80c8250 2024-04-25T12:24:10.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9ebfc32640 1 -- 172.21.15.94:0/3114543531 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eb81407e0 con 0x7f9eb80c8250 2024-04-25T12:24:10.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9eae7fc640 1 -- 172.21.15.94:0/3114543531 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4007030 con 0x7f9eb80c8250 2024-04-25T12:24:10.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9ebfc32640 1 -- 172.21.15.94:0/3114543531 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eb8152bb0 con 0x7f9eb80c8250 2024-04-25T12:24:10.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9ebfc32640 1 -- 172.21.15.94:0/3114543531 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9eb8075df0 con 0x7f9eb80c8250 2024-04-25T12:24:10.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.499+0000 7f9eae7fc640 1 -- 172.21.15.94:0/3114543531 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9eb40071d0 con 0x7f9eb80c8250 2024-04-25T12:24:10.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.503+0000 7f9eae7fc640 1 --2- 172.21.15.94:0/3114543531 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f9e9c068380 0x7f9e9c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:10.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.503+0000 7f9ebd1cd640 1 --2- 172.21.15.94:0/3114543531 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f9e9c068380 0x7f9e9c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:10.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.503+0000 7f9eae7fc640 1 -- 172.21.15.94:0/3114543531 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f9eb4086740 con 0x7f9eb80c8250 2024-04-25T12:24:10.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.503+0000 7f9ebd1cd640 1 --2- 172.21.15.94:0/3114543531 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f9e9c068380 0x7f9e9c06a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80ad000 tx=0x7f9ea8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:10.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.507+0000 7f9eae7fc640 1 -- 172.21.15.94:0/3114543531 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9eb4020020 con 0x7f9eb80c8250 2024-04-25T12:24:10.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.663+0000 7f9ebfc32640 1 -- 172.21.15.94:0/3114543531 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9eb8071e50 con 0x7f9eb80c8250 2024-04-25T12:24:10.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.663+0000 7f9eae7fc640 1 -- 172.21.15.94:0/3114543531 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7f9eb40074c0 con 0x7f9eb80c8250 2024-04-25T12:24:10.669 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2024-04-25T12:24:10.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.667+0000 7f9ebfc32640 1 -- 172.21.15.94:0/3114543531 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f9e9c068380 msgr2=0x7f9e9c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:10.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.667+0000 7f9ebfc32640 1 --2- 172.21.15.94:0/3114543531 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f9e9c068380 0x7f9e9c06a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80ad000 tx=0x7f9ea8008040 comp rx=0 tx=0).stop 2024-04-25T12:24:10.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.667+0000 7f9ebfc32640 1 -- 172.21.15.94:0/3114543531 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9eb80c8250 msgr2=0x7f9eb80c7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:10.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.667+0000 7f9ebfc32640 1 --2- 172.21.15.94:0/3114543531 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9eb80c8250 0x7f9eb80c7140 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9eb400c530 tx=0x7f9eb400c9f0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.667+0000 7f9ebfc32640 1 -- 172.21.15.94:0/3114543531 shutdown_connections 2024-04-25T12:24:10.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.667+0000 7f9ebfc32640 1 --2- 172.21.15.94:0/3114543531 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f9e9c068380 0x7f9e9c06a840 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.667+0000 7f9ebfc32640 1 --2- 172.21.15.94:0/3114543531 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9eb80c8a70 0x7f9eb8153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.667+0000 7f9ebfc32640 1 --2- 172.21.15.94:0/3114543531 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9eb80c8630 0x7f9eb813ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.667+0000 7f9ebfc32640 1 --2- 172.21.15.94:0/3114543531 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9eb80c8250 0x7f9eb80c7140 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.667+0000 7f9ebfc32640 1 -- 172.21.15.94:0/3114543531 >> 172.21.15.94:0/3114543531 conn(0x7f9eb806b9d0 msgr2=0x7f9eb814f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:10.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.667+0000 7f9ebfc32640 1 -- 172.21.15.94:0/3114543531 shutdown_connections 2024-04-25T12:24:10.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.667+0000 7f9ebfc32640 1 -- 172.21.15.94:0/3114543531 wait complete. 2024-04-25T12:24:10.690 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T12:24:10.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.799+0000 7f36ec6c5640 1 Processor -- start 2024-04-25T12:24:10.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.799+0000 7f36ec6c5640 1 -- start start 2024-04-25T12:24:10.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.803+0000 7f36ec6c5640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f36e40c4b40 0x7f36e40c5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:10.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.803+0000 7f36ec6c5640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f36e40c5cc0 0x7f36e4161eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:10.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.803+0000 7f36ec6c5640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36e40c6150 con 0x7f36e40c8800 2024-04-25T12:24:10.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.803+0000 7f36ec6c5640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f36e4158090 con 0x7f36e40c5cc0 2024-04-25T12:24:10.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.803+0000 7f36ec6c5640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f36e41585c0 con 0x7f36e40c4b40 2024-04-25T12:24:10.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.803+0000 7f36eac62640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f36e40c5cc0 0x7f36e4161eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:10.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.803+0000 7f36eac62640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f36e40c5cc0 0x7f36e4161eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57172/0 (socket says 172.21.15.94:57172) 2024-04-25T12:24:10.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.803+0000 7f36eac62640 1 -- 172.21.15.94:0/2303486938 learned_addr learned my addr 172.21.15.94:0/2303486938 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:10.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.803+0000 7f36eac62640 1 -- 172.21.15.94:0/2303486938 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f36e40c4b40 msgr2=0x7f36e40c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:10.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.803+0000 7f36e9c60640 1 --2- 172.21.15.94:0/2303486938 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f36e40c4b40 0x7f36e40c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:10.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.803+0000 7f36eac62640 1 --2- 172.21.15.94:0/2303486938 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f36e40c4b40 0x7f36e40c5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.803+0000 7f36eac62640 1 -- 172.21.15.94:0/2303486938 >> v1:172.21.15.111:6789/0 conn(0x7f36e40c8800 legacy=0x7f36e40c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:10.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.803+0000 7f36eac62640 1 -- 172.21.15.94:0/2303486938 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e40c8be0 con 0x7f36e40c5cc0 2024-04-25T12:24:10.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.803+0000 7f36eac62640 1 --2- 172.21.15.94:0/2303486938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36e40c5cc0 0x7f36e4161eb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f36dc00af60 tx=0x7f36dc01d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b57a6f981ec97a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:10.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.807+0000 7f36e945f640 1 -- 172.21.15.94:0/2303486938 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36dc00a2d0 con 0x7f36e40c5cc0 2024-04-25T12:24:10.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.807+0000 7f36e945f640 1 -- 172.21.15.94:0/2303486938 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36dc0a6810 con 0x7f36e40c5cc0 2024-04-25T12:24:10.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.807+0000 7f36e945f640 1 -- 172.21.15.94:0/2303486938 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36dc0a6be0 con 0x7f36e40c5cc0 2024-04-25T12:24:10.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.807+0000 7f36ec6c5640 1 -- 172.21.15.94:0/2303486938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36e40c5cc0 msgr2=0x7f36e4161eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:10.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.807+0000 7f36ec6c5640 1 --2- 172.21.15.94:0/2303486938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36e40c5cc0 0x7f36e4161eb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f36dc00af60 tx=0x7f36dc01d9d0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.807+0000 7f36ec6c5640 1 -- 172.21.15.94:0/2303486938 shutdown_connections 2024-04-25T12:24:10.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.807+0000 7f36ec6c5640 1 --2- 172.21.15.94:0/2303486938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36e40c5cc0 0x7f36e4161eb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.807+0000 7f36ec6c5640 1 --2- 172.21.15.94:0/2303486938 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f36e40c4b40 0x7f36e40c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.807+0000 7f36ec6c5640 1 -- 172.21.15.94:0/2303486938 >> 172.21.15.94:0/2303486938 conn(0x7f36e406b9d0 msgr2=0x7f36e406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:10.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.807+0000 7f36ec6c5640 1 -- 172.21.15.94:0/2303486938 shutdown_connections 2024-04-25T12:24:10.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.807+0000 7f36ec6c5640 1 -- 172.21.15.94:0/2303486938 wait complete. 2024-04-25T12:24:10.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.807+0000 7f36ec6c5640 1 Processor -- start 2024-04-25T12:24:10.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.807+0000 7f36ec6c5640 1 -- start start 2024-04-25T12:24:10.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.807+0000 7f36ec6c5640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f36e40c4b40 0x7f36e41f0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:10.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.807+0000 7f36ec6c5640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f36e40c5cc0 0x7f36e406efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:10.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.807+0000 7f36ec6c5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36e40c8800 0x7f36e4151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:10.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.807+0000 7f36ec6c5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f36e4074280 con 0x7f36e40c8800 2024-04-25T12:24:10.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.807+0000 7f36ec6c5640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f36e40c52f0 con 0x7f36e40c4b40 2024-04-25T12:24:10.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.807+0000 7f36ec6c5640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f36e4068610 con 0x7f36e40c5cc0 2024-04-25T12:24:10.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.807+0000 7f36eac62640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36e40c8800 0x7f36e4151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:10.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.807+0000 7f36eac62640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36e40c8800 0x7f36e4151170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57180/0 (socket says 172.21.15.94:57180) 2024-04-25T12:24:10.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.807+0000 7f36eac62640 1 -- 172.21.15.94:0/866482400 learned_addr learned my addr 172.21.15.94:0/866482400 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:10.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.807+0000 7f36e9c60640 1 --2- 172.21.15.94:0/866482400 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f36e40c5cc0 0x7f36e406efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:10.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.807+0000 7f36ea461640 1 --2- 172.21.15.94:0/866482400 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f36e40c4b40 0x7f36e41f0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:10.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.811+0000 7f36eac62640 1 -- 172.21.15.94:0/866482400 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f36e40c5cc0 msgr2=0x7f36e406efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:10.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.811+0000 7f36eac62640 1 --2- 172.21.15.94:0/866482400 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f36e40c5cc0 0x7f36e406efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.811+0000 7f36eac62640 1 -- 172.21.15.94:0/866482400 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f36e40c4b40 msgr2=0x7f36e41f0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:10.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.811+0000 7f36eac62640 1 --2- 172.21.15.94:0/866482400 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f36e40c4b40 0x7f36e41f0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.811+0000 7f36eac62640 1 -- 172.21.15.94:0/866482400 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e406a6f0 con 0x7f36e40c8800 2024-04-25T12:24:10.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.811+0000 7f36eac62640 1 --2- 172.21.15.94:0/866482400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36e40c8800 0x7f36e4151170 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0b0040 tx=0x7f36dc01a770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:10.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.811+0000 7f36daffd640 1 -- 172.21.15.94:0/866482400 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36dc008910 con 0x7f36e40c8800 2024-04-25T12:24:10.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.811+0000 7f36daffd640 1 -- 172.21.15.94:0/866482400 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36dc0b9070 con 0x7f36e40c8800 2024-04-25T12:24:10.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.811+0000 7f36ec6c5640 1 -- 172.21.15.94:0/866482400 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36e41f0980 con 0x7f36e40c8800 2024-04-25T12:24:10.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.811+0000 7f36daffd640 1 -- 172.21.15.94:0/866482400 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36dc008d30 con 0x7f36e40c8800 2024-04-25T12:24:10.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.811+0000 7f36ec6c5640 1 -- 172.21.15.94:0/866482400 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36e414aed0 con 0x7f36e40c8800 2024-04-25T12:24:10.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.811+0000 7f36ec6c5640 1 -- 172.21.15.94:0/866482400 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36e4075df0 con 0x7f36e40c8800 2024-04-25T12:24:10.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.811+0000 7f36daffd640 1 -- 172.21.15.94:0/866482400 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f36dc0b5440 con 0x7f36e40c8800 2024-04-25T12:24:10.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.811+0000 7f36daffd640 1 --2- 172.21.15.94:0/866482400 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f36c80683b0 0x7f36c806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:10.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.811+0000 7f36ea461640 1 --2- 172.21.15.94:0/866482400 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f36c80683b0 0x7f36c806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:10.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.811+0000 7f36daffd640 1 -- 172.21.15.94:0/866482400 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f36dc123620 con 0x7f36e40c8800 2024-04-25T12:24:10.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.811+0000 7f36ea461640 1 --2- 172.21.15.94:0/866482400 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f36c80683b0 0x7f36c806a870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f36e00098e0 tx=0x7f36e0009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:10.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.815+0000 7f36daffd640 1 -- 172.21.15.94:0/866482400 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f36dc0c5070 con 0x7f36e40c8800 2024-04-25T12:24:10.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.975+0000 7f36ec6c5640 1 -- 172.21.15.94:0/866482400 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f36e4155ba0 con 0x7f36e40c8800 2024-04-25T12:24:10.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.979+0000 7f36daffd640 1 -- 172.21.15.94:0/866482400 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7f36dc0176e0 con 0x7f36e40c8800 2024-04-25T12:24:10.982 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2024-04-25T12:24:10.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.979+0000 7f36ec6c5640 1 -- 172.21.15.94:0/866482400 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f36c80683b0 msgr2=0x7f36c806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:10.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.979+0000 7f36ec6c5640 1 --2- 172.21.15.94:0/866482400 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f36c80683b0 0x7f36c806a870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f36e00098e0 tx=0x7f36e0009060 comp rx=0 tx=0).stop 2024-04-25T12:24:10.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.979+0000 7f36ec6c5640 1 -- 172.21.15.94:0/866482400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36e40c8800 msgr2=0x7f36e4151170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:10.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.979+0000 7f36ec6c5640 1 --2- 172.21.15.94:0/866482400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36e40c8800 0x7f36e4151170 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0b0040 tx=0x7f36dc01a770 comp rx=0 tx=0).stop 2024-04-25T12:24:10.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.979+0000 7f36ec6c5640 1 -- 172.21.15.94:0/866482400 shutdown_connections 2024-04-25T12:24:10.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.979+0000 7f36ec6c5640 1 --2- 172.21.15.94:0/866482400 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f36c80683b0 0x7f36c806a870 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.979+0000 7f36ec6c5640 1 --2- 172.21.15.94:0/866482400 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f36e40c5cc0 0x7f36e406efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.979+0000 7f36ec6c5640 1 --2- 172.21.15.94:0/866482400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36e40c8800 0x7f36e4151170 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.979+0000 7f36ec6c5640 1 --2- 172.21.15.94:0/866482400 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f36e40c4b40 0x7f36e41f0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:10.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.979+0000 7f36ec6c5640 1 -- 172.21.15.94:0/866482400 >> 172.21.15.94:0/866482400 conn(0x7f36e406b9d0 msgr2=0x7f36e40cbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:10.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.979+0000 7f36ec6c5640 1 -- 172.21.15.94:0/866482400 shutdown_connections 2024-04-25T12:24:10.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:10.979+0000 7f36ec6c5640 1 -- 172.21.15.94:0/866482400 wait complete. 2024-04-25T12:24:11.000 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T12:24:11.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.107+0000 7f675caf7640 1 Processor -- start 2024-04-25T12:24:11.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.107+0000 7f675caf7640 1 -- start start 2024-04-25T12:24:11.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.107+0000 7f675caf7640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6758155300 0x7f67580c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:11.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.107+0000 7f675caf7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f675806f700 0x7f675815e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:11.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.107+0000 7f675caf7640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67580c4e80 con 0x7f675815ec50 2024-04-25T12:24:11.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.107+0000 7f675caf7640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f67580c4230 con 0x7f675806f700 2024-04-25T12:24:11.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.107+0000 7f675caf7640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f67580c5770 con 0x7f6758155300 2024-04-25T12:24:11.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.107+0000 7f674ffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f675806f700 0x7f675815e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:11.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.107+0000 7f674ffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f675806f700 0x7f675815e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57184/0 (socket says 172.21.15.94:57184) 2024-04-25T12:24:11.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.107+0000 7f674ffff640 1 -- 172.21.15.94:0/2665064518 learned_addr learned my addr 172.21.15.94:0/2665064518 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:11.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.107+0000 7f675659c640 1 --2- 172.21.15.94:0/2665064518 >> v2:172.21.15.111:3300/0 conn(0x7f6758155300 0x7f67580c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:11.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.107+0000 7f674ffff640 1 -- 172.21.15.94:0/2665064518 >> v2:172.21.15.111:3300/0 conn(0x7f6758155300 msgr2=0x7f67580c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:11.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.107+0000 7f674ffff640 1 --2- 172.21.15.94:0/2665064518 >> v2:172.21.15.111:3300/0 conn(0x7f6758155300 0x7f67580c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:11.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.107+0000 7f674ffff640 1 -- 172.21.15.94:0/2665064518 >> v1:172.21.15.111:6789/0 conn(0x7f675815ec50 legacy=0x7f67580c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:11.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.107+0000 7f674ffff640 1 -- 172.21.15.94:0/2665064518 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f675815f080 con 0x7f675806f700 2024-04-25T12:24:11.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.107+0000 7f674ffff640 1 --2- 172.21.15.94:0/2665064518 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f675806f700 0x7f675815e710 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6758070da0 tx=0x7f674001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd1c767c3aeeec9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:11.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f6755d9b640 1 -- 172.21.15.94:0/2665064518 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67400b1070 con 0x7f675806f700 2024-04-25T12:24:11.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f6755d9b640 1 -- 172.21.15.94:0/2665064518 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67400ac630 con 0x7f675806f700 2024-04-25T12:24:11.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f6755d9b640 1 -- 172.21.15.94:0/2665064518 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67400a8050 con 0x7f675806f700 2024-04-25T12:24:11.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f675caf7640 1 -- 172.21.15.94:0/2665064518 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f675806f700 msgr2=0x7f675815e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:11.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f675caf7640 1 --2- 172.21.15.94:0/2665064518 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f675806f700 0x7f675815e710 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6758070da0 tx=0x7f674001c4e0 comp rx=0 tx=0).stop 2024-04-25T12:24:11.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f675caf7640 1 -- 172.21.15.94:0/2665064518 shutdown_connections 2024-04-25T12:24:11.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f675caf7640 1 --2- 172.21.15.94:0/2665064518 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f675806f700 0x7f675815e710 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:11.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f675caf7640 1 --2- 172.21.15.94:0/2665064518 >> v2:172.21.15.111:3300/0 conn(0x7f6758155300 0x7f67580c3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:11.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f675caf7640 1 -- 172.21.15.94:0/2665064518 >> 172.21.15.94:0/2665064518 conn(0x7f675806b9d0 msgr2=0x7f675806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:11.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f675caf7640 1 -- 172.21.15.94:0/2665064518 shutdown_connections 2024-04-25T12:24:11.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f675caf7640 1 -- 172.21.15.94:0/2665064518 wait complete. 2024-04-25T12:24:11.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f675caf7640 1 Processor -- start 2024-04-25T12:24:11.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f675caf7640 1 -- start start 2024-04-25T12:24:11.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f675caf7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f675806f700 0x7f6758073e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:11.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f675caf7640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6758155300 0x7f675815b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:11.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f675caf7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f675815ec50 0x7f675815bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:11.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f675caf7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f67580681d0 con 0x7f675815ec50 2024-04-25T12:24:11.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f675caf7640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f675815f600 con 0x7f675806f700 2024-04-25T12:24:11.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f675caf7640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6758068350 con 0x7f6758155300 2024-04-25T12:24:11.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f6756d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f675815ec50 0x7f675815bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:11.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f6756d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f675815ec50 0x7f675815bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57186/0 (socket says 172.21.15.94:57186) 2024-04-25T12:24:11.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f6756d9d640 1 -- 172.21.15.94:0/2537794434 learned_addr learned my addr 172.21.15.94:0/2537794434 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:11.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f675659c640 1 --2- 172.21.15.94:0/2537794434 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f675806f700 0x7f6758073e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:11.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f6756d9d640 1 -- 172.21.15.94:0/2537794434 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6758155300 msgr2=0x7f675815b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:11.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f674ffff640 1 --2- 172.21.15.94:0/2537794434 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6758155300 0x7f675815b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:11.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f6756d9d640 1 --2- 172.21.15.94:0/2537794434 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6758155300 0x7f675815b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:11.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f6756d9d640 1 -- 172.21.15.94:0/2537794434 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f675806f700 msgr2=0x7f6758073e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:11.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f6756d9d640 1 --2- 172.21.15.94:0/2537794434 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f675806f700 0x7f6758073e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:11.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f6756d9d640 1 -- 172.21.15.94:0/2537794434 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6758072be0 con 0x7f675815ec50 2024-04-25T12:24:11.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f6756d9d640 1 --2- 172.21.15.94:0/2537794434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f675815ec50 0x7f675815bac0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f675000b970 tx=0x7f675000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:11.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f674effd640 1 -- 172.21.15.94:0/2537794434 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6750019070 con 0x7f675815ec50 2024-04-25T12:24:11.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f674effd640 1 -- 172.21.15.94:0/2537794434 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f675000cb40 con 0x7f675815ec50 2024-04-25T12:24:11.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.111+0000 7f674effd640 1 -- 172.21.15.94:0/2537794434 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6750014440 con 0x7f675815ec50 2024-04-25T12:24:11.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.115+0000 7f675caf7640 1 -- 172.21.15.94:0/2537794434 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67581590f0 con 0x7f675815ec50 2024-04-25T12:24:11.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.115+0000 7f675caf7640 1 -- 172.21.15.94:0/2537794434 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f675815ad80 con 0x7f675815ec50 2024-04-25T12:24:11.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.115+0000 7f675caf7640 1 -- 172.21.15.94:0/2537794434 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6758075df0 con 0x7f675815ec50 2024-04-25T12:24:11.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.115+0000 7f674effd640 1 -- 172.21.15.94:0/2537794434 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f675001c070 con 0x7f675815ec50 2024-04-25T12:24:11.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.115+0000 7f674effd640 1 --2- 172.21.15.94:0/2537794434 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6738068380 0x7f673806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:11.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.115+0000 7f675659c640 1 --2- 172.21.15.94:0/2537794434 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6738068380 0x7f673806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:11.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.115+0000 7f674effd640 1 -- 172.21.15.94:0/2537794434 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f67500869f0 con 0x7f675815ec50 2024-04-25T12:24:11.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.115+0000 7f675659c640 1 --2- 172.21.15.94:0/2537794434 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6738068380 0x7f673806a840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f674800b9d0 tx=0x7f6748008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:11.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.119+0000 7f674effd640 1 -- 172.21.15.94:0/2537794434 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6750056c50 con 0x7f675815ec50 2024-04-25T12:24:11.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.279+0000 7f675caf7640 1 -- 172.21.15.94:0/2537794434 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f67580751d0 con 0x7f675815ec50 2024-04-25T12:24:11.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.283+0000 7f674effd640 1 -- 172.21.15.94:0/2537794434 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7f6750056550 con 0x7f675815ec50 2024-04-25T12:24:11.286 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2024-04-25T12:24:11.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.283+0000 7f675caf7640 1 -- 172.21.15.94:0/2537794434 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6738068380 msgr2=0x7f673806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:11.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.283+0000 7f675caf7640 1 --2- 172.21.15.94:0/2537794434 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6738068380 0x7f673806a840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f674800b9d0 tx=0x7f6748008040 comp rx=0 tx=0).stop 2024-04-25T12:24:11.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.283+0000 7f675caf7640 1 -- 172.21.15.94:0/2537794434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f675815ec50 msgr2=0x7f675815bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:11.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.283+0000 7f675caf7640 1 --2- 172.21.15.94:0/2537794434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f675815ec50 0x7f675815bac0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f675000b970 tx=0x7f675000be30 comp rx=0 tx=0).stop 2024-04-25T12:24:11.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.283+0000 7f675caf7640 1 -- 172.21.15.94:0/2537794434 shutdown_connections 2024-04-25T12:24:11.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.283+0000 7f675caf7640 1 --2- 172.21.15.94:0/2537794434 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6738068380 0x7f673806a840 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:11.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.283+0000 7f675caf7640 1 --2- 172.21.15.94:0/2537794434 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6758155300 0x7f675815b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:11.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.283+0000 7f675caf7640 1 --2- 172.21.15.94:0/2537794434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f675815ec50 0x7f675815bac0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:11.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.283+0000 7f675caf7640 1 --2- 172.21.15.94:0/2537794434 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f675806f700 0x7f6758073e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:11.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.283+0000 7f675caf7640 1 -- 172.21.15.94:0/2537794434 >> 172.21.15.94:0/2537794434 conn(0x7f675806b9d0 msgr2=0x7f675815e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:11.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.283+0000 7f675caf7640 1 -- 172.21.15.94:0/2537794434 shutdown_connections 2024-04-25T12:24:11.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:11.283+0000 7f675caf7640 1 -- 172.21.15.94:0/2537794434 wait complete. 2024-04-25T12:24:11.304 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi094.front.sepia.ceph.com... 2024-04-25T12:24:11.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:11.304 DEBUG:teuthology.orchestra.run.smithi094:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-25T12:24:11.325 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi094.stderr:ceph-fuse[32723]: fuse finished with error 0 and tester_r 0 2024-04-25T12:24:11.328 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:24:17.429 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2024-04-25T12:24:17.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:17.430 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-25T12:24:17.452 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:24:17.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc13dd6e640 1 Processor -- start 2024-04-25T12:24:17.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc13dd6e640 1 -- start start 2024-04-25T12:24:17.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc13dd6e640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fc1380c8630 0x7fc138151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:17.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc13dd6e640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc13815b740 con 0x7fc1380c8250 2024-04-25T12:24:17.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc13dd6e640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1380c40f0 con 0x7fc1380c8a70 2024-04-25T12:24:17.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc13dd6e640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fc1380c6490 con 0x7fc1380c8630 2024-04-25T12:24:17.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc1377fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc1380c8250 0x7fc1380c39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41556/0 (socket says 172.21.15.94:41556) 2024-04-25T12:24:17.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc1377fe640 1 -- 172.21.15.94:0/1975157044 learned_addr learned my addr 172.21.15.94:0/1975157044 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:17.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc1367fc640 1 -- 172.21.15.94:0/1975157044 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1105614992 0 0) 0x7fc13815b740 con 0x7fc1380c8250 2024-04-25T12:24:17.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc136ffd640 1 --2- 172.21.15.94:0/1975157044 >> v2:172.21.15.111:3300/0 conn(0x7fc1380c8630 0x7fc138151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:17.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc1367fc640 1 -- 172.21.15.94:0/1975157044 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc120003530 con 0x7fc1380c8250 2024-04-25T12:24:17.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc1367fc640 1 -- 172.21.15.94:0/1975157044 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2635458058 0 0) 0x7fc120003530 con 0x7fc1380c8250 2024-04-25T12:24:17.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc1367fc640 1 -- 172.21.15.94:0/1975157044 >> v2:172.21.15.111:3300/0 conn(0x7fc1380c8630 msgr2=0x7fc138151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:17.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc1367fc640 1 --2- 172.21.15.94:0/1975157044 >> v2:172.21.15.111:3300/0 conn(0x7fc1380c8630 0x7fc138151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:17.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc1367fc640 1 -- 172.21.15.94:0/1975157044 >> v1:172.21.15.111:6789/0 conn(0x7fc1380c8a70 legacy=0x7fc138152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:17.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc1367fc640 1 -- 172.21.15.94:0/1975157044 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1380c58c0 con 0x7fc1380c8250 2024-04-25T12:24:17.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc1367fc640 1 -- 172.21.15.94:0/1975157044 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7fc128001680 con 0x7fc1380c8250 2024-04-25T12:24:17.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc1367fc640 1 -- 172.21.15.94:0/1975157044 >> v1:172.21.15.94:6789/0 conn(0x7fc1380c8250 legacy=0x7fc1380c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:17.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc1367fc640 1 --2- 172.21.15.94:0/1975157044 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc1200039c0 0x7fc120003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:17.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc1367fc640 1 --2- 172.21.15.94:0/1975157044 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc120004810 0x7fc120004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:17.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc1367fc640 1 --2- 172.21.15.94:0/1975157044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1200051d0 0x7fc12000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:17.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc1367fc640 1 -- 172.21.15.94:0/1975157044 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc1380c6490 con 0x7fc1200051d0 2024-04-25T12:24:17.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc1367fc640 1 -- 172.21.15.94:0/1975157044 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc12000c170 con 0x7fc120004810 2024-04-25T12:24:17.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc1367fc640 1 -- 172.21.15.94:0/1975157044 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fc12000c370 con 0x7fc1200039c0 2024-04-25T12:24:17.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc137fff640 1 --2- 172.21.15.94:0/1975157044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1200051d0 0x7fc12000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:17.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc1377fe640 1 --2- 172.21.15.94:0/1975157044 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc1200039c0 0x7fc120003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:17.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc136ffd640 1 --2- 172.21.15.94:0/1975157044 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc120004810 0x7fc120004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:17.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc137fff640 1 -- 172.21.15.94:0/1975157044 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc1200039c0 msgr2=0x7fc120003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:17.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc137fff640 1 --2- 172.21.15.94:0/1975157044 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc1200039c0 0x7fc120003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:17.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc137fff640 1 -- 172.21.15.94:0/1975157044 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc120004810 msgr2=0x7fc120004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:17.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc137fff640 1 --2- 172.21.15.94:0/1975157044 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc120004810 0x7fc120004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:17.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc137fff640 1 -- 172.21.15.94:0/1975157044 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc120003530 con 0x7fc1200051d0 2024-04-25T12:24:17.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.619+0000 7fc1377fe640 1 --2- 172.21.15.94:0/1975157044 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc1200039c0 0x7fc120003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:17.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.623+0000 7fc137fff640 1 -- 172.21.15.94:0/1975157044 reap_dead start 2024-04-25T12:24:17.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.623+0000 7fc137fff640 1 --2- 172.21.15.94:0/1975157044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1200051d0 0x7fc12000b9d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc130001e70 tx=0x7fc13001c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b9ec3beda413ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:17.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.623+0000 7fc1367fc640 1 -- 172.21.15.94:0/1975157044 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc130001a90 con 0x7fc1200051d0 2024-04-25T12:24:17.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.623+0000 7fc1367fc640 1 -- 172.21.15.94:0/1975157044 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc130003ba0 con 0x7fc1200051d0 2024-04-25T12:24:17.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.623+0000 7fc1367fc640 1 -- 172.21.15.94:0/1975157044 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc130005020 con 0x7fc1200051d0 2024-04-25T12:24:17.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.623+0000 7fc13dd6e640 1 -- 172.21.15.94:0/1975157044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1200051d0 msgr2=0x7fc12000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:17.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.623+0000 7fc13dd6e640 1 --2- 172.21.15.94:0/1975157044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1200051d0 0x7fc12000b9d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc130001e70 tx=0x7fc13001c780 comp rx=0 tx=0).stop 2024-04-25T12:24:17.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.623+0000 7fc13dd6e640 1 -- 172.21.15.94:0/1975157044 shutdown_connections 2024-04-25T12:24:17.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.623+0000 7fc13dd6e640 1 --2- 172.21.15.94:0/1975157044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1200051d0 0x7fc12000b9d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:17.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.623+0000 7fc13dd6e640 1 -- 172.21.15.94:0/1975157044 >> 172.21.15.94:0/1975157044 conn(0x7fc13806b9d0 msgr2=0x7fc13806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:17.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.623+0000 7fc13dd6e640 1 -- 172.21.15.94:0/1975157044 shutdown_connections 2024-04-25T12:24:17.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.623+0000 7fc13dd6e640 1 -- 172.21.15.94:0/1975157044 wait complete. 2024-04-25T12:24:17.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.623+0000 7fc13dd6e640 1 Processor -- start 2024-04-25T12:24:17.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.623+0000 7fc13dd6e640 1 -- start start 2024-04-25T12:24:17.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc13dd6e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1200051d0 0x7fc138156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:17.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc13dd6e640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc138157d70 0x7fc1380c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:17.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc13dd6e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1381e4c90 0x7fc1381f0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:17.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc13dd6e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc1380c5e40 con 0x7fc1200051d0 2024-04-25T12:24:17.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc13dd6e640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc1380c5710 con 0x7fc1381e4c90 2024-04-25T12:24:17.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc13dd6e640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fc1380c6120 con 0x7fc138157d70 2024-04-25T12:24:17.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc1377fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1200051d0 0x7fc138156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:17.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc1377fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1200051d0 0x7fc138156e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57670/0 (socket says 172.21.15.94:57670) 2024-04-25T12:24:17.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc1377fe640 1 -- 172.21.15.94:0/2900377359 learned_addr learned my addr 172.21.15.94:0/2900377359 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:17.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc137fff640 1 --2- 172.21.15.94:0/2900377359 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1381e4c90 0x7fc1381f0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:17.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc1377fe640 1 -- 172.21.15.94:0/2900377359 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc138157d70 msgr2=0x7fc1380c7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:17.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc1377fe640 1 --2- 172.21.15.94:0/2900377359 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc138157d70 0x7fc1380c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:17.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc1377fe640 1 -- 172.21.15.94:0/2900377359 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1381e4c90 msgr2=0x7fc1381f0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:17.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc1377fe640 1 --2- 172.21.15.94:0/2900377359 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1381e4c90 0x7fc1381f0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:17.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc1377fe640 1 -- 172.21.15.94:0/2900377359 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1381f0040 con 0x7fc1200051d0 2024-04-25T12:24:17.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc1377fe640 1 --2- 172.21.15.94:0/2900377359 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1200051d0 0x7fc138156e10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc128010ba0 tx=0x7fc12800e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:17.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc11ffff640 1 -- 172.21.15.94:0/2900377359 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12801b070 con 0x7fc1200051d0 2024-04-25T12:24:17.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc11ffff640 1 -- 172.21.15.94:0/2900377359 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc128011040 con 0x7fc1200051d0 2024-04-25T12:24:17.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc13dd6e640 1 -- 172.21.15.94:0/2900377359 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc138158840 con 0x7fc1200051d0 2024-04-25T12:24:17.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc11ffff640 1 -- 172.21.15.94:0/2900377359 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128010ea0 con 0x7fc1200051d0 2024-04-25T12:24:17.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc13dd6e640 1 -- 172.21.15.94:0/2900377359 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1381f0590 con 0x7fc1200051d0 2024-04-25T12:24:17.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc13dd6e640 1 -- 172.21.15.94:0/2900377359 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc138075df0 con 0x7fc1200051d0 2024-04-25T12:24:17.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc11ffff640 1 -- 172.21.15.94:0/2900377359 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc12801e070 con 0x7fc1200051d0 2024-04-25T12:24:17.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc11ffff640 1 --2- 172.21.15.94:0/2900377359 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc124068380 0x7fc12406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:17.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc11ffff640 1 -- 172.21.15.94:0/2900377359 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fc1280897c0 con 0x7fc1200051d0 2024-04-25T12:24:17.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc136ffd640 1 --2- 172.21.15.94:0/2900377359 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc124068380 0x7fc12406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:17.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.627+0000 7fc136ffd640 1 --2- 172.21.15.94:0/2900377359 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc124068380 0x7fc12406a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc1381efc60 tx=0x7fc12c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:17.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.631+0000 7fc11ffff640 1 -- 172.21.15.94:0/2900377359 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc128059990 con 0x7fc1200051d0 2024-04-25T12:24:17.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.787+0000 7fc13dd6e640 1 -- 172.21.15.94:0/2900377359 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc138075310 con 0x7fc1200051d0 2024-04-25T12:24:17.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.791+0000 7fc11ffff640 1 -- 172.21.15.94:0/2900377359 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18873 (secure 0 0 0) 0x7fc128059290 con 0x7fc1200051d0 2024-04-25T12:24:17.796 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:17.796 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"7059a9e2-aec4-4b84-b942-caf531e15da3","created":"2024-04-25T12:21:29.118508+0000","modified":"2024-04-25T12:22:34.871807+0000","last_up_change":"2024-04-25T12:21:40.912605+0000","last_in_change":"2024-04-25T12:21:31.372905+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:39.781011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:51.465886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:52.470540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:56.209936+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"640a65ef-0734-468a-a8f5-9ed70cf75c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6809","nonce":2553247564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6811","nonce":2553247564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6815","nonce":2553247564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6813","nonce":2553247564}]},"public_addr":"172.21.15.94:6809/2553247564","cluster_addr":"172.21.15.94:6811/2553247564","heartbeat_back_addr":"172.21.15.94:6815/2553247564","heartbeat_front_addr":"172.21.15.94:6813/2553247564","state":["exists","up"]},{"osd":1,"uuid":"d6e886e6-c8c1-4761-9a4c-abc6961c7c81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6818","nonce":2492806478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6822","nonce":2492806478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6830","nonce":2492806478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6826","nonce":2492806478}]},"public_addr":"172.21.15.94:6818/2492806478","cluster_addr":"172.21.15.94:6822/2492806478","heartbeat_back_addr":"172.21.15.94:6830/2492806478","heartbeat_front_addr":"172.21.15.94:6826/2492806478","state":["exists","up"]},{"osd":2,"uuid":"ba20f409-ed46-43b6-b16d-43dc4622c042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6801","nonce":1485061290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6803","nonce":1485061290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6807","nonce":1485061290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6805","nonce":1485061290}]},"public_addr":"172.21.15.94:6801/1485061290","cluster_addr":"172.21.15.94:6803/1485061290","heartbeat_back_addr":"172.21.15.94:6807/1485061290","heartbeat_front_addr":"172.21.15.94:6805/1485061290","state":["exists","up"]},{"osd":3,"uuid":"85816a2b-3a3f-4ec8-8373-8230d948396f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6819","nonce":1548488434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6823","nonce":1548488434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6829","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6831","nonce":1548488434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6827","nonce":1548488434}]},"public_addr":"172.21.15.94:6819/1548488434","cluster_addr":"172.21.15.94:6823/1548488434","heartbeat_back_addr":"172.21.15.94:6831/1548488434","heartbeat_front_addr":"172.21.15.94:6827/1548488434","state":["exists","up"]},{"osd":4,"uuid":"b4a953b7-01d6-4623-9324-63135fdaf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6811","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6814","nonce":4070977083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6817","nonce":4070977083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6823","nonce":4070977083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6819","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6821","nonce":4070977083}]},"public_addr":"172.21.15.111:6814/4070977083","cluster_addr":"172.21.15.111:6817/4070977083","heartbeat_back_addr":"172.21.15.111:6823/4070977083","heartbeat_front_addr":"172.21.15.111:6821/4070977083","state":["exists","up"]},{"osd":5,"uuid":"c0acc514-427d-41bf-a965-b8463cebf045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6803","nonce":1054925605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6809","nonce":1054925605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6820","nonce":1054925605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6815","nonce":1054925605}]},"public_addr":"172.21.15.111:6803/1054925605","cluster_addr":"172.21.15.111:6809/1054925605","heartbeat_back_addr":"172.21.15.111:6820/1054925605","heartbeat_front_addr":"172.21.15.111:6815/1054925605","state":["exists","up"]},{"osd":6,"uuid":"26ff742f-5a57-44a7-a095-f04d6e87f885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6825","nonce":3619235078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6827","nonce":3619235078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6831","nonce":3619235078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6829","nonce":3619235078}]},"public_addr":"172.21.15.111:6825/3619235078","cluster_addr":"172.21.15.111:6827/3619235078","heartbeat_back_addr":"172.21.15.111:6831/3619235078","heartbeat_front_addr":"172.21.15.111:6829/3619235078","state":["exists","up"]},{"osd":7,"uuid":"9c214cba-693a-4b25-aad7-05a5b0006e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6801","nonce":558758517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6805","nonce":558758517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6813","nonce":558758517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6807","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6808","nonce":558758517}]},"public_addr":"172.21.15.111:6801/558758517","cluster_addr":"172.21.15.111:6805/558758517","heartbeat_back_addr":"172.21.15.111:6813/558758517","heartbeat_front_addr":"172.21.15.111:6808/558758517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.664958+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.853375+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.654455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:37.033852+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.968691+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.856013+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.913496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.848565+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:24:17.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.795+0000 7fc13dd6e640 1 -- 172.21.15.94:0/2900377359 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc124068380 msgr2=0x7fc12406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:17.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.795+0000 7fc13dd6e640 1 --2- 172.21.15.94:0/2900377359 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc124068380 0x7fc12406a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc1381efc60 tx=0x7fc12c008040 comp rx=0 tx=0).stop 2024-04-25T12:24:17.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.795+0000 7fc13dd6e640 1 -- 172.21.15.94:0/2900377359 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1200051d0 msgr2=0x7fc138156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:17.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.795+0000 7fc13dd6e640 1 --2- 172.21.15.94:0/2900377359 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1200051d0 0x7fc138156e10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc128010ba0 tx=0x7fc12800e4d0 comp rx=0 tx=0).stop 2024-04-25T12:24:17.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.795+0000 7fc13dd6e640 1 -- 172.21.15.94:0/2900377359 shutdown_connections 2024-04-25T12:24:17.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.795+0000 7fc13dd6e640 1 --2- 172.21.15.94:0/2900377359 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc124068380 0x7fc12406a840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:17.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.795+0000 7fc13dd6e640 1 --2- 172.21.15.94:0/2900377359 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc138157d70 0x7fc1380c7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:17.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.795+0000 7fc13dd6e640 1 --2- 172.21.15.94:0/2900377359 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1381e4c90 0x7fc1381f0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:17.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.795+0000 7fc13dd6e640 1 --2- 172.21.15.94:0/2900377359 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1200051d0 0x7fc138156e10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:17.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.795+0000 7fc13dd6e640 1 -- 172.21.15.94:0/2900377359 >> 172.21.15.94:0/2900377359 conn(0x7fc13806b9d0 msgr2=0x7fc13806e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:17.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.795+0000 7fc13dd6e640 1 -- 172.21.15.94:0/2900377359 shutdown_connections 2024-04-25T12:24:17.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.795+0000 7fc13dd6e640 1 -- 172.21.15.94:0/2900377359 wait complete. 2024-04-25T12:24:17.814 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:24:17.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.923+0000 7fe6a6794640 1 Processor -- start 2024-04-25T12:24:17.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.927+0000 7fe6a6794640 1 -- start start 2024-04-25T12:24:17.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.927+0000 7fe6a6794640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe6a00c8630 0x7fe6a0151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:17.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.927+0000 7fe6a6794640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6a015b740 con 0x7fe6a00c8250 2024-04-25T12:24:17.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.927+0000 7fe6a6794640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6a00c40f0 con 0x7fe6a00c8a70 2024-04-25T12:24:17.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.927+0000 7fe6a6794640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fe6a00c6490 con 0x7fe6a00c8630 2024-04-25T12:24:17.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.927+0000 7fe69f7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe6a00c8630 0x7fe6a0151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:17.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.927+0000 7fe69ffff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe6a00c8250 0x7fe6a00c39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41572/0 (socket says 172.21.15.94:41572) 2024-04-25T12:24:17.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.927+0000 7fe69f7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe6a00c8630 0x7fe6a0151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57672/0 (socket says 172.21.15.94:57672) 2024-04-25T12:24:17.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.927+0000 7fe69ffff640 1 -- 172.21.15.94:0/3711167683 learned_addr learned my addr 172.21.15.94:0/3711167683 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:17.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.927+0000 7fe69f7fe640 1 -- 172.21.15.94:0/3711167683 >> v1:172.21.15.111:6789/0 conn(0x7fe6a00c8a70 legacy=0x7fe6a0152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:17.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.927+0000 7fe69f7fe640 1 -- 172.21.15.94:0/3711167683 >> v1:172.21.15.94:6789/0 conn(0x7fe6a00c8250 legacy=0x7fe6a00c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:17.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.927+0000 7fe69f7fe640 1 -- 172.21.15.94:0/3711167683 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a00c58c0 con 0x7fe6a00c8630 2024-04-25T12:24:17.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.927+0000 7fe69effd640 1 -- 172.21.15.94:0/3711167683 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3025978306 0 0) 0x7fe6a015b740 con 0x7fe6a00c8250 2024-04-25T12:24:17.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.927+0000 7fe69f7fe640 1 --2- 172.21.15.94:0/3711167683 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6a00c8630 0x7fe6a0151b40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe6940097c0 tx=0x7fe69401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac81c3af44a7dbb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:17.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.927+0000 7fe69effd640 1 -- 172.21.15.94:0/3711167683 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6940b0070 con 0x7fe6a00c8630 2024-04-25T12:24:17.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.927+0000 7fe69effd640 1 -- 172.21.15.94:0/3711167683 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6940ab600 con 0x7fe6a00c8630 2024-04-25T12:24:17.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe69effd640 1 -- 172.21.15.94:0/3711167683 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6940ab9d0 con 0x7fe6a00c8630 2024-04-25T12:24:17.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe6a6794640 1 -- 172.21.15.94:0/3711167683 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6a00c8630 msgr2=0x7fe6a0151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:17.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe6a6794640 1 --2- 172.21.15.94:0/3711167683 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6a00c8630 0x7fe6a0151b40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe6940097c0 tx=0x7fe69401c410 comp rx=0 tx=0).stop 2024-04-25T12:24:17.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe6a6794640 1 -- 172.21.15.94:0/3711167683 shutdown_connections 2024-04-25T12:24:17.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe6a6794640 1 --2- 172.21.15.94:0/3711167683 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6a00c8630 0x7fe6a0151b40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:17.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe6a6794640 1 -- 172.21.15.94:0/3711167683 >> 172.21.15.94:0/3711167683 conn(0x7fe6a006b9d0 msgr2=0x7fe6a006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:17.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe6a6794640 1 -- 172.21.15.94:0/3711167683 shutdown_connections 2024-04-25T12:24:17.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe6a6794640 1 -- 172.21.15.94:0/3711167683 wait complete. 2024-04-25T12:24:17.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe6a6794640 1 Processor -- start 2024-04-25T12:24:17.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe6a6794640 1 -- start start 2024-04-25T12:24:17.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe6a6794640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6a00c8250 0x7fe6a013d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:17.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe6a6794640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6a00c8630 0x7fe6a013e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:17.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe6a6794640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6a00c8a70 0x7fe6a013bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:17.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe6a6794640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a015b400 con 0x7fe6a00c8a70 2024-04-25T12:24:17.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe6a6794640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a00721a0 con 0x7fe6a00c8250 2024-04-25T12:24:17.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe6a6794640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe6a00c6920 con 0x7fe6a00c8630 2024-04-25T12:24:17.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe6a4d31640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6a00c8a70 0x7fe6a013bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:17.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe6a4d31640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6a00c8a70 0x7fe6a013bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57674/0 (socket says 172.21.15.94:57674) 2024-04-25T12:24:17.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe6a4d31640 1 -- 172.21.15.94:0/3218927899 learned_addr learned my addr 172.21.15.94:0/3218927899 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:17.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe69ffff640 1 --2- 172.21.15.94:0/3218927899 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6a00c8250 0x7fe6a013d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:17.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe6a4d31640 1 -- 172.21.15.94:0/3218927899 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6a00c8630 msgr2=0x7fe6a013e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:17.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe69f7fe640 1 --2- 172.21.15.94:0/3218927899 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6a00c8630 0x7fe6a013e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:17.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe6a4d31640 1 --2- 172.21.15.94:0/3218927899 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6a00c8630 0x7fe6a013e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:17.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe6a4d31640 1 -- 172.21.15.94:0/3218927899 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6a00c8250 msgr2=0x7fe6a013d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:17.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe6a4d31640 1 --2- 172.21.15.94:0/3218927899 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6a00c8250 0x7fe6a013d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:17.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe6a4d31640 1 -- 172.21.15.94:0/3218927899 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a0144220 con 0x7fe6a00c8a70 2024-04-25T12:24:17.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe69ffff640 1 --2- 172.21.15.94:0/3218927899 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6a00c8250 0x7fe6a013d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:17.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe6a4d31640 1 --2- 172.21.15.94:0/3218927899 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6a00c8a70 0x7fe6a013bd10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe69800c760 tx=0x7fe69800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:17.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe69cff9640 1 -- 172.21.15.94:0/3218927899 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe698003b80 con 0x7fe6a00c8a70 2024-04-25T12:24:17.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe69cff9640 1 -- 172.21.15.94:0/3218927899 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe698003d20 con 0x7fe6a00c8a70 2024-04-25T12:24:17.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe6a6794640 1 -- 172.21.15.94:0/3218927899 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a0144500 con 0x7fe6a00c8a70 2024-04-25T12:24:17.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe69cff9640 1 -- 172.21.15.94:0/3218927899 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69800aa30 con 0x7fe6a00c8a70 2024-04-25T12:24:17.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.931+0000 7fe6a6794640 1 -- 172.21.15.94:0/3218927899 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6a0144ac0 con 0x7fe6a00c8a70 2024-04-25T12:24:17.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.935+0000 7fe6a6794640 1 -- 172.21.15.94:0/3218927899 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6a0144e30 con 0x7fe6a00c8a70 2024-04-25T12:24:17.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.935+0000 7fe69cff9640 1 -- 172.21.15.94:0/3218927899 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe69800abd0 con 0x7fe6a00c8a70 2024-04-25T12:24:17.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.935+0000 7fe69cff9640 1 --2- 172.21.15.94:0/3218927899 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe68c068380 0x7fe68c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:17.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.935+0000 7fe69cff9640 1 -- 172.21.15.94:0/3218927899 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fe698086cb0 con 0x7fe6a00c8a70 2024-04-25T12:24:17.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.935+0000 7fe69ffff640 1 --2- 172.21.15.94:0/3218927899 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe68c068380 0x7fe68c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:17.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.935+0000 7fe69ffff640 1 --2- 172.21.15.94:0/3218927899 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe68c068380 0x7fe68c06a840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe690000f70 tx=0x7fe690009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:17.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:17.939+0000 7fe69cff9640 1 -- 172.21.15.94:0/3218927899 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe6a0144e30 con 0x7fe6a00c8a70 2024-04-25T12:24:18.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.095+0000 7fe6a6794640 1 -- 172.21.15.94:0/3218927899 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe6a0075df0 con 0x7fe6a00c8a70 2024-04-25T12:24:18.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.095+0000 7fe69cff9640 1 -- 172.21.15.94:0/3218927899 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18873 (secure 0 0 0) 0x7fe698056df0 con 0x7fe6a00c8a70 2024-04-25T12:24:18.102 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:18.102 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"7059a9e2-aec4-4b84-b942-caf531e15da3","created":"2024-04-25T12:21:29.118508+0000","modified":"2024-04-25T12:22:34.871807+0000","last_up_change":"2024-04-25T12:21:40.912605+0000","last_in_change":"2024-04-25T12:21:31.372905+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:39.781011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:51.465886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:52.470540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:56.209936+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"640a65ef-0734-468a-a8f5-9ed70cf75c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6809","nonce":2553247564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6811","nonce":2553247564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6815","nonce":2553247564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6813","nonce":2553247564}]},"public_addr":"172.21.15.94:6809/2553247564","cluster_addr":"172.21.15.94:6811/2553247564","heartbeat_back_addr":"172.21.15.94:6815/2553247564","heartbeat_front_addr":"172.21.15.94:6813/2553247564","state":["exists","up"]},{"osd":1,"uuid":"d6e886e6-c8c1-4761-9a4c-abc6961c7c81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6818","nonce":2492806478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6822","nonce":2492806478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6830","nonce":2492806478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6826","nonce":2492806478}]},"public_addr":"172.21.15.94:6818/2492806478","cluster_addr":"172.21.15.94:6822/2492806478","heartbeat_back_addr":"172.21.15.94:6830/2492806478","heartbeat_front_addr":"172.21.15.94:6826/2492806478","state":["exists","up"]},{"osd":2,"uuid":"ba20f409-ed46-43b6-b16d-43dc4622c042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6801","nonce":1485061290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6803","nonce":1485061290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6807","nonce":1485061290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6805","nonce":1485061290}]},"public_addr":"172.21.15.94:6801/1485061290","cluster_addr":"172.21.15.94:6803/1485061290","heartbeat_back_addr":"172.21.15.94:6807/1485061290","heartbeat_front_addr":"172.21.15.94:6805/1485061290","state":["exists","up"]},{"osd":3,"uuid":"85816a2b-3a3f-4ec8-8373-8230d948396f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6819","nonce":1548488434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6823","nonce":1548488434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6829","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6831","nonce":1548488434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6827","nonce":1548488434}]},"public_addr":"172.21.15.94:6819/1548488434","cluster_addr":"172.21.15.94:6823/1548488434","heartbeat_back_addr":"172.21.15.94:6831/1548488434","heartbeat_front_addr":"172.21.15.94:6827/1548488434","state":["exists","up"]},{"osd":4,"uuid":"b4a953b7-01d6-4623-9324-63135fdaf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6811","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6814","nonce":4070977083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6817","nonce":4070977083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6823","nonce":4070977083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6819","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6821","nonce":4070977083}]},"public_addr":"172.21.15.111:6814/4070977083","cluster_addr":"172.21.15.111:6817/4070977083","heartbeat_back_addr":"172.21.15.111:6823/4070977083","heartbeat_front_addr":"172.21.15.111:6821/4070977083","state":["exists","up"]},{"osd":5,"uuid":"c0acc514-427d-41bf-a965-b8463cebf045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6803","nonce":1054925605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6809","nonce":1054925605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6820","nonce":1054925605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6815","nonce":1054925605}]},"public_addr":"172.21.15.111:6803/1054925605","cluster_addr":"172.21.15.111:6809/1054925605","heartbeat_back_addr":"172.21.15.111:6820/1054925605","heartbeat_front_addr":"172.21.15.111:6815/1054925605","state":["exists","up"]},{"osd":6,"uuid":"26ff742f-5a57-44a7-a095-f04d6e87f885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6825","nonce":3619235078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6827","nonce":3619235078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6831","nonce":3619235078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6829","nonce":3619235078}]},"public_addr":"172.21.15.111:6825/3619235078","cluster_addr":"172.21.15.111:6827/3619235078","heartbeat_back_addr":"172.21.15.111:6831/3619235078","heartbeat_front_addr":"172.21.15.111:6829/3619235078","state":["exists","up"]},{"osd":7,"uuid":"9c214cba-693a-4b25-aad7-05a5b0006e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6801","nonce":558758517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6805","nonce":558758517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6813","nonce":558758517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6807","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6808","nonce":558758517}]},"public_addr":"172.21.15.111:6801/558758517","cluster_addr":"172.21.15.111:6805/558758517","heartbeat_back_addr":"172.21.15.111:6813/558758517","heartbeat_front_addr":"172.21.15.111:6808/558758517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.664958+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.853375+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.654455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:37.033852+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.968691+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.856013+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.913496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.848565+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:24:18.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.099+0000 7fe6a6794640 1 -- 172.21.15.94:0/3218927899 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe68c068380 msgr2=0x7fe68c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:18.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.099+0000 7fe6a6794640 1 --2- 172.21.15.94:0/3218927899 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe68c068380 0x7fe68c06a840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe690000f70 tx=0x7fe690009040 comp rx=0 tx=0).stop 2024-04-25T12:24:18.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.099+0000 7fe6a6794640 1 -- 172.21.15.94:0/3218927899 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6a00c8a70 msgr2=0x7fe6a013bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:18.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.099+0000 7fe6a6794640 1 --2- 172.21.15.94:0/3218927899 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6a00c8a70 0x7fe6a013bd10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe69800c760 tx=0x7fe69800cc20 comp rx=0 tx=0).stop 2024-04-25T12:24:18.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.099+0000 7fe6a6794640 1 -- 172.21.15.94:0/3218927899 shutdown_connections 2024-04-25T12:24:18.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.099+0000 7fe6a6794640 1 --2- 172.21.15.94:0/3218927899 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe68c068380 0x7fe68c06a840 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:18.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.099+0000 7fe6a6794640 1 --2- 172.21.15.94:0/3218927899 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6a00c8630 0x7fe6a013e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:18.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.099+0000 7fe6a6794640 1 --2- 172.21.15.94:0/3218927899 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6a00c8a70 0x7fe6a013bd10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:18.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.099+0000 7fe6a6794640 1 --2- 172.21.15.94:0/3218927899 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6a00c8250 0x7fe6a013d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:18.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.099+0000 7fe6a6794640 1 -- 172.21.15.94:0/3218927899 >> 172.21.15.94:0/3218927899 conn(0x7fe6a006b9d0 msgr2=0x7fe6a0150a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:18.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.099+0000 7fe6a6794640 1 -- 172.21.15.94:0/3218927899 shutdown_connections 2024-04-25T12:24:18.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.099+0000 7fe6a6794640 1 -- 172.21.15.94:0/3218927899 wait complete. 2024-04-25T12:24:18.119 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T12:24:18.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.235+0000 7f91e97af640 1 Processor -- start 2024-04-25T12:24:18.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.235+0000 7f91e97af640 1 -- start start 2024-04-25T12:24:18.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.239+0000 7f91e97af640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f91e414ffa0 0x7f91e406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:18.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.239+0000 7f91e97af640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f91e4074100 0x7f91e40c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:18.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.239+0000 7f91e97af640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91e40c5d70 con 0x7f91e414fbc0 2024-04-25T12:24:18.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.239+0000 7f91e97af640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f91e40c6050 con 0x7f91e414ffa0 2024-04-25T12:24:18.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.239+0000 7f91e97af640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f91e40c6330 con 0x7f91e4074100 2024-04-25T12:24:18.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.239+0000 7f91e27fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f91e414ffa0 0x7f91e406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:18.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.239+0000 7f91e27fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f91e414ffa0 0x7f91e406f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57680/0 (socket says 172.21.15.94:57680) 2024-04-25T12:24:18.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.239+0000 7f91e27fc640 1 -- 172.21.15.94:0/48399053 learned_addr learned my addr 172.21.15.94:0/48399053 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:18.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.239+0000 7f91e37fe640 1 --2- 172.21.15.94:0/48399053 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f91e4074100 0x7f91e40c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:18.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.239+0000 7f91e27fc640 1 -- 172.21.15.94:0/48399053 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f91e4074100 msgr2=0x7f91e40c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:18.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.239+0000 7f91e27fc640 1 --2- 172.21.15.94:0/48399053 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f91e4074100 0x7f91e40c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:18.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.239+0000 7f91e27fc640 1 -- 172.21.15.94:0/48399053 >> v1:172.21.15.111:6789/0 conn(0x7f91e414fbc0 legacy=0x7f91e40c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:18.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.239+0000 7f91e27fc640 1 -- 172.21.15.94:0/48399053 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e40c6610 con 0x7f91e414ffa0 2024-04-25T12:24:18.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.239+0000 7f91e27fc640 1 --2- 172.21.15.94:0/48399053 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91e414ffa0 0x7f91e406f700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f91d8009870 tx=0x7f91d801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ac0ac3cb3f9fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:18.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.239+0000 7f91e1ffb640 1 -- 172.21.15.94:0/48399053 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d80aa660 con 0x7f91e414ffa0 2024-04-25T12:24:18.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.239+0000 7f91e1ffb640 1 -- 172.21.15.94:0/48399053 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91d80af070 con 0x7f91e414ffa0 2024-04-25T12:24:18.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.239+0000 7f91e1ffb640 1 -- 172.21.15.94:0/48399053 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d80aaa20 con 0x7f91e414ffa0 2024-04-25T12:24:18.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.239+0000 7f91e97af640 1 -- 172.21.15.94:0/48399053 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91e414ffa0 msgr2=0x7f91e406f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:18.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.239+0000 7f91e97af640 1 --2- 172.21.15.94:0/48399053 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91e414ffa0 0x7f91e406f700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f91d8009870 tx=0x7f91d801c520 comp rx=0 tx=0).stop 2024-04-25T12:24:18.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.239+0000 7f91e97af640 1 -- 172.21.15.94:0/48399053 shutdown_connections 2024-04-25T12:24:18.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.239+0000 7f91e97af640 1 --2- 172.21.15.94:0/48399053 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f91e4074100 0x7f91e40c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:18.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.239+0000 7f91e97af640 1 --2- 172.21.15.94:0/48399053 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91e414ffa0 0x7f91e406f700 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:18.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.239+0000 7f91e97af640 1 -- 172.21.15.94:0/48399053 >> 172.21.15.94:0/48399053 conn(0x7f91e406b9d0 msgr2=0x7f91e406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:18.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.239+0000 7f91e97af640 1 -- 172.21.15.94:0/48399053 shutdown_connections 2024-04-25T12:24:18.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.239+0000 7f91e97af640 1 -- 172.21.15.94:0/48399053 wait complete. 2024-04-25T12:24:18.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.243+0000 7f91e97af640 1 Processor -- start 2024-04-25T12:24:18.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.243+0000 7f91e97af640 1 -- start start 2024-04-25T12:24:18.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.243+0000 7f91e97af640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f91e4074100 0x7f91e4142b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:18.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.243+0000 7f91e97af640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91e414fbc0 0x7f91e41f2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:18.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.243+0000 7f91e97af640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91e414ffa0 0x7f91e414b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:18.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.243+0000 7f91e97af640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f91e40c8ab0 con 0x7f91e414ffa0 2024-04-25T12:24:18.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.243+0000 7f91e97af640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f91e40c8930 con 0x7f91e414fbc0 2024-04-25T12:24:18.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.243+0000 7f91e97af640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f91e4166090 con 0x7f91e4074100 2024-04-25T12:24:18.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.243+0000 7f91e37fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91e414ffa0 0x7f91e414b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:18.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.243+0000 7f91e37fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91e414ffa0 0x7f91e414b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57690/0 (socket says 172.21.15.94:57690) 2024-04-25T12:24:18.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.243+0000 7f91e37fe640 1 -- 172.21.15.94:0/2072901594 learned_addr learned my addr 172.21.15.94:0/2072901594 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:18.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.243+0000 7f91e27fc640 1 --2- 172.21.15.94:0/2072901594 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91e414fbc0 0x7f91e41f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:18.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.243+0000 7f91e2ffd640 1 --2- 172.21.15.94:0/2072901594 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f91e4074100 0x7f91e4142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:18.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.243+0000 7f91e37fe640 1 -- 172.21.15.94:0/2072901594 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f91e4074100 msgr2=0x7f91e4142b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:18.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.243+0000 7f91e37fe640 1 --2- 172.21.15.94:0/2072901594 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f91e4074100 0x7f91e4142b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:18.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.243+0000 7f91e37fe640 1 -- 172.21.15.94:0/2072901594 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91e414fbc0 msgr2=0x7f91e41f2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:18.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.243+0000 7f91e37fe640 1 --2- 172.21.15.94:0/2072901594 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91e414fbc0 0x7f91e41f2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:18.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.243+0000 7f91e37fe640 1 -- 172.21.15.94:0/2072901594 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e4143050 con 0x7f91e414ffa0 2024-04-25T12:24:18.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.243+0000 7f91e37fe640 1 --2- 172.21.15.94:0/2072901594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91e414ffa0 0x7f91e414b770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00cd90 tx=0x7f91dc00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:18.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.243+0000 7f91cb7fe640 1 -- 172.21.15.94:0/2072901594 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc003ba0 con 0x7f91e414ffa0 2024-04-25T12:24:18.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.243+0000 7f91cb7fe640 1 -- 172.21.15.94:0/2072901594 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91dc003d60 con 0x7f91e414ffa0 2024-04-25T12:24:18.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.243+0000 7f91cb7fe640 1 -- 172.21.15.94:0/2072901594 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc004260 con 0x7f91e414ffa0 2024-04-25T12:24:18.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.243+0000 7f91e97af640 1 -- 172.21.15.94:0/2072901594 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e41f5a90 con 0x7f91e414ffa0 2024-04-25T12:24:18.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.243+0000 7f91e97af640 1 -- 172.21.15.94:0/2072901594 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e41f6010 con 0x7f91e414ffa0 2024-04-25T12:24:18.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.243+0000 7f91e97af640 1 -- 172.21.15.94:0/2072901594 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91e4075df0 con 0x7f91e414ffa0 2024-04-25T12:24:18.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.247+0000 7f91cb7fe640 1 -- 172.21.15.94:0/2072901594 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f91dc004400 con 0x7f91e414ffa0 2024-04-25T12:24:18.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.247+0000 7f91cb7fe640 1 --2- 172.21.15.94:0/2072901594 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f91d0068380 0x7f91d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:18.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.247+0000 7f91cb7fe640 1 -- 172.21.15.94:0/2072901594 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f91dc0878a0 con 0x7f91e414ffa0 2024-04-25T12:24:18.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.247+0000 7f91e2ffd640 1 --2- 172.21.15.94:0/2072901594 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f91d0068380 0x7f91d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:18.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.247+0000 7f91e2ffd640 1 --2- 172.21.15.94:0/2072901594 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f91d0068380 0x7f91d006a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f91d4003d60 tx=0x7f91d4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:18.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.251+0000 7f91cb7fe640 1 -- 172.21.15.94:0/2072901594 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f91e4143050 con 0x7f91e414ffa0 2024-04-25T12:24:18.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:18.431+0000 7f91e97af640 1 -- 172.21.15.94:0/2072901594 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f91e41437a0 con 0x7f91e414ffa0 2024-04-25T12:24:19.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.147+0000 7f91cb7fe640 1 -- 172.21.15.94:0/2072901594 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f91dc01d340 con 0x7f91e414ffa0 2024-04-25T12:24:19.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.155+0000 7f91e97af640 1 -- 172.21.15.94:0/2072901594 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f91d0068380 msgr2=0x7f91d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:19.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.155+0000 7f91e97af640 1 --2- 172.21.15.94:0/2072901594 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f91d0068380 0x7f91d006a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f91d4003d60 tx=0x7f91d4009040 comp rx=0 tx=0).stop 2024-04-25T12:24:19.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.155+0000 7f91e97af640 1 -- 172.21.15.94:0/2072901594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91e414ffa0 msgr2=0x7f91e414b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:19.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.155+0000 7f91e97af640 1 --2- 172.21.15.94:0/2072901594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91e414ffa0 0x7f91e414b770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00cd90 tx=0x7f91dc00a660 comp rx=0 tx=0).stop 2024-04-25T12:24:19.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.155+0000 7f91e97af640 1 -- 172.21.15.94:0/2072901594 shutdown_connections 2024-04-25T12:24:19.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.155+0000 7f91e97af640 1 --2- 172.21.15.94:0/2072901594 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f91d0068380 0x7f91d006a840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:19.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.155+0000 7f91e97af640 1 --2- 172.21.15.94:0/2072901594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91e414ffa0 0x7f91e414b770 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:19.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.155+0000 7f91e97af640 1 --2- 172.21.15.94:0/2072901594 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91e414fbc0 0x7f91e41f2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:19.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.155+0000 7f91e97af640 1 --2- 172.21.15.94:0/2072901594 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f91e4074100 0x7f91e4142b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:19.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.155+0000 7f91e97af640 1 -- 172.21.15.94:0/2072901594 >> 172.21.15.94:0/2072901594 conn(0x7f91e406b9d0 msgr2=0x7f91e414e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:19.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.155+0000 7f91e97af640 1 -- 172.21.15.94:0/2072901594 shutdown_connections 2024-04-25T12:24:19.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.155+0000 7f91e97af640 1 -- 172.21.15.94:0/2072901594 wait complete. 2024-04-25T12:24:19.182 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300} 2024-04-25T12:24:19.182 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-04-25T12:24:19.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a4742640 1 Processor -- start 2024-04-25T12:24:19.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a4742640 1 -- start start 2024-04-25T12:24:19.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a4742640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff39c0c8630 0x7ff39c151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:19.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a4742640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff39c15b740 con 0x7ff39c0c8a70 2024-04-25T12:24:19.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a4742640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff39c0c40f0 con 0x7ff39c0c8250 2024-04-25T12:24:19.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a4742640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7ff39c0c6490 con 0x7ff39c0c8630 2024-04-25T12:24:19.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a2cdf640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7ff39c0c8a70 0x7ff39c152080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41582/0 (socket says 172.21.15.94:41582) 2024-04-25T12:24:19.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a2cdf640 1 -- 172.21.15.94:0/1238226744 learned_addr learned my addr 172.21.15.94:0/1238226744 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:19.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a1cdd640 1 --2- 172.21.15.94:0/1238226744 >> v2:172.21.15.111:3300/0 conn(0x7ff39c0c8630 0x7ff39c151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:19.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a14dc640 1 -- 172.21.15.94:0/1238226744 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4091497622 0 0) 0x7ff39c15b740 con 0x7ff39c0c8a70 2024-04-25T12:24:19.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a14dc640 1 -- 172.21.15.94:0/1238226744 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff388003530 con 0x7ff39c0c8a70 2024-04-25T12:24:19.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a14dc640 1 -- 172.21.15.94:0/1238226744 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2083206858 0 0) 0x7ff388003530 con 0x7ff39c0c8a70 2024-04-25T12:24:19.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a14dc640 1 -- 172.21.15.94:0/1238226744 >> v2:172.21.15.111:3300/0 conn(0x7ff39c0c8630 msgr2=0x7ff39c151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:19.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a14dc640 1 --2- 172.21.15.94:0/1238226744 >> v2:172.21.15.111:3300/0 conn(0x7ff39c0c8630 0x7ff39c151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:19.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a14dc640 1 -- 172.21.15.94:0/1238226744 >> v1:172.21.15.111:6789/0 conn(0x7ff39c0c8250 legacy=0x7ff39c0c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:19.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a14dc640 1 -- 172.21.15.94:0/1238226744 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39c0c58c0 con 0x7ff39c0c8a70 2024-04-25T12:24:19.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a14dc640 1 -- 172.21.15.94:0/1238226744 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7ff394001a00 con 0x7ff39c0c8a70 2024-04-25T12:24:19.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a14dc640 1 -- 172.21.15.94:0/1238226744 >> v1:172.21.15.94:6789/0 conn(0x7ff39c0c8a70 legacy=0x7ff39c152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:19.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a14dc640 1 --2- 172.21.15.94:0/1238226744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff3880039c0 0x7ff388003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:19.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a14dc640 1 --2- 172.21.15.94:0/1238226744 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff388004810 0x7ff388004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:19.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a14dc640 1 --2- 172.21.15.94:0/1238226744 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3880051d0 0x7ff38800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:19.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a14dc640 1 -- 172.21.15.94:0/1238226744 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff39c0c6490 con 0x7ff3880051d0 2024-04-25T12:24:19.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a14dc640 1 -- 172.21.15.94:0/1238226744 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff38800c170 con 0x7ff3880039c0 2024-04-25T12:24:19.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a14dc640 1 -- 172.21.15.94:0/1238226744 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff38800c370 con 0x7ff388004810 2024-04-25T12:24:19.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a2cdf640 1 --2- 172.21.15.94:0/1238226744 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3880051d0 0x7ff38800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:19.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a24de640 1 --2- 172.21.15.94:0/1238226744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff3880039c0 0x7ff388003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:19.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a1cdd640 1 --2- 172.21.15.94:0/1238226744 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff388004810 0x7ff388004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:19.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a2cdf640 1 -- 172.21.15.94:0/1238226744 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff388004810 msgr2=0x7ff388004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:19.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a2cdf640 1 --2- 172.21.15.94:0/1238226744 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff388004810 0x7ff388004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:19.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a2cdf640 1 -- 172.21.15.94:0/1238226744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff3880039c0 msgr2=0x7ff388003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:19.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a2cdf640 1 --2- 172.21.15.94:0/1238226744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff3880039c0 0x7ff388003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:19.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a2cdf640 1 -- 172.21.15.94:0/1238226744 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff388003530 con 0x7ff3880051d0 2024-04-25T12:24:19.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.307+0000 7ff3a24de640 1 --2- 172.21.15.94:0/1238226744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff3880039c0 0x7ff388003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:24:19.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.311+0000 7ff3a2cdf640 1 -- 172.21.15.94:0/1238226744 reap_dead start 2024-04-25T12:24:19.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.311+0000 7ff3a2cdf640 1 --2- 172.21.15.94:0/1238226744 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3880051d0 0x7ff38800b9d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff39400a840 tx=0x7ff39401fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794d6d582f57a9c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:19.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.311+0000 7ff3a14dc640 1 -- 172.21.15.94:0/1238226744 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39400a460 con 0x7ff3880051d0 2024-04-25T12:24:19.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.311+0000 7ff3a14dc640 1 -- 172.21.15.94:0/1238226744 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3940aa710 con 0x7ff3880051d0 2024-04-25T12:24:19.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.311+0000 7ff3a14dc640 1 -- 172.21.15.94:0/1238226744 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3940aab00 con 0x7ff3880051d0 2024-04-25T12:24:19.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.311+0000 7ff3a4742640 1 -- 172.21.15.94:0/1238226744 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3880051d0 msgr2=0x7ff38800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:19.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.311+0000 7ff3a4742640 1 --2- 172.21.15.94:0/1238226744 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3880051d0 0x7ff38800b9d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff39400a840 tx=0x7ff39401fac0 comp rx=0 tx=0).stop 2024-04-25T12:24:19.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.311+0000 7ff3a4742640 1 -- 172.21.15.94:0/1238226744 shutdown_connections 2024-04-25T12:24:19.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.311+0000 7ff3a4742640 1 --2- 172.21.15.94:0/1238226744 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3880051d0 0x7ff38800b9d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:19.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.311+0000 7ff3a4742640 1 -- 172.21.15.94:0/1238226744 >> 172.21.15.94:0/1238226744 conn(0x7ff39c06b9d0 msgr2=0x7ff39c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:19.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.311+0000 7ff3a4742640 1 -- 172.21.15.94:0/1238226744 shutdown_connections 2024-04-25T12:24:19.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.311+0000 7ff3a4742640 1 -- 172.21.15.94:0/1238226744 wait complete. 2024-04-25T12:24:19.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.311+0000 7ff3a4742640 1 Processor -- start 2024-04-25T12:24:19.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.311+0000 7ff3a4742640 1 -- start start 2024-04-25T12:24:19.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.311+0000 7ff3a4742640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3880051d0 0x7ff39c1451a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:19.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.311+0000 7ff3a4742640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff39c156ea0 0x7ff39c158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:19.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.311+0000 7ff3a4742640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff39c1566d0 0x7ff39c14e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:19.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.311+0000 7ff3a4742640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff39c0c5e40 con 0x7ff3880051d0 2024-04-25T12:24:19.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.311+0000 7ff3a4742640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff39c0c5710 con 0x7ff39c1566d0 2024-04-25T12:24:19.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.311+0000 7ff3a4742640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff39c0c6120 con 0x7ff39c156ea0 2024-04-25T12:24:19.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.311+0000 7ff3a24de640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3880051d0 0x7ff39c1451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:19.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.311+0000 7ff3a24de640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3880051d0 0x7ff39c1451a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57708/0 (socket says 172.21.15.94:57708) 2024-04-25T12:24:19.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.311+0000 7ff3a24de640 1 -- 172.21.15.94:0/3353058791 learned_addr learned my addr 172.21.15.94:0/3353058791 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:19.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.315+0000 7ff3a1cdd640 1 --2- 172.21.15.94:0/3353058791 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff39c156ea0 0x7ff39c158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:19.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.315+0000 7ff3a2cdf640 1 --2- 172.21.15.94:0/3353058791 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff39c1566d0 0x7ff39c14e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:19.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.315+0000 7ff3a24de640 1 -- 172.21.15.94:0/3353058791 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff39c156ea0 msgr2=0x7ff39c158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:19.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.315+0000 7ff3a24de640 1 --2- 172.21.15.94:0/3353058791 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff39c156ea0 0x7ff39c158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:19.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.315+0000 7ff3a24de640 1 -- 172.21.15.94:0/3353058791 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff39c1566d0 msgr2=0x7ff39c14e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:19.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.315+0000 7ff3a24de640 1 --2- 172.21.15.94:0/3353058791 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff39c1566d0 0x7ff39c14e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:19.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.315+0000 7ff3a24de640 1 -- 172.21.15.94:0/3353058791 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39c0c36b0 con 0x7ff3880051d0 2024-04-25T12:24:19.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.315+0000 7ff3a24de640 1 --2- 172.21.15.94:0/3353058791 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3880051d0 0x7ff39c1451a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff39800e440 tx=0x7ff39800e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:19.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.315+0000 7ff392ffd640 1 -- 172.21.15.94:0/3353058791 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff398019070 con 0x7ff3880051d0 2024-04-25T12:24:19.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.315+0000 7ff392ffd640 1 -- 172.21.15.94:0/3353058791 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3980052e0 con 0x7ff3880051d0 2024-04-25T12:24:19.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.315+0000 7ff3a4742640 1 -- 172.21.15.94:0/3353058791 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff39c156b80 con 0x7ff3880051d0 2024-04-25T12:24:19.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.315+0000 7ff392ffd640 1 -- 172.21.15.94:0/3353058791 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff398003840 con 0x7ff3880051d0 2024-04-25T12:24:19.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.315+0000 7ff3a4742640 1 -- 172.21.15.94:0/3353058791 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff39c157ab0 con 0x7ff3880051d0 2024-04-25T12:24:19.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.315+0000 7ff3a4742640 1 -- 172.21.15.94:0/3353058791 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff39c075df0 con 0x7ff3880051d0 2024-04-25T12:24:19.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.315+0000 7ff392ffd640 1 -- 172.21.15.94:0/3353058791 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff39801c070 con 0x7ff3880051d0 2024-04-25T12:24:19.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.315+0000 7ff392ffd640 1 --2- 172.21.15.94:0/3353058791 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff380068380 0x7ff38006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:19.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.315+0000 7ff392ffd640 1 -- 172.21.15.94:0/3353058791 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7ff398086200 con 0x7ff3880051d0 2024-04-25T12:24:19.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.315+0000 7ff3a1cdd640 1 --2- 172.21.15.94:0/3353058791 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff380068380 0x7ff38006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:19.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.315+0000 7ff3a1cdd640 1 --2- 172.21.15.94:0/3353058791 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff380068380 0x7ff38006a840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff39c1f2030 tx=0x7ff38c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:19.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.319+0000 7ff392ffd640 1 -- 172.21.15.94:0/3353058791 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff398055e10 con 0x7ff3880051d0 2024-04-25T12:24:19.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:19.499+0000 7ff3a4742640 1 -- 172.21.15.94:0/3353058791 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7ff39c071e50 con 0x7ff3880051d0 2024-04-25T12:24:19.899 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:24:19.902 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:24:20.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.155+0000 7ff392ffd640 1 -- 172.21.15.94:0/3353058791 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v9) ==== 105+0+0 (secure 0 0 0) 0x7ff39805a110 con 0x7ff3880051d0 2024-04-25T12:24:20.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.159+0000 7ff3a4742640 1 -- 172.21.15.94:0/3353058791 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff380068380 msgr2=0x7ff38006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:20.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.159+0000 7ff3a4742640 1 --2- 172.21.15.94:0/3353058791 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff380068380 0x7ff38006a840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff39c1f2030 tx=0x7ff38c008040 comp rx=0 tx=0).stop 2024-04-25T12:24:20.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.159+0000 7ff3a4742640 1 -- 172.21.15.94:0/3353058791 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3880051d0 msgr2=0x7ff39c1451a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:20.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.159+0000 7ff3a4742640 1 --2- 172.21.15.94:0/3353058791 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3880051d0 0x7ff39c1451a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff39800e440 tx=0x7ff39800e900 comp rx=0 tx=0).stop 2024-04-25T12:24:20.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.159+0000 7ff3a4742640 1 -- 172.21.15.94:0/3353058791 shutdown_connections 2024-04-25T12:24:20.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.159+0000 7ff3a4742640 1 --2- 172.21.15.94:0/3353058791 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff380068380 0x7ff38006a840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:20.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.159+0000 7ff3a4742640 1 --2- 172.21.15.94:0/3353058791 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff39c156ea0 0x7ff39c158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:20.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.159+0000 7ff3a4742640 1 --2- 172.21.15.94:0/3353058791 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff39c1566d0 0x7ff39c14e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:20.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.159+0000 7ff3a4742640 1 --2- 172.21.15.94:0/3353058791 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3880051d0 0x7ff39c1451a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:20.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.159+0000 7ff3a4742640 1 -- 172.21.15.94:0/3353058791 >> 172.21.15.94:0/3353058791 conn(0x7ff39c06b9d0 msgr2=0x7ff39c0c42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:20.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.159+0000 7ff3a4742640 1 -- 172.21.15.94:0/3353058791 shutdown_connections 2024-04-25T12:24:20.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.159+0000 7ff3a4742640 1 -- 172.21.15.94:0/3353058791 wait complete. 2024-04-25T12:24:20.187 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T12:24:20.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.311+0000 7fe7a676e640 1 Processor -- start 2024-04-25T12:24:20.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.311+0000 7fe7a676e640 1 -- start start 2024-04-25T12:24:20.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.311+0000 7fe7a676e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe7a00c5f20 0x7fe7a00c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:20.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.311+0000 7fe7a676e640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe7a00c6300 0x7fe7a0152c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:20.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.311+0000 7fe7a676e640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7a00ca960 con 0x7fe7a00c9c10 2024-04-25T12:24:20.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.311+0000 7fe7a676e640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fe7a00c7f30 con 0x7fe7a00c5f20 2024-04-25T12:24:20.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.311+0000 7fe7a676e640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fe7a00ca0c0 con 0x7fe7a00c6300 2024-04-25T12:24:20.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.311+0000 7fe79ffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe7a00c5f20 0x7fe7a00c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:20.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.311+0000 7fe79ffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe7a00c5f20 0x7fe7a00c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57714/0 (socket says 172.21.15.94:57714) 2024-04-25T12:24:20.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.311+0000 7fe79f7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe7a00c9c10 0x7fe7a00c91c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41588/0 (socket says 172.21.15.94:41588) 2024-04-25T12:24:20.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.311+0000 7fe79ffff640 1 -- 172.21.15.94:0/4199434710 learned_addr learned my addr 172.21.15.94:0/4199434710 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:20.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.311+0000 7fe7a4d0b640 1 --2- 172.21.15.94:0/4199434710 >> v2:172.21.15.111:3300/0 conn(0x7fe7a00c6300 0x7fe7a0152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:20.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.311+0000 7fe79ffff640 1 -- 172.21.15.94:0/4199434710 >> v2:172.21.15.111:3300/0 conn(0x7fe7a00c6300 msgr2=0x7fe7a0152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:20.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.311+0000 7fe79ffff640 1 --2- 172.21.15.94:0/4199434710 >> v2:172.21.15.111:3300/0 conn(0x7fe7a00c6300 0x7fe7a0152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:20.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.311+0000 7fe79ffff640 1 -- 172.21.15.94:0/4199434710 >> v1:172.21.15.94:6789/0 conn(0x7fe7a00c9c10 legacy=0x7fe7a00c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:20.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.311+0000 7fe79effd640 1 -- 172.21.15.94:0/4199434710 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1409662691 0 0) 0x7fe7a00ca960 con 0x7fe7a00c9c10 2024-04-25T12:24:20.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.311+0000 7fe79ffff640 1 -- 172.21.15.94:0/4199434710 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a00ca3a0 con 0x7fe7a00c5f20 2024-04-25T12:24:20.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.311+0000 7fe7a4d0b640 1 --2- 172.21.15.94:0/4199434710 >> v2:172.21.15.111:3300/0 conn(0x7fe7a00c6300 0x7fe7a0152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:20.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe79ffff640 1 --2- 172.21.15.94:0/4199434710 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7a00c5f20 0x7fe7a00c86f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0159ed0 tx=0x7fe79401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c84dfc2dcf363b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:20.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe79effd640 1 -- 172.21.15.94:0/4199434710 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7940b5070 con 0x7fe7a00c5f20 2024-04-25T12:24:20.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe79effd640 1 -- 172.21.15.94:0/4199434710 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7940a8a10 con 0x7fe7a00c5f20 2024-04-25T12:24:20.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe79effd640 1 -- 172.21.15.94:0/4199434710 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7940a8de0 con 0x7fe7a00c5f20 2024-04-25T12:24:20.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe7a676e640 1 -- 172.21.15.94:0/4199434710 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7a00c5f20 msgr2=0x7fe7a00c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:20.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe7a676e640 1 --2- 172.21.15.94:0/4199434710 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7a00c5f20 0x7fe7a00c86f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0159ed0 tx=0x7fe79401ed10 comp rx=0 tx=0).stop 2024-04-25T12:24:20.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe7a676e640 1 -- 172.21.15.94:0/4199434710 shutdown_connections 2024-04-25T12:24:20.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe7a676e640 1 --2- 172.21.15.94:0/4199434710 >> v2:172.21.15.111:3300/0 conn(0x7fe7a00c6300 0x7fe7a0152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:20.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe7a676e640 1 --2- 172.21.15.94:0/4199434710 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7a00c5f20 0x7fe7a00c86f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:20.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe7a676e640 1 -- 172.21.15.94:0/4199434710 >> 172.21.15.94:0/4199434710 conn(0x7fe7a00676a0 msgr2=0x7fe7a0067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:20.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe7a676e640 1 -- 172.21.15.94:0/4199434710 shutdown_connections 2024-04-25T12:24:20.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe7a676e640 1 -- 172.21.15.94:0/4199434710 wait complete. 2024-04-25T12:24:20.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe7a676e640 1 Processor -- start 2024-04-25T12:24:20.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe7a676e640 1 -- start start 2024-04-25T12:24:20.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe7a676e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7a00c5f20 0x7fe7a0157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:20.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe7a676e640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe7a00c6300 0x7fe7a014fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:20.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe7a676e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe7a00c9c10 0x7fe7a015c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:20.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe7a676e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a00c98d0 con 0x7fe7a00c5f20 2024-04-25T12:24:20.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe7a676e640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a00c81d0 con 0x7fe7a00c9c10 2024-04-25T12:24:20.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe7a676e640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe7a00c8c30 con 0x7fe7a00c6300 2024-04-25T12:24:20.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe79ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7a00c5f20 0x7fe7a0157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:20.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe79ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7a00c5f20 0x7fe7a0157f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57720/0 (socket says 172.21.15.94:57720) 2024-04-25T12:24:20.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe79ffff640 1 -- 172.21.15.94:0/3763413755 learned_addr learned my addr 172.21.15.94:0/3763413755 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:20.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe79f7fe640 1 --2- 172.21.15.94:0/3763413755 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe7a00c6300 0x7fe7a014fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:20.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe7a4d0b640 1 --2- 172.21.15.94:0/3763413755 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe7a00c9c10 0x7fe7a015c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:20.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe79ffff640 1 -- 172.21.15.94:0/3763413755 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe7a00c6300 msgr2=0x7fe7a014fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:20.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe79ffff640 1 --2- 172.21.15.94:0/3763413755 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe7a00c6300 0x7fe7a014fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:20.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe79ffff640 1 -- 172.21.15.94:0/3763413755 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe7a00c9c10 msgr2=0x7fe7a015c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:20.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe79ffff640 1 --2- 172.21.15.94:0/3763413755 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe7a00c9c10 0x7fe7a015c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:20.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe79ffff640 1 -- 172.21.15.94:0/3763413755 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a014d150 con 0x7fe7a00c5f20 2024-04-25T12:24:20.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe79ffff640 1 --2- 172.21.15.94:0/3763413755 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7a00c5f20 0x7fe7a0157f20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe79401b920 tx=0x7fe79401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:20.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe79cff9640 1 -- 172.21.15.94:0/3763413755 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7940b5070 con 0x7fe7a00c5f20 2024-04-25T12:24:20.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe79cff9640 1 -- 172.21.15.94:0/3763413755 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7940b0c50 con 0x7fe7a00c5f20 2024-04-25T12:24:20.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe7a676e640 1 -- 172.21.15.94:0/3763413755 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7a01f2470 con 0x7fe7a00c5f20 2024-04-25T12:24:20.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe79cff9640 1 -- 172.21.15.94:0/3763413755 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7940bb410 con 0x7fe7a00c5f20 2024-04-25T12:24:20.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.315+0000 7fe7a676e640 1 -- 172.21.15.94:0/3763413755 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7a014d3f0 con 0x7fe7a00c5f20 2024-04-25T12:24:20.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.319+0000 7fe7a676e640 1 -- 172.21.15.94:0/3763413755 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7a0157970 con 0x7fe7a00c5f20 2024-04-25T12:24:20.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.319+0000 7fe79cff9640 1 -- 172.21.15.94:0/3763413755 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe7940c2060 con 0x7fe7a00c5f20 2024-04-25T12:24:20.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.319+0000 7fe79cff9640 1 --2- 172.21.15.94:0/3763413755 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe78c0683b0 0x7fe78c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:20.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.319+0000 7fe79cff9640 1 -- 172.21.15.94:0/3763413755 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fe794124080 con 0x7fe7a00c5f20 2024-04-25T12:24:20.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.319+0000 7fe79f7fe640 1 --2- 172.21.15.94:0/3763413755 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe78c0683b0 0x7fe78c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:20.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.319+0000 7fe79f7fe640 1 --2- 172.21.15.94:0/3763413755 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe78c0683b0 0x7fe78c06a870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe790007fd0 tx=0x7fe790009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:20.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.323+0000 7fe79cff9640 1 -- 172.21.15.94:0/3763413755 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe794018870 con 0x7fe7a00c5f20 2024-04-25T12:24:20.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:20.523+0000 7fe7a676e640 1 -- 172.21.15.94:0/3763413755 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe7a0075df0 con 0x7fe7a00c5f20 2024-04-25T12:24:21.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.171+0000 7fe79cff9640 1 -- 172.21.15.94:0/3763413755 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7fe7940f4240 con 0x7fe7a00c5f20 2024-04-25T12:24:21.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.175+0000 7fe7a676e640 1 -- 172.21.15.94:0/3763413755 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe78c0683b0 msgr2=0x7fe78c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:21.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.175+0000 7fe7a676e640 1 --2- 172.21.15.94:0/3763413755 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe78c0683b0 0x7fe78c06a870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe790007fd0 tx=0x7fe790009040 comp rx=0 tx=0).stop 2024-04-25T12:24:21.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.175+0000 7fe7a676e640 1 -- 172.21.15.94:0/3763413755 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7a00c5f20 msgr2=0x7fe7a0157f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:21.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.175+0000 7fe7a676e640 1 --2- 172.21.15.94:0/3763413755 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7a00c5f20 0x7fe7a0157f20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe79401b920 tx=0x7fe79401bab0 comp rx=0 tx=0).stop 2024-04-25T12:24:21.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.175+0000 7fe7a676e640 1 -- 172.21.15.94:0/3763413755 shutdown_connections 2024-04-25T12:24:21.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.175+0000 7fe7a676e640 1 --2- 172.21.15.94:0/3763413755 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe78c0683b0 0x7fe78c06a870 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:21.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.175+0000 7fe7a676e640 1 --2- 172.21.15.94:0/3763413755 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe7a00c6300 0x7fe7a014fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:21.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.175+0000 7fe7a676e640 1 --2- 172.21.15.94:0/3763413755 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe7a00c9c10 0x7fe7a015c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:21.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.175+0000 7fe7a676e640 1 --2- 172.21.15.94:0/3763413755 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7a00c5f20 0x7fe7a0157f20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:21.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.175+0000 7fe7a676e640 1 -- 172.21.15.94:0/3763413755 >> 172.21.15.94:0/3763413755 conn(0x7fe7a00676a0 msgr2=0x7fe7a0071160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:21.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.175+0000 7fe7a676e640 1 -- 172.21.15.94:0/3763413755 shutdown_connections 2024-04-25T12:24:21.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.175+0000 7fe7a676e640 1 -- 172.21.15.94:0/3763413755 wait complete. 2024-04-25T12:24:21.197 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-25T12:24:21.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.319+0000 7f69f358a640 1 Processor -- start 2024-04-25T12:24:21.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.319+0000 7f69f358a640 1 -- start start 2024-04-25T12:24:21.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69f358a640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69ec0cda50 0x7f69ec0c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:21.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69f358a640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69ec15beb0 con 0x7f69ec155350 2024-04-25T12:24:21.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69f358a640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69ec0ccc90 con 0x7f69ec15b0b0 2024-04-25T12:24:21.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69f358a640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f69ec0cca40 con 0x7f69ec0cda50 2024-04-25T12:24:21.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69f1326640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f69ec155350 0x7f69ec0cb7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:41594/0 (socket says 172.21.15.94:41594) 2024-04-25T12:24:21.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69f1326640 1 -- 172.21.15.94:0/950239914 learned_addr learned my addr 172.21.15.94:0/950239914 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:21.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69f0b25640 1 --2- 172.21.15.94:0/950239914 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69ec0cda50 0x7f69ec0c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:21.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69e3fff640 1 -- 172.21.15.94:0/950239914 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2880429172 0 0) 0x7f69ec15beb0 con 0x7f69ec155350 2024-04-25T12:24:21.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69e3fff640 1 -- 172.21.15.94:0/950239914 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69d8003530 con 0x7f69ec155350 2024-04-25T12:24:21.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69e3fff640 1 -- 172.21.15.94:0/950239914 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1505936850 0 0) 0x7f69d8003530 con 0x7f69ec155350 2024-04-25T12:24:21.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69e3fff640 1 -- 172.21.15.94:0/950239914 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69ec0cda50 msgr2=0x7f69ec0c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:21.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69e3fff640 1 --2- 172.21.15.94:0/950239914 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69ec0cda50 0x7f69ec0c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:21.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69e3fff640 1 -- 172.21.15.94:0/950239914 >> v1:172.21.15.111:6789/0 conn(0x7f69ec15b0b0 legacy=0x7f69ec15b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:21.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69e3fff640 1 -- 172.21.15.94:0/950239914 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69ec0ccf70 con 0x7f69ec155350 2024-04-25T12:24:21.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69e3fff640 1 -- 172.21.15.94:0/950239914 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7f69dc001680 con 0x7f69ec155350 2024-04-25T12:24:21.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69e3fff640 1 -- 172.21.15.94:0/950239914 >> v1:172.21.15.94:6789/0 conn(0x7f69ec155350 legacy=0x7f69ec0cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:21.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69e3fff640 1 --2- 172.21.15.94:0/950239914 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69d80039f0 0x7f69d8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:21.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69e3fff640 1 --2- 172.21.15.94:0/950239914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69d8004810 0x7f69d8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:21.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69e3fff640 1 --2- 172.21.15.94:0/950239914 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69d80051d0 0x7f69d800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:21.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69e3fff640 1 -- 172.21.15.94:0/950239914 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec0cca40 con 0x7f69d8004810 2024-04-25T12:24:21.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69e3fff640 1 -- 172.21.15.94:0/950239914 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f69d800c080 con 0x7f69d80051d0 2024-04-25T12:24:21.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69e3fff640 1 -- 172.21.15.94:0/950239914 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f69d800c280 con 0x7f69d80039f0 2024-04-25T12:24:21.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69f0b25640 1 --2- 172.21.15.94:0/950239914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69d8004810 0x7f69d8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:21.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69f1326640 1 --2- 172.21.15.94:0/950239914 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69d80039f0 0x7f69d8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:21.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69f1b27640 1 --2- 172.21.15.94:0/950239914 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69d80051d0 0x7f69d800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:21.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69f0b25640 1 -- 172.21.15.94:0/950239914 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69d80039f0 msgr2=0x7f69d8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:21.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69f0b25640 1 --2- 172.21.15.94:0/950239914 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69d80039f0 0x7f69d8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:21.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69f0b25640 1 -- 172.21.15.94:0/950239914 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69d80051d0 msgr2=0x7f69d800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:21.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69f0b25640 1 --2- 172.21.15.94:0/950239914 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69d80051d0 0x7f69d800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:21.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69f0b25640 1 -- 172.21.15.94:0/950239914 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d8003530 con 0x7f69d8004810 2024-04-25T12:24:21.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.323+0000 7f69f1b27640 1 --2- 172.21.15.94:0/950239914 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69d80051d0 0x7f69d800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:24:21.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.327+0000 7f69f0b25640 1 --2- 172.21.15.94:0/950239914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69d8004810 0x7f69d8004c90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f69ec158cc0 tx=0x7f69e801c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49914de69f15eca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:21.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.327+0000 7f69e3fff640 1 -- 172.21.15.94:0/950239914 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e800b550 con 0x7f69d8004810 2024-04-25T12:24:21.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.327+0000 7f69e3fff640 1 -- 172.21.15.94:0/950239914 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69e80b1070 con 0x7f69d8004810 2024-04-25T12:24:21.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.327+0000 7f69e3fff640 1 -- 172.21.15.94:0/950239914 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e80ac850 con 0x7f69d8004810 2024-04-25T12:24:21.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.327+0000 7f69f358a640 1 -- 172.21.15.94:0/950239914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69d8004810 msgr2=0x7f69d8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:21.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.327+0000 7f69f358a640 1 --2- 172.21.15.94:0/950239914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69d8004810 0x7f69d8004c90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f69ec158cc0 tx=0x7f69e801c580 comp rx=0 tx=0).stop 2024-04-25T12:24:21.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.327+0000 7f69f1b27640 1 -- 172.21.15.94:0/950239914 reap_dead start 2024-04-25T12:24:21.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.327+0000 7f69f358a640 1 -- 172.21.15.94:0/950239914 shutdown_connections 2024-04-25T12:24:21.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.327+0000 7f69f358a640 1 -- 172.21.15.94:0/950239914 >> 172.21.15.94:0/950239914 conn(0x7f69ec06cc30 msgr2=0x7f69ec06d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:21.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.327+0000 7f69f358a640 1 -- 172.21.15.94:0/950239914 shutdown_connections 2024-04-25T12:24:21.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.327+0000 7f69f358a640 1 -- 172.21.15.94:0/950239914 wait complete. 2024-04-25T12:24:21.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.327+0000 7f69f358a640 1 Processor -- start 2024-04-25T12:24:21.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.327+0000 7f69f358a640 1 -- start start 2024-04-25T12:24:21.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.327+0000 7f69f358a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69d8004810 0x7f69ec150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:21.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.327+0000 7f69f358a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69ec14e8d0 0x7f69ec1f0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:21.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.327+0000 7f69f358a640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69ec1f1220 0x7f69ec14b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:21.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.327+0000 7f69f358a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec0cd530 con 0x7f69ec14e8d0 2024-04-25T12:24:21.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.327+0000 7f69f358a640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec15bc50 con 0x7f69d8004810 2024-04-25T12:24:21.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.327+0000 7f69f358a640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f69ec155730 con 0x7f69ec1f1220 2024-04-25T12:24:21.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.327+0000 7f69f0b25640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69ec14e8d0 0x7f69ec1f0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:21.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.327+0000 7f69f0b25640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69ec14e8d0 0x7f69ec1f0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57746/0 (socket says 172.21.15.94:57746) 2024-04-25T12:24:21.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.327+0000 7f69f0b25640 1 -- 172.21.15.94:0/1770594783 learned_addr learned my addr 172.21.15.94:0/1770594783 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:21.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.327+0000 7f69f1b27640 1 --2- 172.21.15.94:0/1770594783 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69ec1f1220 0x7f69ec14b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:21.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.327+0000 7f69f1326640 1 --2- 172.21.15.94:0/1770594783 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69d8004810 0x7f69ec150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:21.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.331+0000 7f69f0b25640 1 -- 172.21.15.94:0/1770594783 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69ec1f1220 msgr2=0x7f69ec14b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:21.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.331+0000 7f69f0b25640 1 --2- 172.21.15.94:0/1770594783 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69ec1f1220 0x7f69ec14b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:21.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.331+0000 7f69f0b25640 1 -- 172.21.15.94:0/1770594783 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69d8004810 msgr2=0x7f69ec150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:21.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.331+0000 7f69f0b25640 1 --2- 172.21.15.94:0/1770594783 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69d8004810 0x7f69ec150250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:21.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.331+0000 7f69f0b25640 1 -- 172.21.15.94:0/1770594783 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69ec159d50 con 0x7f69ec14e8d0 2024-04-25T12:24:21.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.331+0000 7f69f0b25640 1 --2- 172.21.15.94:0/1770594783 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69ec14e8d0 0x7f69ec1f0ce0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f69e80ae040 tx=0x7f69d8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:21.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.331+0000 7f69e1ffb640 1 -- 172.21.15.94:0/1770594783 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e800b550 con 0x7f69ec14e8d0 2024-04-25T12:24:21.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.331+0000 7f69e1ffb640 1 -- 172.21.15.94:0/1770594783 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69e80ac430 con 0x7f69ec14e8d0 2024-04-25T12:24:21.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.331+0000 7f69f358a640 1 -- 172.21.15.94:0/1770594783 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69ec14f8b0 con 0x7f69ec14e8d0 2024-04-25T12:24:21.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.331+0000 7f69e1ffb640 1 -- 172.21.15.94:0/1770594783 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e80ac820 con 0x7f69ec14e8d0 2024-04-25T12:24:21.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.331+0000 7f69f358a640 1 -- 172.21.15.94:0/1770594783 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69ec14fb50 con 0x7f69ec14e8d0 2024-04-25T12:24:21.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.331+0000 7f69f358a640 1 -- 172.21.15.94:0/1770594783 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69ec075df0 con 0x7f69ec14e8d0 2024-04-25T12:24:21.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.331+0000 7f69e1ffb640 1 -- 172.21.15.94:0/1770594783 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f69e80be020 con 0x7f69ec14e8d0 2024-04-25T12:24:21.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.331+0000 7f69e1ffb640 1 --2- 172.21.15.94:0/1770594783 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f69d00683b0 0x7f69d006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:21.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.331+0000 7f69e1ffb640 1 -- 172.21.15.94:0/1770594783 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f69e8121c50 con 0x7f69ec14e8d0 2024-04-25T12:24:21.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.331+0000 7f69f1326640 1 --2- 172.21.15.94:0/1770594783 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f69d00683b0 0x7f69d006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:21.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.331+0000 7f69f1326640 1 --2- 172.21.15.94:0/1770594783 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f69d00683b0 0x7f69d006a870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f69dc001ec0 tx=0x7f69dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:21.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.335+0000 7f69e1ffb640 1 -- 172.21.15.94:0/1770594783 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f69e8127020 con 0x7f69ec14e8d0 2024-04-25T12:24:21.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:21.527+0000 7f69f358a640 1 -- 172.21.15.94:0/1770594783 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f69ec15a280 con 0x7f69ec14e8d0 2024-04-25T12:24:22.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.179+0000 7f69e1ffb640 1 -- 172.21.15.94:0/1770594783 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v12) ==== 115+0+0 (secure 0 0 0) 0x7f69e8121030 con 0x7f69ec14e8d0 2024-04-25T12:24:22.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.179+0000 7f69f358a640 1 -- 172.21.15.94:0/1770594783 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f69d00683b0 msgr2=0x7f69d006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:22.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.179+0000 7f69f358a640 1 --2- 172.21.15.94:0/1770594783 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f69d00683b0 0x7f69d006a870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f69dc001ec0 tx=0x7f69dc009040 comp rx=0 tx=0).stop 2024-04-25T12:24:22.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.179+0000 7f69f358a640 1 -- 172.21.15.94:0/1770594783 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69ec14e8d0 msgr2=0x7f69ec1f0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:22.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.179+0000 7f69f358a640 1 --2- 172.21.15.94:0/1770594783 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69ec14e8d0 0x7f69ec1f0ce0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f69e80ae040 tx=0x7f69d8005840 comp rx=0 tx=0).stop 2024-04-25T12:24:22.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.183+0000 7f69f358a640 1 -- 172.21.15.94:0/1770594783 shutdown_connections 2024-04-25T12:24:22.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.183+0000 7f69f358a640 1 --2- 172.21.15.94:0/1770594783 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f69d00683b0 0x7f69d006a870 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.183+0000 7f69f358a640 1 --2- 172.21.15.94:0/1770594783 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69ec1f1220 0x7f69ec14b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.183+0000 7f69f358a640 1 --2- 172.21.15.94:0/1770594783 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69ec14e8d0 0x7f69ec1f0ce0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.183+0000 7f69f358a640 1 --2- 172.21.15.94:0/1770594783 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69d8004810 0x7f69ec150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.183+0000 7f69f358a640 1 -- 172.21.15.94:0/1770594783 >> 172.21.15.94:0/1770594783 conn(0x7f69ec06cc30 msgr2=0x7f69ec0cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:22.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.183+0000 7f69f358a640 1 -- 172.21.15.94:0/1770594783 shutdown_connections 2024-04-25T12:24:22.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.183+0000 7f69f358a640 1 -- 172.21.15.94:0/1770594783 wait complete. 2024-04-25T12:24:22.205 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T12:24:22.205 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:24:22.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.323+0000 7f1aa289d640 1 Processor -- start 2024-04-25T12:24:22.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.323+0000 7f1aa289d640 1 -- start start 2024-04-25T12:24:22.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.327+0000 7f1aa289d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1a9c14fbc0 0x7f1a9c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:22.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.327+0000 7f1aa289d640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a9c14ffa0 0x7f1a9c0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:22.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.327+0000 7f1aa289d640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a9c0c5d70 con 0x7f1a9c074100 2024-04-25T12:24:22.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.327+0000 7f1aa289d640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f1a9c0c6050 con 0x7f1a9c14fbc0 2024-04-25T12:24:22.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.327+0000 7f1aa289d640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f1a9c0c6330 con 0x7f1a9c14ffa0 2024-04-25T12:24:22.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.327+0000 7f1a9bfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1a9c14fbc0 0x7f1a9c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:22.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.327+0000 7f1a9bfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1a9c14fbc0 0x7f1a9c06f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51682/0 (socket says 172.21.15.94:51682) 2024-04-25T12:24:22.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.327+0000 7f1a9bfff640 1 -- 172.21.15.94:0/666294655 learned_addr learned my addr 172.21.15.94:0/666294655 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:22.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.327+0000 7f1a937fe640 1 --2- 172.21.15.94:0/666294655 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a9c14ffa0 0x7f1a9c0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:22.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.327+0000 7f1a9bfff640 1 -- 172.21.15.94:0/666294655 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a9c14ffa0 msgr2=0x7f1a9c0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:22.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.327+0000 7f1a9bfff640 1 --2- 172.21.15.94:0/666294655 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a9c14ffa0 0x7f1a9c0c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.327+0000 7f1a9bfff640 1 -- 172.21.15.94:0/666294655 >> v1:172.21.15.111:6789/0 conn(0x7f1a9c074100 legacy=0x7f1a9c0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:22.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.327+0000 7f1a9bfff640 1 -- 172.21.15.94:0/666294655 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a9c0c6610 con 0x7f1a9c14fbc0 2024-04-25T12:24:22.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.327+0000 7f1a9bfff640 1 --2- 172.21.15.94:0/666294655 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a9c14fbc0 0x7f1a9c06f700 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c009870 tx=0x7f1a8c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf9d182ac6c9cf2b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:22.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.327+0000 7f1a9b7fe640 1 -- 172.21.15.94:0/666294655 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c0aa660 con 0x7f1a9c14fbc0 2024-04-25T12:24:22.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.327+0000 7f1a9b7fe640 1 -- 172.21.15.94:0/666294655 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a8c0af070 con 0x7f1a9c14fbc0 2024-04-25T12:24:22.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.327+0000 7f1a9b7fe640 1 -- 172.21.15.94:0/666294655 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c0aaa20 con 0x7f1a9c14fbc0 2024-04-25T12:24:22.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1aa289d640 1 -- 172.21.15.94:0/666294655 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a9c14fbc0 msgr2=0x7f1a9c06f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:22.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1aa289d640 1 --2- 172.21.15.94:0/666294655 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a9c14fbc0 0x7f1a9c06f700 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c009870 tx=0x7f1a8c01c520 comp rx=0 tx=0).stop 2024-04-25T12:24:22.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1aa289d640 1 -- 172.21.15.94:0/666294655 shutdown_connections 2024-04-25T12:24:22.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1aa289d640 1 --2- 172.21.15.94:0/666294655 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a9c14ffa0 0x7f1a9c0c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1aa289d640 1 --2- 172.21.15.94:0/666294655 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a9c14fbc0 0x7f1a9c06f700 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1aa289d640 1 -- 172.21.15.94:0/666294655 >> 172.21.15.94:0/666294655 conn(0x7f1a9c06b9d0 msgr2=0x7f1a9c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:22.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1aa289d640 1 -- 172.21.15.94:0/666294655 shutdown_connections 2024-04-25T12:24:22.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1aa289d640 1 -- 172.21.15.94:0/666294655 wait complete. 2024-04-25T12:24:22.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1aa289d640 1 Processor -- start 2024-04-25T12:24:22.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1aa289d640 1 -- start start 2024-04-25T12:24:22.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1aa289d640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a9c074100 0x7f1a9c15c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:22.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1aa289d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a9c14fbc0 0x7f1a9c1ebf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:22.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1aa289d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1a9c14ffa0 0x7f1a9c0cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:22.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1aa289d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9c166420 con 0x7f1a9c14fbc0 2024-04-25T12:24:22.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1aa289d640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9c1662a0 con 0x7f1a9c14ffa0 2024-04-25T12:24:22.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1aa289d640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f1a9c1665a0 con 0x7f1a9c074100 2024-04-25T12:24:22.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1a937fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a9c14fbc0 0x7f1a9c1ebf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:22.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1a937fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a9c14fbc0 0x7f1a9c1ebf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51686/0 (socket says 172.21.15.94:51686) 2024-04-25T12:24:22.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1a937fe640 1 -- 172.21.15.94:0/3892845961 learned_addr learned my addr 172.21.15.94:0/3892845961 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:22.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1a9bfff640 1 --2- 172.21.15.94:0/3892845961 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a9c074100 0x7f1a9c15c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:22.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1a937fe640 1 -- 172.21.15.94:0/3892845961 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a9c074100 msgr2=0x7f1a9c15c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:22.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1aa0e3a640 1 --2- 172.21.15.94:0/3892845961 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1a9c14ffa0 0x7f1a9c0cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:22.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1a937fe640 1 --2- 172.21.15.94:0/3892845961 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a9c074100 0x7f1a9c15c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1a937fe640 1 -- 172.21.15.94:0/3892845961 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1a9c14ffa0 msgr2=0x7f1a9c0cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:22.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1a937fe640 1 --2- 172.21.15.94:0/3892845961 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1a9c14ffa0 0x7f1a9c0cb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1a937fe640 1 -- 172.21.15.94:0/3892845961 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a9c1eb4d0 con 0x7f1a9c14fbc0 2024-04-25T12:24:22.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1a937fe640 1 --2- 172.21.15.94:0/3892845961 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a9c14fbc0 0x7f1a9c1ebf70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400d620 tx=0x7f1a8400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:22.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1a997fa640 1 -- 172.21.15.94:0/3892845961 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8400b620 con 0x7f1a9c14fbc0 2024-04-25T12:24:22.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1a997fa640 1 -- 172.21.15.94:0/3892845961 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a84019070 con 0x7f1a9c14fbc0 2024-04-25T12:24:22.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1aa289d640 1 -- 172.21.15.94:0/3892845961 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a9c14e380 con 0x7f1a9c14fbc0 2024-04-25T12:24:22.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1a997fa640 1 -- 172.21.15.94:0/3892845961 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8400ba20 con 0x7f1a9c14fbc0 2024-04-25T12:24:22.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1aa289d640 1 -- 172.21.15.94:0/3892845961 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a9c06f740 con 0x7f1a9c14fbc0 2024-04-25T12:24:22.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.331+0000 7f1aa289d640 1 -- 172.21.15.94:0/3892845961 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a9c075df0 con 0x7f1a9c14fbc0 2024-04-25T12:24:22.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.335+0000 7f1a997fa640 1 -- 172.21.15.94:0/3892845961 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1a8400bbc0 con 0x7f1a9c14fbc0 2024-04-25T12:24:22.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.335+0000 7f1a997fa640 1 --2- 172.21.15.94:0/3892845961 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f1a7c068380 0x7f1a7c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:22.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.335+0000 7f1a997fa640 1 -- 172.21.15.94:0/3892845961 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f1a84087250 con 0x7f1a9c14fbc0 2024-04-25T12:24:22.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.335+0000 7f1a9bfff640 1 --2- 172.21.15.94:0/3892845961 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f1a7c068380 0x7f1a7c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:22.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.335+0000 7f1a9bfff640 1 --2- 172.21.15.94:0/3892845961 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f1a7c068380 0x7f1a7c06a840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c0ae000 tx=0x7f1a8c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:22.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.339+0000 7f1a997fa640 1 -- 172.21.15.94:0/3892845961 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1a84057420 con 0x7f1a9c14fbc0 2024-04-25T12:24:22.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.523+0000 7f1aa289d640 1 -- 172.21.15.94:0/3892845961 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a9c0c7df0 con 0x7f1a9c14fbc0 2024-04-25T12:24:22.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.523+0000 7f1a997fa640 1 -- 172.21.15.94:0/3892845961 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6854 (secure 0 0 0) 0x7f1a84056d20 con 0x7f1a9c14fbc0 2024-04-25T12:24:22.528 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:22.528 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6838/1468945344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6835","nonce":1468945344},{"type":"v1","addr":"172.21.15.94:6838","nonce":1468945344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4223,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6839/3773379365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":3773379365},{"type":"v1","addr":"172.21.15.94:6839","nonce":3773379365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6835/3463503555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3463503555},{"type":"v1","addr":"172.21.15.111:6835","nonce":3463503555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/1182495659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1182495659},{"type":"v1","addr":"172.21.15.94:6837","nonce":1182495659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T12:21:53.517464+0000","modified":"2024-04-25T12:24:21.530644+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1],"up":{"mds_0":4285,"mds_1":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":1,"incarnation":10,"state":"up:creating","state_seq":1,"addr":"172.21.15.111:6833/2332499082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":2332499082},{"type":"v1","addr":"172.21.15.111:6833","nonce":2332499082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.111:6837/3560813143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":3560813143},{"type":"v1","addr":"172.21.15.111:6837","nonce":3560813143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T12:24:22.528 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 12 2024-04-25T12:24:22.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.523+0000 7f1aa289d640 1 -- 172.21.15.94:0/3892845961 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f1a7c068380 msgr2=0x7f1a7c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:22.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.523+0000 7f1aa289d640 1 --2- 172.21.15.94:0/3892845961 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f1a7c068380 0x7f1a7c06a840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c0ae000 tx=0x7f1a8c008040 comp rx=0 tx=0).stop 2024-04-25T12:24:22.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.523+0000 7f1aa289d640 1 -- 172.21.15.94:0/3892845961 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a9c14fbc0 msgr2=0x7f1a9c1ebf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:22.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.523+0000 7f1aa289d640 1 --2- 172.21.15.94:0/3892845961 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a9c14fbc0 0x7f1a9c1ebf70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400d620 tx=0x7f1a8400dae0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.523+0000 7f1aa289d640 1 -- 172.21.15.94:0/3892845961 shutdown_connections 2024-04-25T12:24:22.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.523+0000 7f1aa289d640 1 --2- 172.21.15.94:0/3892845961 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f1a7c068380 0x7f1a7c06a840 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.523+0000 7f1aa289d640 1 --2- 172.21.15.94:0/3892845961 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1a9c14ffa0 0x7f1a9c0cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.523+0000 7f1aa289d640 1 --2- 172.21.15.94:0/3892845961 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a9c14fbc0 0x7f1a9c1ebf70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.523+0000 7f1aa289d640 1 --2- 172.21.15.94:0/3892845961 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a9c074100 0x7f1a9c15c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.523+0000 7f1aa289d640 1 -- 172.21.15.94:0/3892845961 >> 172.21.15.94:0/3892845961 conn(0x7f1a9c06b9d0 msgr2=0x7f1a9c14a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:22.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.523+0000 7f1aa289d640 1 -- 172.21.15.94:0/3892845961 shutdown_connections 2024-04-25T12:24:22.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.527+0000 7f1aa289d640 1 -- 172.21.15.94:0/3892845961 wait complete. 2024-04-25T12:24:22.545 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:24:22.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.643+0000 7fa48a2f9640 1 Processor -- start 2024-04-25T12:24:22.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.643+0000 7fa48a2f9640 1 -- start start 2024-04-25T12:24:22.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa48a2f9640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa48414fbc0 0x7fa48406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:22.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa48a2f9640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa48414ffa0 0x7fa4840c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:22.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa48a2f9640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4840c5d70 con 0x7fa484074100 2024-04-25T12:24:22.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa48a2f9640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fa4840c6050 con 0x7fa48414fbc0 2024-04-25T12:24:22.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa48a2f9640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa4840c6330 con 0x7fa48414ffa0 2024-04-25T12:24:22.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa488896640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fa484074100 0x7fa4840c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39212/0 (socket says 172.21.15.94:39212) 2024-04-25T12:24:22.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa488896640 1 -- 172.21.15.94:0/3585645196 learned_addr learned my addr 172.21.15.94:0/3585645196 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:22.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa4837fe640 1 --2- 172.21.15.94:0/3585645196 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa48414ffa0 0x7fa4840c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:22.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa483fff640 1 --2- 172.21.15.94:0/3585645196 >> v2:172.21.15.111:3300/0 conn(0x7fa48414fbc0 0x7fa48406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:22.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa482ffd640 1 -- 172.21.15.94:0/3585645196 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2316200362 0 0) 0x7fa4840c5d70 con 0x7fa484074100 2024-04-25T12:24:22.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa482ffd640 1 -- 172.21.15.94:0/3585645196 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa46c003530 con 0x7fa484074100 2024-04-25T12:24:22.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa482ffd640 1 -- 172.21.15.94:0/3585645196 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3091997553 0 0) 0x7fa46c003530 con 0x7fa484074100 2024-04-25T12:24:22.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa482ffd640 1 -- 172.21.15.94:0/3585645196 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa48414ffa0 msgr2=0x7fa4840c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:22.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa482ffd640 1 --2- 172.21.15.94:0/3585645196 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa48414ffa0 0x7fa4840c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa482ffd640 1 -- 172.21.15.94:0/3585645196 >> v2:172.21.15.111:3300/0 conn(0x7fa48414fbc0 msgr2=0x7fa48406f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:22.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa482ffd640 1 --2- 172.21.15.94:0/3585645196 >> v2:172.21.15.111:3300/0 conn(0x7fa48414fbc0 0x7fa48406f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa482ffd640 1 -- 172.21.15.94:0/3585645196 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4840c6610 con 0x7fa484074100 2024-04-25T12:24:22.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa482ffd640 1 -- 172.21.15.94:0/3585645196 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7fa47c001a00 con 0x7fa484074100 2024-04-25T12:24:22.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa482ffd640 1 -- 172.21.15.94:0/3585645196 >> v1:172.21.15.94:6789/0 conn(0x7fa484074100 legacy=0x7fa4840c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:22.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa482ffd640 1 --2- 172.21.15.94:0/3585645196 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa46c0039c0 0x7fa46c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:22.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa482ffd640 1 --2- 172.21.15.94:0/3585645196 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa46c004810 0x7fa46c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:22.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa482ffd640 1 --2- 172.21.15.94:0/3585645196 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa46c0051d0 0x7fa46c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:22.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa482ffd640 1 -- 172.21.15.94:0/3585645196 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa4840c6050 con 0x7fa46c0051d0 2024-04-25T12:24:22.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa482ffd640 1 -- 172.21.15.94:0/3585645196 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa4840c6330 con 0x7fa46c004810 2024-04-25T12:24:22.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa482ffd640 1 -- 172.21.15.94:0/3585645196 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa46c00c010 con 0x7fa46c0039c0 2024-04-25T12:24:22.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa483fff640 1 --2- 172.21.15.94:0/3585645196 >> v2:172.21.15.111:3300/0 conn(0x7fa48414fbc0 0x7fa48406f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:24:22.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa4837fe640 1 --2- 172.21.15.94:0/3585645196 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa48414ffa0 0x7fa4840c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:24:22.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa488896640 1 --2- 172.21.15.94:0/3585645196 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa46c0051d0 0x7fa46c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:22.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa488896640 1 -- 172.21.15.94:0/3585645196 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa46c0039c0 msgr2=0x7fa46c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:22.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa488896640 1 --2- 172.21.15.94:0/3585645196 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa46c0039c0 0x7fa46c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa488896640 1 -- 172.21.15.94:0/3585645196 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa46c004810 msgr2=0x7fa46c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:22.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa488896640 1 --2- 172.21.15.94:0/3585645196 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa46c004810 0x7fa46c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.647+0000 7fa488896640 1 -- 172.21.15.94:0/3585645196 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46c003530 con 0x7fa46c0051d0 2024-04-25T12:24:22.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa488896640 1 --2- 172.21.15.94:0/3585645196 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa46c0051d0 0x7fa46c00b9d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00a880 tx=0x7fa47c01d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98897dd17322fb11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:22.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa482ffd640 1 -- 172.21.15.94:0/3585645196 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47c00a4a0 con 0x7fa46c0051d0 2024-04-25T12:24:22.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa482ffd640 1 -- 172.21.15.94:0/3585645196 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa47c0ad650 con 0x7fa46c0051d0 2024-04-25T12:24:22.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa482ffd640 1 -- 172.21.15.94:0/3585645196 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47c0ada80 con 0x7fa46c0051d0 2024-04-25T12:24:22.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa48a2f9640 1 -- 172.21.15.94:0/3585645196 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa46c0051d0 msgr2=0x7fa46c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:22.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa48a2f9640 1 --2- 172.21.15.94:0/3585645196 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa46c0051d0 0x7fa46c00b9d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00a880 tx=0x7fa47c01d360 comp rx=0 tx=0).stop 2024-04-25T12:24:22.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa488896640 1 -- 172.21.15.94:0/3585645196 reap_dead start 2024-04-25T12:24:22.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa48a2f9640 1 -- 172.21.15.94:0/3585645196 shutdown_connections 2024-04-25T12:24:22.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa48a2f9640 1 -- 172.21.15.94:0/3585645196 >> 172.21.15.94:0/3585645196 conn(0x7fa48406b9d0 msgr2=0x7fa48406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:22.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa48a2f9640 1 -- 172.21.15.94:0/3585645196 shutdown_connections 2024-04-25T12:24:22.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa48a2f9640 1 -- 172.21.15.94:0/3585645196 wait complete. 2024-04-25T12:24:22.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa48a2f9640 1 Processor -- start 2024-04-25T12:24:22.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa48a2f9640 1 -- start start 2024-04-25T12:24:22.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa48a2f9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa46c0051d0 0x7fa4841f1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:22.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa48a2f9640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa484158c20 0x7fa484142600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:22.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa48a2f9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa484140bc0 0x7fa4841592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:22.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa48a2f9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa484068350 con 0x7fa484140bc0 2024-04-25T12:24:22.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa48a2f9640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa4840681d0 con 0x7fa46c0051d0 2024-04-25T12:24:22.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa48a2f9640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa4840c7960 con 0x7fa484158c20 2024-04-25T12:24:22.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa488896640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa484140bc0 0x7fa4841592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:22.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa488896640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa484140bc0 0x7fa4841592f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51712/0 (socket says 172.21.15.94:51712) 2024-04-25T12:24:22.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa488896640 1 -- 172.21.15.94:0/620611013 learned_addr learned my addr 172.21.15.94:0/620611013 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:22.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa483fff640 1 --2- 172.21.15.94:0/620611013 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa46c0051d0 0x7fa4841f1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:22.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa488896640 1 -- 172.21.15.94:0/620611013 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa484158c20 msgr2=0x7fa484142600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:22.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa488896640 1 --2- 172.21.15.94:0/620611013 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa484158c20 0x7fa484142600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa488896640 1 -- 172.21.15.94:0/620611013 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa46c0051d0 msgr2=0x7fa4841f1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:22.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa488896640 1 --2- 172.21.15.94:0/620611013 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa46c0051d0 0x7fa4841f1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa488896640 1 -- 172.21.15.94:0/620611013 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa484159830 con 0x7fa484140bc0 2024-04-25T12:24:22.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa488896640 1 --2- 172.21.15.94:0/620611013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa484140bc0 0x7fa4841592f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa47c01d190 tx=0x7fa46c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:22.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa480ff9640 1 -- 172.21.15.94:0/620611013 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47c0bc070 con 0x7fa484140bc0 2024-04-25T12:24:22.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa480ff9640 1 -- 172.21.15.94:0/620611013 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa47c0ad430 con 0x7fa484140bc0 2024-04-25T12:24:22.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa48a2f9640 1 -- 172.21.15.94:0/620611013 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4841f4c20 con 0x7fa484140bc0 2024-04-25T12:24:22.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa480ff9640 1 -- 172.21.15.94:0/620611013 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47c0019c0 con 0x7fa484140bc0 2024-04-25T12:24:22.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.651+0000 7fa48a2f9640 1 -- 172.21.15.94:0/620611013 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4841f0f60 con 0x7fa484140bc0 2024-04-25T12:24:22.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.655+0000 7fa48a2f9640 1 -- 172.21.15.94:0/620611013 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa484075df0 con 0x7fa484140bc0 2024-04-25T12:24:22.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.655+0000 7fa480ff9640 1 -- 172.21.15.94:0/620611013 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa47c0bf070 con 0x7fa484140bc0 2024-04-25T12:24:22.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.655+0000 7fa480ff9640 1 --2- 172.21.15.94:0/620611013 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa4700683b0 0x7fa47006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:22.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.655+0000 7fa480ff9640 1 -- 172.21.15.94:0/620611013 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fa47c120de0 con 0x7fa484140bc0 2024-04-25T12:24:22.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.655+0000 7fa483fff640 1 --2- 172.21.15.94:0/620611013 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa4700683b0 0x7fa47006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:22.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.655+0000 7fa483fff640 1 --2- 172.21.15.94:0/620611013 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa4700683b0 0x7fa47006a870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa47400d8d0 tx=0x7fa474008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:22.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.659+0000 7fa480ff9640 1 -- 172.21.15.94:0/620611013 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa47c017070 con 0x7fa484140bc0 2024-04-25T12:24:22.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.815+0000 7fa48a2f9640 1 -- 172.21.15.94:0/620611013 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa484072ff0 con 0x7fa484140bc0 2024-04-25T12:24:22.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.819+0000 7fa480ff9640 1 -- 172.21.15.94:0/620611013 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18873 (secure 0 0 0) 0x7fa47c0f0fb0 con 0x7fa484140bc0 2024-04-25T12:24:22.822 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:22.822 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"7059a9e2-aec4-4b84-b942-caf531e15da3","created":"2024-04-25T12:21:29.118508+0000","modified":"2024-04-25T12:22:34.871807+0000","last_up_change":"2024-04-25T12:21:40.912605+0000","last_in_change":"2024-04-25T12:21:31.372905+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:39.781011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:51.465886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:52.470540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:56.209936+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"640a65ef-0734-468a-a8f5-9ed70cf75c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6809","nonce":2553247564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6811","nonce":2553247564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6815","nonce":2553247564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6813","nonce":2553247564}]},"public_addr":"172.21.15.94:6809/2553247564","cluster_addr":"172.21.15.94:6811/2553247564","heartbeat_back_addr":"172.21.15.94:6815/2553247564","heartbeat_front_addr":"172.21.15.94:6813/2553247564","state":["exists","up"]},{"osd":1,"uuid":"d6e886e6-c8c1-4761-9a4c-abc6961c7c81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6818","nonce":2492806478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6822","nonce":2492806478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6830","nonce":2492806478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6826","nonce":2492806478}]},"public_addr":"172.21.15.94:6818/2492806478","cluster_addr":"172.21.15.94:6822/2492806478","heartbeat_back_addr":"172.21.15.94:6830/2492806478","heartbeat_front_addr":"172.21.15.94:6826/2492806478","state":["exists","up"]},{"osd":2,"uuid":"ba20f409-ed46-43b6-b16d-43dc4622c042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6801","nonce":1485061290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6803","nonce":1485061290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6807","nonce":1485061290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6805","nonce":1485061290}]},"public_addr":"172.21.15.94:6801/1485061290","cluster_addr":"172.21.15.94:6803/1485061290","heartbeat_back_addr":"172.21.15.94:6807/1485061290","heartbeat_front_addr":"172.21.15.94:6805/1485061290","state":["exists","up"]},{"osd":3,"uuid":"85816a2b-3a3f-4ec8-8373-8230d948396f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6819","nonce":1548488434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6823","nonce":1548488434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6829","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6831","nonce":1548488434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6827","nonce":1548488434}]},"public_addr":"172.21.15.94:6819/1548488434","cluster_addr":"172.21.15.94:6823/1548488434","heartbeat_back_addr":"172.21.15.94:6831/1548488434","heartbeat_front_addr":"172.21.15.94:6827/1548488434","state":["exists","up"]},{"osd":4,"uuid":"b4a953b7-01d6-4623-9324-63135fdaf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6811","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6814","nonce":4070977083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6817","nonce":4070977083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6823","nonce":4070977083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6819","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6821","nonce":4070977083}]},"public_addr":"172.21.15.111:6814/4070977083","cluster_addr":"172.21.15.111:6817/4070977083","heartbeat_back_addr":"172.21.15.111:6823/4070977083","heartbeat_front_addr":"172.21.15.111:6821/4070977083","state":["exists","up"]},{"osd":5,"uuid":"c0acc514-427d-41bf-a965-b8463cebf045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6803","nonce":1054925605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6809","nonce":1054925605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6820","nonce":1054925605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6815","nonce":1054925605}]},"public_addr":"172.21.15.111:6803/1054925605","cluster_addr":"172.21.15.111:6809/1054925605","heartbeat_back_addr":"172.21.15.111:6820/1054925605","heartbeat_front_addr":"172.21.15.111:6815/1054925605","state":["exists","up"]},{"osd":6,"uuid":"26ff742f-5a57-44a7-a095-f04d6e87f885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6825","nonce":3619235078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6827","nonce":3619235078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6831","nonce":3619235078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6829","nonce":3619235078}]},"public_addr":"172.21.15.111:6825/3619235078","cluster_addr":"172.21.15.111:6827/3619235078","heartbeat_back_addr":"172.21.15.111:6831/3619235078","heartbeat_front_addr":"172.21.15.111:6829/3619235078","state":["exists","up"]},{"osd":7,"uuid":"9c214cba-693a-4b25-aad7-05a5b0006e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6801","nonce":558758517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6805","nonce":558758517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6813","nonce":558758517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6807","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6808","nonce":558758517}]},"public_addr":"172.21.15.111:6801/558758517","cluster_addr":"172.21.15.111:6805/558758517","heartbeat_back_addr":"172.21.15.111:6813/558758517","heartbeat_front_addr":"172.21.15.111:6808/558758517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.664958+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.853375+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.654455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:37.033852+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.968691+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.856013+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.913496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.848565+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:24:22.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.819+0000 7fa48a2f9640 1 -- 172.21.15.94:0/620611013 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa4700683b0 msgr2=0x7fa47006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:22.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.819+0000 7fa48a2f9640 1 --2- 172.21.15.94:0/620611013 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa4700683b0 0x7fa47006a870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa47400d8d0 tx=0x7fa474008040 comp rx=0 tx=0).stop 2024-04-25T12:24:22.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.819+0000 7fa48a2f9640 1 -- 172.21.15.94:0/620611013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa484140bc0 msgr2=0x7fa4841592f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:22.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.819+0000 7fa48a2f9640 1 --2- 172.21.15.94:0/620611013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa484140bc0 0x7fa4841592f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa47c01d190 tx=0x7fa46c005840 comp rx=0 tx=0).stop 2024-04-25T12:24:22.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.819+0000 7fa48a2f9640 1 -- 172.21.15.94:0/620611013 shutdown_connections 2024-04-25T12:24:22.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.819+0000 7fa48a2f9640 1 --2- 172.21.15.94:0/620611013 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa4700683b0 0x7fa47006a870 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.819+0000 7fa48a2f9640 1 --2- 172.21.15.94:0/620611013 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa484158c20 0x7fa484142600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.819+0000 7fa48a2f9640 1 --2- 172.21.15.94:0/620611013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa484140bc0 0x7fa4841592f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.819+0000 7fa48a2f9640 1 --2- 172.21.15.94:0/620611013 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa46c0051d0 0x7fa4841f1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.819+0000 7fa48a2f9640 1 -- 172.21.15.94:0/620611013 >> 172.21.15.94:0/620611013 conn(0x7fa48406b9d0 msgr2=0x7fa48406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:22.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.819+0000 7fa48a2f9640 1 -- 172.21.15.94:0/620611013 shutdown_connections 2024-04-25T12:24:22.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.819+0000 7fa48a2f9640 1 -- 172.21.15.94:0/620611013 wait complete. 2024-04-25T12:24:22.840 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T12:24:22.840 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:24:22.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.943+0000 7fedf2307640 1 Processor -- start 2024-04-25T12:24:22.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.943+0000 7fedf2307640 1 -- start start 2024-04-25T12:24:22.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedf2307640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fedec074100 0x7fedec06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:22.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedf2307640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedec0c5d70 con 0x7fedec14ffa0 2024-04-25T12:24:22.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedf2307640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedec0c6050 con 0x7fedec14fbc0 2024-04-25T12:24:22.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedf2307640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fedec0c6330 con 0x7fedec074100 2024-04-25T12:24:22.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeb7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fedec14ffa0 0x7fedec0c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39228/0 (socket says 172.21.15.94:39228) 2024-04-25T12:24:22.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeb7fe640 1 -- 172.21.15.94:0/1058569162 learned_addr learned my addr 172.21.15.94:0/1058569162 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:22.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedf08a4640 1 --2- 172.21.15.94:0/1058569162 >> v2:172.21.15.111:3300/0 conn(0x7fedec074100 0x7fedec06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:22.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeaffd640 1 -- 172.21.15.94:0/1058569162 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4226594171 0 0) 0x7fedec0c5d70 con 0x7fedec14ffa0 2024-04-25T12:24:22.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeaffd640 1 -- 172.21.15.94:0/1058569162 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedd4003530 con 0x7fedec14ffa0 2024-04-25T12:24:22.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeaffd640 1 -- 172.21.15.94:0/1058569162 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3094316638 0 0) 0x7fedd4003530 con 0x7fedec14ffa0 2024-04-25T12:24:22.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeaffd640 1 -- 172.21.15.94:0/1058569162 >> v2:172.21.15.111:3300/0 conn(0x7fedec074100 msgr2=0x7fedec06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:22.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeaffd640 1 --2- 172.21.15.94:0/1058569162 >> v2:172.21.15.111:3300/0 conn(0x7fedec074100 0x7fedec06f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeaffd640 1 -- 172.21.15.94:0/1058569162 >> v1:172.21.15.111:6789/0 conn(0x7fedec14fbc0 legacy=0x7fedec0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:22.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeaffd640 1 -- 172.21.15.94:0/1058569162 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedec0c6610 con 0x7fedec14ffa0 2024-04-25T12:24:22.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeaffd640 1 -- 172.21.15.94:0/1058569162 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7fede0001680 con 0x7fedec14ffa0 2024-04-25T12:24:22.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeaffd640 1 -- 172.21.15.94:0/1058569162 >> v1:172.21.15.94:6789/0 conn(0x7fedec14ffa0 legacy=0x7fedec0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:22.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeaffd640 1 --2- 172.21.15.94:0/1058569162 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedd40039f0 0x7fedd4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:22.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeaffd640 1 --2- 172.21.15.94:0/1058569162 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fedd4004810 0x7fedd4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:22.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeaffd640 1 --2- 172.21.15.94:0/1058569162 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fedd40051d0 0x7fedd400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:22.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeaffd640 1 -- 172.21.15.94:0/1058569162 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fedec0c6330 con 0x7fedd4004810 2024-04-25T12:24:22.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeaffd640 1 -- 172.21.15.94:0/1058569162 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fedd400c0a0 con 0x7fedd40039f0 2024-04-25T12:24:22.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeaffd640 1 -- 172.21.15.94:0/1058569162 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fedd400c2a0 con 0x7fedd40051d0 2024-04-25T12:24:22.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeb7fe640 1 --2- 172.21.15.94:0/1058569162 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fedd4004810 0x7fedd4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:22.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeb7fe640 1 -- 172.21.15.94:0/1058569162 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fedd40051d0 msgr2=0x7fedd400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:22.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeb7fe640 1 --2- 172.21.15.94:0/1058569162 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fedd40051d0 0x7fedd400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeb7fe640 1 -- 172.21.15.94:0/1058569162 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedd40039f0 msgr2=0x7fedd4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:22.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeb7fe640 1 --2- 172.21.15.94:0/1058569162 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedd40039f0 0x7fedd4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeb7fe640 1 -- 172.21.15.94:0/1058569162 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd4003530 con 0x7fedd4004810 2024-04-25T12:24:22.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedf08a4640 1 -- 172.21.15.94:0/1058569162 reap_dead start 2024-04-25T12:24:22.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeb7fe640 1 --2- 172.21.15.94:0/1058569162 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fedd4004810 0x7fedd4004c90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fede000c1c0 tx=0x7fede001f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a190efa3de88e46 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:22.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeaffd640 1 -- 172.21.15.94:0/1058569162 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede0007d00 con 0x7fedd4004810 2024-04-25T12:24:22.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeaffd640 1 -- 172.21.15.94:0/1058569162 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede0005b00 con 0x7fedd4004810 2024-04-25T12:24:22.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.947+0000 7fedeaffd640 1 -- 172.21.15.94:0/1058569162 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede0007070 con 0x7fedd4004810 2024-04-25T12:24:22.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf2307640 1 -- 172.21.15.94:0/1058569162 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fedd4004810 msgr2=0x7fedd4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:22.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf2307640 1 --2- 172.21.15.94:0/1058569162 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fedd4004810 0x7fedd4004c90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fede000c1c0 tx=0x7fede001f390 comp rx=0 tx=0).stop 2024-04-25T12:24:22.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf2307640 1 -- 172.21.15.94:0/1058569162 shutdown_connections 2024-04-25T12:24:22.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf2307640 1 --2- 172.21.15.94:0/1058569162 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fedd4004810 0x7fedd4004c90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf2307640 1 -- 172.21.15.94:0/1058569162 >> 172.21.15.94:0/1058569162 conn(0x7fedec06b9d0 msgr2=0x7fedec06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:22.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf2307640 1 -- 172.21.15.94:0/1058569162 shutdown_connections 2024-04-25T12:24:22.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf2307640 1 -- 172.21.15.94:0/1058569162 wait complete. 2024-04-25T12:24:22.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf2307640 1 Processor -- start 2024-04-25T12:24:22.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf2307640 1 -- start start 2024-04-25T12:24:22.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf2307640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedd4004810 0x7fedec0c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:22.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf2307640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fedec0c3370 0x7fedec06e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:22.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf2307640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fedec15cd30 0x7fedec15bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:22.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf2307640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fedec068350 con 0x7fedec15cd30 2024-04-25T12:24:22.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf2307640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fedec0681d0 con 0x7fedd4004810 2024-04-25T12:24:22.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf2307640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fedec06f700 con 0x7fedec0c3370 2024-04-25T12:24:22.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf08a4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fedec15cd30 0x7fedec15bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:22.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf08a4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fedec15cd30 0x7fedec15bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51728/0 (socket says 172.21.15.94:51728) 2024-04-25T12:24:22.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf08a4640 1 -- 172.21.15.94:0/1266400527 learned_addr learned my addr 172.21.15.94:0/1266400527 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:22.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedebfff640 1 --2- 172.21.15.94:0/1266400527 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedd4004810 0x7fedec0c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:22.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedeb7fe640 1 --2- 172.21.15.94:0/1266400527 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fedec0c3370 0x7fedec06e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:22.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf08a4640 1 -- 172.21.15.94:0/1266400527 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fedec0c3370 msgr2=0x7fedec06e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:22.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf08a4640 1 --2- 172.21.15.94:0/1266400527 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fedec0c3370 0x7fedec06e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf08a4640 1 -- 172.21.15.94:0/1266400527 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedd4004810 msgr2=0x7fedec0c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:22.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf08a4640 1 --2- 172.21.15.94:0/1266400527 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedd4004810 0x7fedec0c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:22.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf08a4640 1 -- 172.21.15.94:0/1266400527 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedec15a1e0 con 0x7fedec15cd30 2024-04-25T12:24:22.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf08a4640 1 --2- 172.21.15.94:0/1266400527 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fedec15cd30 0x7fedec15bf60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fedec06dda0 tx=0x7fede400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:22.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fede8ff9640 1 -- 172.21.15.94:0/1266400527 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede400ba80 con 0x7fedec15cd30 2024-04-25T12:24:22.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fede8ff9640 1 -- 172.21.15.94:0/1266400527 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede401a070 con 0x7fedec15cd30 2024-04-25T12:24:22.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf2307640 1 -- 172.21.15.94:0/1266400527 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedec15a4c0 con 0x7fedec15cd30 2024-04-25T12:24:22.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fede8ff9640 1 -- 172.21.15.94:0/1266400527 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede4014400 con 0x7fedec15cd30 2024-04-25T12:24:22.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf2307640 1 -- 172.21.15.94:0/1266400527 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedec06ec80 con 0x7fedec15cd30 2024-04-25T12:24:22.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.951+0000 7fedf2307640 1 -- 172.21.15.94:0/1266400527 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedec075df0 con 0x7fedec15cd30 2024-04-25T12:24:22.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.955+0000 7fede8ff9640 1 -- 172.21.15.94:0/1266400527 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fede4013070 con 0x7fedec15cd30 2024-04-25T12:24:22.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.955+0000 7fede8ff9640 1 --2- 172.21.15.94:0/1266400527 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fedd80683b0 0x7fedd806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:22.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.955+0000 7fede8ff9640 1 -- 172.21.15.94:0/1266400527 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fede4086f70 con 0x7fedec15cd30 2024-04-25T12:24:22.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.955+0000 7fedebfff640 1 --2- 172.21.15.94:0/1266400527 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fedd80683b0 0x7fedd806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:22.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.955+0000 7fedebfff640 1 --2- 172.21.15.94:0/1266400527 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fedd80683b0 0x7fedd806a870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7feddc001660 tx=0x7feddc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:22.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:22.959+0000 7fede8ff9640 1 -- 172.21.15.94:0/1266400527 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fede40570a0 con 0x7fedec15cd30 2024-04-25T12:24:23.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.103+0000 7fedf2307640 1 -- 172.21.15.94:0/1266400527 --> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fedec0c4120 con 0x7fedd80683b0 2024-04-25T12:24:23.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.115+0000 7fede8ff9640 1 -- 172.21.15.94:0/1266400527 <== mgr.4101 v2:172.21.15.94:6832/549402167 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332539 (secure 0 0 0) 0x7fedec0c4120 con 0x7fedd80683b0 2024-04-25T12:24:23.123 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:23.125 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-04-25T12:24:23.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.119+0000 7fedf2307640 1 -- 172.21.15.94:0/1266400527 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fedd80683b0 msgr2=0x7fedd806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:23.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.119+0000 7fedf2307640 1 --2- 172.21.15.94:0/1266400527 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fedd80683b0 0x7fedd806a870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7feddc001660 tx=0x7feddc009040 comp rx=0 tx=0).stop 2024-04-25T12:24:23.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.119+0000 7fedf2307640 1 -- 172.21.15.94:0/1266400527 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fedec15cd30 msgr2=0x7fedec15bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:23.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.119+0000 7fedf2307640 1 --2- 172.21.15.94:0/1266400527 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fedec15cd30 0x7fedec15bf60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fedec06dda0 tx=0x7fede400b480 comp rx=0 tx=0).stop 2024-04-25T12:24:23.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.119+0000 7fedf2307640 1 -- 172.21.15.94:0/1266400527 shutdown_connections 2024-04-25T12:24:23.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.119+0000 7fedf2307640 1 --2- 172.21.15.94:0/1266400527 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fedd80683b0 0x7fedd806a870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.119+0000 7fedf2307640 1 --2- 172.21.15.94:0/1266400527 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fedec0c3370 0x7fedec06e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.119+0000 7fedf2307640 1 --2- 172.21.15.94:0/1266400527 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fedec15cd30 0x7fedec15bf60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.119+0000 7fedf2307640 1 --2- 172.21.15.94:0/1266400527 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedd4004810 0x7fedec0c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.119+0000 7fedf2307640 1 -- 172.21.15.94:0/1266400527 >> 172.21.15.94:0/1266400527 conn(0x7fedec06b9d0 msgr2=0x7fedec14ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:23.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.119+0000 7fedf2307640 1 -- 172.21.15.94:0/1266400527 shutdown_connections 2024-04-25T12:24:23.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.119+0000 7fedf2307640 1 -- 172.21.15.94:0/1266400527 wait complete. 2024-04-25T12:24:23.138 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-04-25T12:24:21.802749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236304,"kb_used_data":3496,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738416,"statfs":{"total":773094113280,"available":772852137984,"internally_reserved":0,"allocated":3579904,"data_stored":2148576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004223"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916423+0000","last_change":"2024-04-25T12:21:53.194776+0000","last_active":"2024-04-25T12:22:34.916423+0000","last_peered":"2024-04-25T12:22:34.916423+0000","last_clean":"2024-04-25T12:22:34.916423+0000","last_became_active":"2024-04-25T12:21:53.194480+0000","last_became_peered":"2024-04-25T12:21:53.194480+0000","last_unstale":"2024-04-25T12:22:34.916423+0000","last_undegraded":"2024-04-25T12:22:34.916423+0000","last_fullsized":"2024-04-25T12:22:34.916423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:52.906255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979743+0000","last_change":"2024-04-25T12:21:54.200481+0000","last_active":"2024-04-25T12:22:34.979743+0000","last_peered":"2024-04-25T12:22:34.979743+0000","last_clean":"2024-04-25T12:22:34.979743+0000","last_became_active":"2024-04-25T12:21:54.199679+0000","last_became_peered":"2024-04-25T12:21:54.199679+0000","last_unstale":"2024-04-25T12:22:34.979743+0000","last_undegraded":"2024-04-25T12:22:34.979743+0000","last_fullsized":"2024-04-25T12:22:34.979743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:59.395265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978194+0000","last_change":"2024-04-25T12:21:58.346732+0000","last_active":"2024-04-25T12:22:34.978194+0000","last_peered":"2024-04-25T12:22:34.978194+0000","last_clean":"2024-04-25T12:22:34.978194+0000","last_became_active":"2024-04-25T12:21:58.346337+0000","last_became_peered":"2024-04-25T12:21:58.346337+0000","last_unstale":"2024-04-25T12:22:34.978194+0000","last_undegraded":"2024-04-25T12:22:34.978194+0000","last_fullsized":"2024-04-25T12:22:34.978194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:20.028661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980382+0000","last_change":"2024-04-25T12:21:53.166281+0000","last_active":"2024-04-25T12:22:34.980382+0000","last_peered":"2024-04-25T12:22:34.980382+0000","last_clean":"2024-04-25T12:22:34.980382+0000","last_became_active":"2024-04-25T12:21:53.165990+0000","last_became_peered":"2024-04-25T12:21:53.165990+0000","last_unstale":"2024-04-25T12:22:34.980382+0000","last_undegraded":"2024-04-25T12:22:34.980382+0000","last_fullsized":"2024-04-25T12:22:34.980382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:07.228743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916094+0000","last_change":"2024-04-25T12:21:54.189754+0000","last_active":"2024-04-25T12:22:34.916094+0000","last_peered":"2024-04-25T12:22:34.916094+0000","last_clean":"2024-04-25T12:22:34.916094+0000","last_became_active":"2024-04-25T12:21:54.188987+0000","last_became_peered":"2024-04-25T12:21:54.188987+0000","last_unstale":"2024-04-25T12:22:34.916094+0000","last_undegraded":"2024-04-25T12:22:34.916094+0000","last_fullsized":"2024-04-25T12:22:34.916094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:29.603368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.892649+0000","last_change":"2024-04-25T12:21:58.251628+0000","last_active":"2024-04-25T12:22:34.892649+0000","last_peered":"2024-04-25T12:22:34.892649+0000","last_clean":"2024-04-25T12:22:34.892649+0000","last_became_active":"2024-04-25T12:21:58.250542+0000","last_became_peered":"2024-04-25T12:21:58.250542+0000","last_unstale":"2024-04-25T12:22:34.892649+0000","last_undegraded":"2024-04-25T12:22:34.892649+0000","last_fullsized":"2024-04-25T12:22:34.892649+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:33.434685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891183+0000","last_change":"2024-04-25T12:21:53.203427+0000","last_active":"2024-04-25T12:22:34.891183+0000","last_peered":"2024-04-25T12:22:34.891183+0000","last_clean":"2024-04-25T12:22:34.891183+0000","last_became_active":"2024-04-25T12:21:53.202760+0000","last_became_peered":"2024-04-25T12:21:53.202760+0000","last_unstale":"2024-04-25T12:22:34.891183+0000","last_undegraded":"2024-04-25T12:22:34.891183+0000","last_fullsized":"2024-04-25T12:22:34.891183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:44.397450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887586+0000","last_change":"2024-04-25T12:21:54.208420+0000","last_active":"2024-04-25T12:22:34.887586+0000","last_peered":"2024-04-25T12:22:34.887586+0000","last_clean":"2024-04-25T12:22:34.887586+0000","last_became_active":"2024-04-25T12:21:54.208093+0000","last_became_peered":"2024-04-25T12:21:54.208093+0000","last_unstale":"2024-04-25T12:22:34.887586+0000","last_undegraded":"2024-04-25T12:22:34.887586+0000","last_fullsized":"2024-04-25T12:22:34.887586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:08.762268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.892999+0000","last_change":"2024-04-25T12:21:58.255963+0000","last_active":"2024-04-25T12:22:34.892999+0000","last_peered":"2024-04-25T12:22:34.892999+0000","last_clean":"2024-04-25T12:22:34.892999+0000","last_became_active":"2024-04-25T12:21:58.254021+0000","last_became_peered":"2024-04-25T12:21:58.254021+0000","last_unstale":"2024-04-25T12:22:34.892999+0000","last_undegraded":"2024-04-25T12:22:34.892999+0000","last_fullsized":"2024-04-25T12:22:34.892999+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:20.528034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890657+0000","last_change":"2024-04-25T12:21:53.208470+0000","last_active":"2024-04-25T12:22:34.890657+0000","last_peered":"2024-04-25T12:22:34.890657+0000","last_clean":"2024-04-25T12:22:34.890657+0000","last_became_active":"2024-04-25T12:21:53.207929+0000","last_became_peered":"2024-04-25T12:21:53.207929+0000","last_unstale":"2024-04-25T12:22:34.890657+0000","last_undegraded":"2024-04-25T12:22:34.890657+0000","last_fullsized":"2024-04-25T12:22:34.890657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:14.904832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887497+0000","last_change":"2024-04-25T12:21:54.206567+0000","last_active":"2024-04-25T12:22:34.887497+0000","last_peered":"2024-04-25T12:22:34.887497+0000","last_clean":"2024-04-25T12:22:34.887497+0000","last_became_active":"2024-04-25T12:21:54.206138+0000","last_became_peered":"2024-04-25T12:21:54.206138+0000","last_unstale":"2024-04-25T12:22:34.887497+0000","last_undegraded":"2024-04-25T12:22:34.887497+0000","last_fullsized":"2024-04-25T12:22:34.887497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:31.698845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893253+0000","last_change":"2024-04-25T12:21:58.245331+0000","last_active":"2024-04-25T12:22:34.893253+0000","last_peered":"2024-04-25T12:22:34.893253+0000","last_clean":"2024-04-25T12:22:34.893253+0000","last_became_active":"2024-04-25T12:21:58.244313+0000","last_became_peered":"2024-04-25T12:21:58.244313+0000","last_unstale":"2024-04-25T12:22:34.893253+0000","last_undegraded":"2024-04-25T12:22:34.893253+0000","last_fullsized":"2024-04-25T12:22:34.893253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:21.595492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029274+0000","last_change":"2024-04-25T12:21:54.208935+0000","last_active":"2024-04-25T12:22:35.029274+0000","last_peered":"2024-04-25T12:22:35.029274+0000","last_clean":"2024-04-25T12:22:35.029274+0000","last_became_active":"2024-04-25T12:21:54.208338+0000","last_became_peered":"2024-04-25T12:21:54.208338+0000","last_unstale":"2024-04-25T12:22:35.029274+0000","last_undegraded":"2024-04-25T12:22:35.029274+0000","last_fullsized":"2024-04-25T12:22:35.029274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:08.485037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890828+0000","last_change":"2024-04-25T12:21:53.203519+0000","last_active":"2024-04-25T12:22:34.890828+0000","last_peered":"2024-04-25T12:22:34.890828+0000","last_clean":"2024-04-25T12:22:34.890828+0000","last_became_active":"2024-04-25T12:21:53.197141+0000","last_became_peered":"2024-04-25T12:21:53.197141+0000","last_unstale":"2024-04-25T12:22:34.890828+0000","last_undegraded":"2024-04-25T12:22:34.890828+0000","last_fullsized":"2024-04-25T12:22:34.890828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:03.010472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894179+0000","last_change":"2024-04-25T12:21:58.250871+0000","last_active":"2024-04-25T12:22:34.894179+0000","last_peered":"2024-04-25T12:22:34.894179+0000","last_clean":"2024-04-25T12:22:34.894179+0000","last_became_active":"2024-04-25T12:21:58.249079+0000","last_became_peered":"2024-04-25T12:21:58.249079+0000","last_unstale":"2024-04-25T12:22:34.894179+0000","last_undegraded":"2024-04-25T12:22:34.894179+0000","last_fullsized":"2024-04-25T12:22:34.894179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:54.201824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978908+0000","last_change":"2024-04-25T12:21:54.209195+0000","last_active":"2024-04-25T12:22:34.978908+0000","last_peered":"2024-04-25T12:22:34.978908+0000","last_clean":"2024-04-25T12:22:34.978908+0000","last_became_active":"2024-04-25T12:21:54.208802+0000","last_became_peered":"2024-04-25T12:21:54.208802+0000","last_unstale":"2024-04-25T12:22:34.978908+0000","last_undegraded":"2024-04-25T12:22:34.978908+0000","last_fullsized":"2024-04-25T12:22:34.978908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:10.846624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293651+0000","last_change":"2024-04-25T12:21:53.165498+0000","last_active":"2024-04-25T12:22:35.293651+0000","last_peered":"2024-04-25T12:22:35.293651+0000","last_clean":"2024-04-25T12:22:35.293651+0000","last_became_active":"2024-04-25T12:21:53.164867+0000","last_became_peered":"2024-04-25T12:21:53.164867+0000","last_unstale":"2024-04-25T12:22:35.293651+0000","last_undegraded":"2024-04-25T12:22:35.293651+0000","last_fullsized":"2024-04-25T12:22:35.293651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:07.312761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893517+0000","last_change":"2024-04-25T12:21:58.260620+0000","last_active":"2024-04-25T12:22:34.893517+0000","last_peered":"2024-04-25T12:22:34.893517+0000","last_clean":"2024-04-25T12:22:34.893517+0000","last_became_active":"2024-04-25T12:21:58.259595+0000","last_became_peered":"2024-04-25T12:21:58.259595+0000","last_unstale":"2024-04-25T12:22:34.893517+0000","last_undegraded":"2024-04-25T12:22:34.893517+0000","last_fullsized":"2024-04-25T12:22:34.893517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:43.230479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979100+0000","last_change":"2024-04-25T12:21:54.206960+0000","last_active":"2024-04-25T12:22:34.979100+0000","last_peered":"2024-04-25T12:22:34.979100+0000","last_clean":"2024-04-25T12:22:34.979100+0000","last_became_active":"2024-04-25T12:21:54.204650+0000","last_became_peered":"2024-04-25T12:21:54.204650+0000","last_unstale":"2024-04-25T12:22:34.979100+0000","last_undegraded":"2024-04-25T12:22:34.979100+0000","last_fullsized":"2024-04-25T12:22:34.979100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:15.888865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293382+0000","last_change":"2024-04-25T12:21:53.193797+0000","last_active":"2024-04-25T12:22:35.293382+0000","last_peered":"2024-04-25T12:22:35.293382+0000","last_clean":"2024-04-25T12:22:35.293382+0000","last_became_active":"2024-04-25T12:21:53.193466+0000","last_became_peered":"2024-04-25T12:21:53.193466+0000","last_unstale":"2024-04-25T12:22:35.293382+0000","last_undegraded":"2024-04-25T12:22:35.293382+0000","last_fullsized":"2024-04-25T12:22:35.293382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:23.341451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292912+0000","last_change":"2024-04-25T12:21:58.348047+0000","last_active":"2024-04-25T12:22:35.292912+0000","last_peered":"2024-04-25T12:22:35.292912+0000","last_clean":"2024-04-25T12:22:35.292912+0000","last_became_active":"2024-04-25T12:21:58.347583+0000","last_became_peered":"2024-04-25T12:21:58.347583+0000","last_unstale":"2024-04-25T12:22:35.292912+0000","last_undegraded":"2024-04-25T12:22:35.292912+0000","last_fullsized":"2024-04-25T12:22:35.292912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:21:48.878907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894218+0000","last_change":"2024-04-25T12:21:54.196479+0000","last_active":"2024-04-25T12:22:34.894218+0000","last_peered":"2024-04-25T12:22:34.894218+0000","last_clean":"2024-04-25T12:22:34.894218+0000","last_became_active":"2024-04-25T12:21:54.195939+0000","last_became_peered":"2024-04-25T12:21:54.195939+0000","last_unstale":"2024-04-25T12:22:34.894218+0000","last_undegraded":"2024-04-25T12:22:34.894218+0000","last_fullsized":"2024-04-25T12:22:34.894218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:17.787145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.886118+0000","last_change":"2024-04-25T12:21:53.198034+0000","last_active":"2024-04-25T12:22:34.886118+0000","last_peered":"2024-04-25T12:22:34.886118+0000","last_clean":"2024-04-25T12:22:34.886118+0000","last_became_active":"2024-04-25T12:21:53.196252+0000","last_became_peered":"2024-04-25T12:21:53.196252+0000","last_unstale":"2024-04-25T12:22:34.886118+0000","last_undegraded":"2024-04-25T12:22:34.886118+0000","last_fullsized":"2024-04-25T12:22:34.886118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:08.329111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.033926+0000","last_change":"2024-04-25T12:22:35.032802+0000","last_active":"2024-04-25T12:22:35.033926+0000","last_peered":"2024-04-25T12:22:35.033926+0000","last_clean":"2024-04-25T12:22:35.033926+0000","last_became_active":"2024-04-25T12:22:35.031906+0000","last_became_peered":"2024-04-25T12:22:35.031906+0000","last_unstale":"2024-04-25T12:22:35.033926+0000","last_undegraded":"2024-04-25T12:22:35.033926+0000","last_fullsized":"2024-04-25T12:22:35.033926+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:40.346041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916736+0000","last_change":"2024-04-25T12:21:54.192601+0000","last_active":"2024-04-25T12:22:34.916736+0000","last_peered":"2024-04-25T12:22:34.916736+0000","last_clean":"2024-04-25T12:22:34.916736+0000","last_became_active":"2024-04-25T12:21:54.191864+0000","last_became_peered":"2024-04-25T12:21:54.191864+0000","last_unstale":"2024-04-25T12:22:34.916736+0000","last_undegraded":"2024-04-25T12:22:34.916736+0000","last_fullsized":"2024-04-25T12:22:34.916736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:50.392769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030915+0000","last_change":"2024-04-25T12:21:53.197793+0000","last_active":"2024-04-25T12:22:35.030915+0000","last_peered":"2024-04-25T12:22:35.030915+0000","last_clean":"2024-04-25T12:22:35.030915+0000","last_became_active":"2024-04-25T12:21:53.197059+0000","last_became_peered":"2024-04-25T12:21:53.197059+0000","last_unstale":"2024-04-25T12:22:35.030915+0000","last_undegraded":"2024-04-25T12:22:35.030915+0000","last_fullsized":"2024-04-25T12:22:35.030915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:58.471408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893581+0000","last_change":"2024-04-25T12:21:58.355166+0000","last_active":"2024-04-25T12:22:34.893581+0000","last_peered":"2024-04-25T12:22:34.893581+0000","last_clean":"2024-04-25T12:22:34.893581+0000","last_became_active":"2024-04-25T12:21:58.353996+0000","last_became_peered":"2024-04-25T12:21:58.353996+0000","last_unstale":"2024-04-25T12:22:34.893581+0000","last_undegraded":"2024-04-25T12:22:34.893581+0000","last_fullsized":"2024-04-25T12:22:34.893581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:22.681720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980643+0000","last_change":"2024-04-25T12:21:54.219182+0000","last_active":"2024-04-25T12:22:34.980643+0000","last_peered":"2024-04-25T12:22:34.980643+0000","last_clean":"2024-04-25T12:22:34.980643+0000","last_became_active":"2024-04-25T12:21:54.218854+0000","last_became_peered":"2024-04-25T12:21:54.218854+0000","last_unstale":"2024-04-25T12:22:34.980643+0000","last_undegraded":"2024-04-25T12:22:34.980643+0000","last_fullsized":"2024-04-25T12:22:34.980643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:08.985962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292883+0000","last_change":"2024-04-25T12:21:53.190102+0000","last_active":"2024-04-25T12:22:35.292883+0000","last_peered":"2024-04-25T12:22:35.292883+0000","last_clean":"2024-04-25T12:22:35.292883+0000","last_became_active":"2024-04-25T12:21:53.189781+0000","last_became_peered":"2024-04-25T12:21:53.189781+0000","last_unstale":"2024-04-25T12:22:35.292883+0000","last_undegraded":"2024-04-25T12:22:35.292883+0000","last_fullsized":"2024-04-25T12:22:35.292883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:52.533217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978106+0000","last_change":"2024-04-25T12:21:58.341932+0000","last_active":"2024-04-25T12:22:34.978106+0000","last_peered":"2024-04-25T12:22:34.978106+0000","last_clean":"2024-04-25T12:22:34.978106+0000","last_became_active":"2024-04-25T12:21:58.341492+0000","last_became_peered":"2024-04-25T12:21:58.341492+0000","last_unstale":"2024-04-25T12:22:34.978106+0000","last_undegraded":"2024-04-25T12:22:34.978106+0000","last_fullsized":"2024-04-25T12:22:34.978106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:51.576036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293382+0000","last_change":"2024-04-25T12:21:54.182541+0000","last_active":"2024-04-25T12:22:35.293382+0000","last_peered":"2024-04-25T12:22:35.293382+0000","last_clean":"2024-04-25T12:22:35.293382+0000","last_became_active":"2024-04-25T12:21:54.181720+0000","last_became_peered":"2024-04-25T12:21:54.181720+0000","last_unstale":"2024-04-25T12:22:35.293382+0000","last_undegraded":"2024-04-25T12:22:35.293382+0000","last_fullsized":"2024-04-25T12:22:35.293382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:00.544076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891591+0000","last_change":"2024-04-25T12:21:53.200521+0000","last_active":"2024-04-25T12:22:34.891591+0000","last_peered":"2024-04-25T12:22:34.891591+0000","last_clean":"2024-04-25T12:22:34.891591+0000","last_became_active":"2024-04-25T12:21:53.196102+0000","last_became_peered":"2024-04-25T12:21:53.196102+0000","last_unstale":"2024-04-25T12:22:34.891591+0000","last_undegraded":"2024-04-25T12:22:34.891591+0000","last_fullsized":"2024-04-25T12:22:34.891591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:54.350452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916195+0000","last_change":"2024-04-25T12:21:58.342064+0000","last_active":"2024-04-25T12:22:34.916195+0000","last_peered":"2024-04-25T12:22:34.916195+0000","last_clean":"2024-04-25T12:22:34.916195+0000","last_became_active":"2024-04-25T12:21:58.341558+0000","last_became_peered":"2024-04-25T12:21:58.341558+0000","last_unstale":"2024-04-25T12:22:34.916195+0000","last_undegraded":"2024-04-25T12:22:34.916195+0000","last_fullsized":"2024-04-25T12:22:34.916195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:11.378767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887849+0000","last_change":"2024-04-25T12:21:54.206427+0000","last_active":"2024-04-25T12:22:34.887849+0000","last_peered":"2024-04-25T12:22:34.887849+0000","last_clean":"2024-04-25T12:22:34.887849+0000","last_became_active":"2024-04-25T12:21:54.205519+0000","last_became_peered":"2024-04-25T12:21:54.205519+0000","last_unstale":"2024-04-25T12:22:34.887849+0000","last_undegraded":"2024-04-25T12:22:34.887849+0000","last_fullsized":"2024-04-25T12:22:34.887849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:59.659460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293573+0000","last_change":"2024-04-25T12:21:53.162914+0000","last_active":"2024-04-25T12:22:35.293573+0000","last_peered":"2024-04-25T12:22:35.293573+0000","last_clean":"2024-04-25T12:22:35.293573+0000","last_became_active":"2024-04-25T12:21:53.162599+0000","last_became_peered":"2024-04-25T12:21:53.162599+0000","last_unstale":"2024-04-25T12:22:35.293573+0000","last_undegraded":"2024-04-25T12:22:35.293573+0000","last_fullsized":"2024-04-25T12:22:35.293573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:23.448280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.919463+0000","last_change":"2024-04-25T12:22:34.919463+0000","last_active":"2024-04-25T12:22:34.919463+0000","last_peered":"2024-04-25T12:22:34.919463+0000","last_clean":"2024-04-25T12:22:34.919463+0000","last_became_active":"2024-04-25T12:22:34.917798+0000","last_became_peered":"2024-04-25T12:22:34.917798+0000","last_unstale":"2024-04-25T12:22:34.919463+0000","last_undegraded":"2024-04-25T12:22:34.919463+0000","last_fullsized":"2024-04-25T12:22:34.919463+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:35.620229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894822+0000","last_change":"2024-04-25T12:21:54.202462+0000","last_active":"2024-04-25T12:22:34.894822+0000","last_peered":"2024-04-25T12:22:34.894822+0000","last_clean":"2024-04-25T12:22:34.894822+0000","last_became_active":"2024-04-25T12:21:54.202112+0000","last_became_peered":"2024-04-25T12:21:54.202112+0000","last_unstale":"2024-04-25T12:22:34.894822+0000","last_undegraded":"2024-04-25T12:22:34.894822+0000","last_fullsized":"2024-04-25T12:22:34.894822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:20.813264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887672+0000","last_change":"2024-04-25T12:21:53.188606+0000","last_active":"2024-04-25T12:22:34.887672+0000","last_peered":"2024-04-25T12:22:34.887672+0000","last_clean":"2024-04-25T12:22:34.887672+0000","last_became_active":"2024-04-25T12:21:53.187855+0000","last_became_peered":"2024-04-25T12:21:53.187855+0000","last_unstale":"2024-04-25T12:22:34.887672+0000","last_undegraded":"2024-04-25T12:22:34.887672+0000","last_fullsized":"2024-04-25T12:22:34.887672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:52.874270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293184+0000","last_change":"2024-04-25T12:21:58.264074+0000","last_active":"2024-04-25T12:22:35.293184+0000","last_peered":"2024-04-25T12:22:35.293184+0000","last_clean":"2024-04-25T12:22:35.293184+0000","last_became_active":"2024-04-25T12:21:58.263425+0000","last_became_peered":"2024-04-25T12:21:58.263425+0000","last_unstale":"2024-04-25T12:22:35.293184+0000","last_undegraded":"2024-04-25T12:22:35.293184+0000","last_fullsized":"2024-04-25T12:22:35.293184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:02.083494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292583+0000","last_change":"2024-04-25T12:21:54.189512+0000","last_active":"2024-04-25T12:22:35.292583+0000","last_peered":"2024-04-25T12:22:35.292583+0000","last_clean":"2024-04-25T12:22:35.292583+0000","last_became_active":"2024-04-25T12:21:54.188587+0000","last_became_peered":"2024-04-25T12:21:54.188587+0000","last_unstale":"2024-04-25T12:22:35.292583+0000","last_undegraded":"2024-04-25T12:22:35.292583+0000","last_fullsized":"2024-04-25T12:22:35.292583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:00.810648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884624+0000","last_change":"2024-04-25T12:21:53.159998+0000","last_active":"2024-04-25T12:22:34.884624+0000","last_peered":"2024-04-25T12:22:34.884624+0000","last_clean":"2024-04-25T12:22:34.884624+0000","last_became_active":"2024-04-25T12:21:53.159714+0000","last_became_peered":"2024-04-25T12:21:53.159714+0000","last_unstale":"2024-04-25T12:22:34.884624+0000","last_undegraded":"2024-04-25T12:22:34.884624+0000","last_fullsized":"2024-04-25T12:22:34.884624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:38.665874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.982542+0000","last_change":"2024-04-25T12:22:34.982542+0000","last_active":"2024-04-25T12:22:34.982542+0000","last_peered":"2024-04-25T12:22:34.982542+0000","last_clean":"2024-04-25T12:22:34.982542+0000","last_became_active":"2024-04-25T12:22:34.981347+0000","last_became_peered":"2024-04-25T12:22:34.981347+0000","last_unstale":"2024-04-25T12:22:34.982542+0000","last_undegraded":"2024-04-25T12:22:34.982542+0000","last_fullsized":"2024-04-25T12:22:34.982542+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:55.180698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915214+0000","last_change":"2024-04-25T12:21:54.205348+0000","last_active":"2024-04-25T12:22:34.915214+0000","last_peered":"2024-04-25T12:22:34.915214+0000","last_clean":"2024-04-25T12:22:34.915214+0000","last_became_active":"2024-04-25T12:21:54.205023+0000","last_became_peered":"2024-04-25T12:21:54.205023+0000","last_unstale":"2024-04-25T12:22:34.915214+0000","last_undegraded":"2024-04-25T12:22:34.915214+0000","last_fullsized":"2024-04-25T12:22:34.915214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:46.381368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.888119+0000","last_change":"2024-04-25T12:21:53.201066+0000","last_active":"2024-04-25T12:22:34.888119+0000","last_peered":"2024-04-25T12:22:34.888119+0000","last_clean":"2024-04-25T12:22:34.888119+0000","last_became_active":"2024-04-25T12:21:53.197081+0000","last_became_peered":"2024-04-25T12:21:53.197081+0000","last_unstale":"2024-04-25T12:22:34.888119+0000","last_undegraded":"2024-04-25T12:22:34.888119+0000","last_fullsized":"2024-04-25T12:22:34.888119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:19.865455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916511+0000","last_change":"2024-04-25T12:21:58.343823+0000","last_active":"2024-04-25T12:22:34.916511+0000","last_peered":"2024-04-25T12:22:34.916511+0000","last_clean":"2024-04-25T12:22:34.916511+0000","last_became_active":"2024-04-25T12:21:58.342796+0000","last_became_peered":"2024-04-25T12:21:58.342796+0000","last_unstale":"2024-04-25T12:22:34.916511+0000","last_undegraded":"2024-04-25T12:22:34.916511+0000","last_fullsized":"2024-04-25T12:22:34.916511+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:14.849636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979107+0000","last_change":"2024-04-25T12:21:54.204569+0000","last_active":"2024-04-25T12:22:34.979107+0000","last_peered":"2024-04-25T12:22:34.979107+0000","last_clean":"2024-04-25T12:22:34.979107+0000","last_became_active":"2024-04-25T12:21:54.204212+0000","last_became_peered":"2024-04-25T12:21:54.204212+0000","last_unstale":"2024-04-25T12:22:34.979107+0000","last_undegraded":"2024-04-25T12:22:34.979107+0000","last_fullsized":"2024-04-25T12:22:34.979107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:44.245327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887147+0000","last_change":"2024-04-25T12:21:53.169844+0000","last_active":"2024-04-25T12:22:34.887147+0000","last_peered":"2024-04-25T12:22:34.887147+0000","last_clean":"2024-04-25T12:22:34.887147+0000","last_became_active":"2024-04-25T12:21:53.168939+0000","last_became_peered":"2024-04-25T12:21:53.168939+0000","last_unstale":"2024-04-25T12:22:34.887147+0000","last_undegraded":"2024-04-25T12:22:34.887147+0000","last_fullsized":"2024-04-25T12:22:34.887147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:57.836476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.888439+0000","last_change":"2024-04-25T12:21:42.610528+0000","last_active":"2024-04-25T12:22:34.888439+0000","last_peered":"2024-04-25T12:22:34.888439+0000","last_clean":"2024-04-25T12:22:34.888439+0000","last_became_active":"2024-04-25T12:21:42.608579+0000","last_became_peered":"2024-04-25T12:21:42.608579+0000","last_unstale":"2024-04-25T12:22:34.888439+0000","last_undegraded":"2024-04-25T12:22:34.888439+0000","last_fullsized":"2024-04-25T12:22:34.888439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:39.904333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:39.904333+0000","last_clean_scrub_stamp":"2024-04-25T12:21:39.904333+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:16.122851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029891+0000","last_change":"2024-04-25T12:21:58.351105+0000","last_active":"2024-04-25T12:22:35.029891+0000","last_peered":"2024-04-25T12:22:35.029891+0000","last_clean":"2024-04-25T12:22:35.029891+0000","last_became_active":"2024-04-25T12:21:58.350087+0000","last_became_peered":"2024-04-25T12:21:58.350087+0000","last_unstale":"2024-04-25T12:22:35.029891+0000","last_undegraded":"2024-04-25T12:22:35.029891+0000","last_fullsized":"2024-04-25T12:22:35.029891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:22.686410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891042+0000","last_change":"2024-04-25T12:21:54.215530+0000","last_active":"2024-04-25T12:22:34.891042+0000","last_peered":"2024-04-25T12:22:34.891042+0000","last_clean":"2024-04-25T12:22:34.891042+0000","last_became_active":"2024-04-25T12:21:54.211077+0000","last_became_peered":"2024-04-25T12:21:54.211077+0000","last_unstale":"2024-04-25T12:22:34.891042+0000","last_undegraded":"2024-04-25T12:22:34.891042+0000","last_fullsized":"2024-04-25T12:22:34.891042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:03.079964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884857+0000","last_change":"2024-04-25T12:21:53.175259+0000","last_active":"2024-04-25T12:22:34.884857+0000","last_peered":"2024-04-25T12:22:34.884857+0000","last_clean":"2024-04-25T12:22:34.884857+0000","last_became_active":"2024-04-25T12:21:53.174980+0000","last_became_peered":"2024-04-25T12:21:53.174980+0000","last_unstale":"2024-04-25T12:22:34.884857+0000","last_undegraded":"2024-04-25T12:22:34.884857+0000","last_fullsized":"2024-04-25T12:22:34.884857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:51.852590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029315+0000","last_change":"2024-04-25T12:21:58.344660+0000","last_active":"2024-04-25T12:22:35.029315+0000","last_peered":"2024-04-25T12:22:35.029315+0000","last_clean":"2024-04-25T12:22:35.029315+0000","last_became_active":"2024-04-25T12:21:58.343502+0000","last_became_peered":"2024-04-25T12:21:58.343502+0000","last_unstale":"2024-04-25T12:22:35.029315+0000","last_undegraded":"2024-04-25T12:22:35.029315+0000","last_fullsized":"2024-04-25T12:22:35.029315+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:46.127740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887959+0000","last_change":"2024-04-25T12:21:54.207666+0000","last_active":"2024-04-25T12:22:34.887959+0000","last_peered":"2024-04-25T12:22:34.887959+0000","last_clean":"2024-04-25T12:22:34.887959+0000","last_became_active":"2024-04-25T12:21:54.206749+0000","last_became_peered":"2024-04-25T12:21:54.206749+0000","last_unstale":"2024-04-25T12:22:34.887959+0000","last_undegraded":"2024-04-25T12:22:34.887959+0000","last_fullsized":"2024-04-25T12:22:34.887959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:36.113364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293367+0000","last_change":"2024-04-25T12:21:53.179412+0000","last_active":"2024-04-25T12:22:35.293367+0000","last_peered":"2024-04-25T12:22:35.293367+0000","last_clean":"2024-04-25T12:22:35.293367+0000","last_became_active":"2024-04-25T12:21:53.179142+0000","last_became_peered":"2024-04-25T12:21:53.179142+0000","last_unstale":"2024-04-25T12:22:35.293367+0000","last_undegraded":"2024-04-25T12:22:35.293367+0000","last_fullsized":"2024-04-25T12:22:35.293367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:08.771439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915942+0000","last_change":"2024-04-25T12:21:58.254119+0000","last_active":"2024-04-25T12:22:34.915942+0000","last_peered":"2024-04-25T12:22:34.915942+0000","last_clean":"2024-04-25T12:22:34.915942+0000","last_became_active":"2024-04-25T12:21:58.253624+0000","last_became_peered":"2024-04-25T12:21:58.253624+0000","last_unstale":"2024-04-25T12:22:34.915942+0000","last_undegraded":"2024-04-25T12:22:34.915942+0000","last_fullsized":"2024-04-25T12:22:34.915942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:54.719908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891979+0000","last_change":"2024-04-25T12:21:54.219803+0000","last_active":"2024-04-25T12:22:34.891979+0000","last_peered":"2024-04-25T12:22:34.891979+0000","last_clean":"2024-04-25T12:22:34.891979+0000","last_became_active":"2024-04-25T12:21:54.219513+0000","last_became_peered":"2024-04-25T12:21:54.219513+0000","last_unstale":"2024-04-25T12:22:34.891979+0000","last_undegraded":"2024-04-25T12:22:34.891979+0000","last_fullsized":"2024-04-25T12:22:34.891979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:03.617773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.886845+0000","last_change":"2024-04-25T12:21:53.159382+0000","last_active":"2024-04-25T12:22:34.886845+0000","last_peered":"2024-04-25T12:22:34.886845+0000","last_clean":"2024-04-25T12:22:34.886845+0000","last_became_active":"2024-04-25T12:21:53.159018+0000","last_became_peered":"2024-04-25T12:21:53.159018+0000","last_unstale":"2024-04-25T12:22:34.886845+0000","last_undegraded":"2024-04-25T12:22:34.886845+0000","last_fullsized":"2024-04-25T12:22:34.886845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:39.868721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.885990+0000","last_change":"2024-04-25T12:21:58.344915+0000","last_active":"2024-04-25T12:22:34.885990+0000","last_peered":"2024-04-25T12:22:34.885990+0000","last_clean":"2024-04-25T12:22:34.885990+0000","last_became_active":"2024-04-25T12:21:58.343839+0000","last_became_peered":"2024-04-25T12:21:58.343839+0000","last_unstale":"2024-04-25T12:22:34.885990+0000","last_undegraded":"2024-04-25T12:22:34.885990+0000","last_fullsized":"2024-04-25T12:22:34.885990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:20.784047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891353+0000","last_change":"2024-04-25T12:21:54.215509+0000","last_active":"2024-04-25T12:22:34.891353+0000","last_peered":"2024-04-25T12:22:34.891353+0000","last_clean":"2024-04-25T12:22:34.891353+0000","last_became_active":"2024-04-25T12:21:54.211719+0000","last_became_peered":"2024-04-25T12:21:54.211719+0000","last_unstale":"2024-04-25T12:22:34.891353+0000","last_undegraded":"2024-04-25T12:22:34.891353+0000","last_fullsized":"2024-04-25T12:22:34.891353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:21.047044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.895010+0000","last_change":"2024-04-25T12:21:53.170513+0000","last_active":"2024-04-25T12:22:34.895010+0000","last_peered":"2024-04-25T12:22:34.895010+0000","last_clean":"2024-04-25T12:22:34.895010+0000","last_became_active":"2024-04-25T12:21:53.169743+0000","last_became_peered":"2024-04-25T12:21:53.169743+0000","last_unstale":"2024-04-25T12:22:34.895010+0000","last_undegraded":"2024-04-25T12:22:34.895010+0000","last_fullsized":"2024-04-25T12:22:34.895010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:03.566639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893058+0000","last_change":"2024-04-25T12:21:58.254432+0000","last_active":"2024-04-25T12:22:34.893058+0000","last_peered":"2024-04-25T12:22:34.893058+0000","last_clean":"2024-04-25T12:22:34.893058+0000","last_became_active":"2024-04-25T12:21:58.253256+0000","last_became_peered":"2024-04-25T12:21:58.253256+0000","last_unstale":"2024-04-25T12:22:34.893058+0000","last_undegraded":"2024-04-25T12:22:34.893058+0000","last_fullsized":"2024-04-25T12:22:34.893058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:13.469118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.896289+0000","last_change":"2024-04-25T12:22:34.896289+0000","last_active":"2024-04-25T12:22:34.896289+0000","last_peered":"2024-04-25T12:22:34.896289+0000","last_clean":"2024-04-25T12:22:34.896289+0000","last_became_active":"2024-04-25T12:22:34.895584+0000","last_became_peered":"2024-04-25T12:22:34.895584+0000","last_unstale":"2024-04-25T12:22:34.896289+0000","last_undegraded":"2024-04-25T12:22:34.896289+0000","last_fullsized":"2024-04-25T12:22:34.896289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:54.648002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884039+0000","last_change":"2024-04-25T12:21:53.163846+0000","last_active":"2024-04-25T12:22:34.884039+0000","last_peered":"2024-04-25T12:22:34.884039+0000","last_clean":"2024-04-25T12:22:34.884039+0000","last_became_active":"2024-04-25T12:21:53.163565+0000","last_became_peered":"2024-04-25T12:21:53.163565+0000","last_unstale":"2024-04-25T12:22:34.884039+0000","last_undegraded":"2024-04-25T12:22:34.884039+0000","last_fullsized":"2024-04-25T12:22:34.884039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:22.297830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916129+0000","last_change":"2024-04-25T12:21:58.250582+0000","last_active":"2024-04-25T12:22:34.916129+0000","last_peered":"2024-04-25T12:22:34.916129+0000","last_clean":"2024-04-25T12:22:34.916129+0000","last_became_active":"2024-04-25T12:21:58.250136+0000","last_became_peered":"2024-04-25T12:21:58.250136+0000","last_unstale":"2024-04-25T12:22:34.916129+0000","last_undegraded":"2024-04-25T12:22:34.916129+0000","last_fullsized":"2024-04-25T12:22:34.916129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:23.786586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030261+0000","last_change":"2024-04-25T12:21:54.200492+0000","last_active":"2024-04-25T12:22:35.030261+0000","last_peered":"2024-04-25T12:22:35.030261+0000","last_clean":"2024-04-25T12:22:35.030261+0000","last_became_active":"2024-04-25T12:21:54.200187+0000","last_became_peered":"2024-04-25T12:21:54.200187+0000","last_unstale":"2024-04-25T12:22:35.030261+0000","last_undegraded":"2024-04-25T12:22:35.030261+0000","last_fullsized":"2024-04-25T12:22:35.030261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:17.428348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029495+0000","last_change":"2024-04-25T12:21:53.186752+0000","last_active":"2024-04-25T12:22:35.029495+0000","last_peered":"2024-04-25T12:22:35.029495+0000","last_clean":"2024-04-25T12:22:35.029495+0000","last_became_active":"2024-04-25T12:21:53.184866+0000","last_became_peered":"2024-04-25T12:21:53.184866+0000","last_unstale":"2024-04-25T12:22:35.029495+0000","last_undegraded":"2024-04-25T12:22:35.029495+0000","last_fullsized":"2024-04-25T12:22:35.029495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:07.228743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980199+0000","last_change":"2024-04-25T12:21:58.344241+0000","last_active":"2024-04-25T12:22:34.980199+0000","last_peered":"2024-04-25T12:22:34.980199+0000","last_clean":"2024-04-25T12:22:34.980199+0000","last_became_active":"2024-04-25T12:21:58.343764+0000","last_became_peered":"2024-04-25T12:21:58.343764+0000","last_unstale":"2024-04-25T12:22:34.980199+0000","last_undegraded":"2024-04-25T12:22:34.980199+0000","last_fullsized":"2024-04-25T12:22:34.980199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:25.931918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890533+0000","last_change":"2024-04-25T12:21:54.216405+0000","last_active":"2024-04-25T12:22:34.890533+0000","last_peered":"2024-04-25T12:22:34.890533+0000","last_clean":"2024-04-25T12:22:34.890533+0000","last_became_active":"2024-04-25T12:21:54.215575+0000","last_became_peered":"2024-04-25T12:21:54.215575+0000","last_unstale":"2024-04-25T12:22:34.890533+0000","last_undegraded":"2024-04-25T12:22:34.890533+0000","last_fullsized":"2024-04-25T12:22:34.890533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:57.935295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887546+0000","last_change":"2024-04-25T12:21:53.198384+0000","last_active":"2024-04-25T12:22:34.887546+0000","last_peered":"2024-04-25T12:22:34.887546+0000","last_clean":"2024-04-25T12:22:34.887546+0000","last_became_active":"2024-04-25T12:21:53.197618+0000","last_became_peered":"2024-04-25T12:21:53.197618+0000","last_unstale":"2024-04-25T12:22:34.887546+0000","last_undegraded":"2024-04-25T12:22:34.887546+0000","last_fullsized":"2024-04-25T12:22:34.887546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:23.368197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979881+0000","last_change":"2024-04-25T12:21:58.342445+0000","last_active":"2024-04-25T12:22:34.979881+0000","last_peered":"2024-04-25T12:22:34.979881+0000","last_clean":"2024-04-25T12:22:34.979881+0000","last_became_active":"2024-04-25T12:21:58.341575+0000","last_became_peered":"2024-04-25T12:21:58.341575+0000","last_unstale":"2024-04-25T12:22:34.979881+0000","last_undegraded":"2024-04-25T12:22:34.979881+0000","last_fullsized":"2024-04-25T12:22:34.979881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:34.553686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915983+0000","last_change":"2024-04-25T12:21:54.200799+0000","last_active":"2024-04-25T12:22:34.915983+0000","last_peered":"2024-04-25T12:22:34.915983+0000","last_clean":"2024-04-25T12:22:34.915983+0000","last_became_active":"2024-04-25T12:21:54.200209+0000","last_became_peered":"2024-04-25T12:21:54.200209+0000","last_unstale":"2024-04-25T12:22:34.915983+0000","last_undegraded":"2024-04-25T12:22:34.915983+0000","last_fullsized":"2024-04-25T12:22:34.915983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:57.958942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916583+0000","last_change":"2024-04-25T12:21:53.168731+0000","last_active":"2024-04-25T12:22:34.916583+0000","last_peered":"2024-04-25T12:22:34.916583+0000","last_clean":"2024-04-25T12:22:34.916583+0000","last_became_active":"2024-04-25T12:21:53.168461+0000","last_became_peered":"2024-04-25T12:21:53.168461+0000","last_unstale":"2024-04-25T12:22:34.916583+0000","last_undegraded":"2024-04-25T12:22:34.916583+0000","last_fullsized":"2024-04-25T12:22:34.916583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:34.935857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887483+0000","last_change":"2024-04-25T12:21:58.344622+0000","last_active":"2024-04-25T12:22:34.887483+0000","last_peered":"2024-04-25T12:22:34.887483+0000","last_clean":"2024-04-25T12:22:34.887483+0000","last_became_active":"2024-04-25T12:21:58.343533+0000","last_became_peered":"2024-04-25T12:21:58.343533+0000","last_unstale":"2024-04-25T12:22:34.887483+0000","last_undegraded":"2024-04-25T12:22:34.887483+0000","last_fullsized":"2024-04-25T12:22:34.887483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:35.536857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891003+0000","last_change":"2024-04-25T12:21:54.216903+0000","last_active":"2024-04-25T12:22:34.891003+0000","last_peered":"2024-04-25T12:22:34.891003+0000","last_clean":"2024-04-25T12:22:34.891003+0000","last_became_active":"2024-04-25T12:21:54.216312+0000","last_became_peered":"2024-04-25T12:21:54.216312+0000","last_unstale":"2024-04-25T12:22:34.891003+0000","last_undegraded":"2024-04-25T12:22:34.891003+0000","last_fullsized":"2024-04-25T12:22:34.891003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:12.963783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'10","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:11.327474+0000","last_change":"2024-04-25T12:21:53.179160+0000","last_active":"2024-04-25T12:24:11.327474+0000","last_peered":"2024-04-25T12:24:11.327474+0000","last_clean":"2024-04-25T12:24:11.327474+0000","last_became_active":"2024-04-25T12:21:53.177229+0000","last_became_peered":"2024-04-25T12:21:53.177229+0000","last_unstale":"2024-04-25T12:24:11.327474+0000","last_undegraded":"2024-04-25T12:24:11.327474+0000","last_fullsized":"2024-04-25T12:24:11.327474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:09.082459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293725+0000","last_change":"2024-04-25T12:21:58.245003+0000","last_active":"2024-04-25T12:22:35.293725+0000","last_peered":"2024-04-25T12:22:35.293725+0000","last_clean":"2024-04-25T12:22:35.293725+0000","last_became_active":"2024-04-25T12:21:58.244500+0000","last_became_peered":"2024-04-25T12:21:58.244500+0000","last_unstale":"2024-04-25T12:22:35.293725+0000","last_undegraded":"2024-04-25T12:22:35.293725+0000","last_fullsized":"2024-04-25T12:22:35.293725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:35.010344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.895285+0000","last_change":"2024-04-25T12:21:54.213845+0000","last_active":"2024-04-25T12:22:34.895285+0000","last_peered":"2024-04-25T12:22:34.895285+0000","last_clean":"2024-04-25T12:22:34.895285+0000","last_became_active":"2024-04-25T12:21:54.213413+0000","last_became_peered":"2024-04-25T12:21:54.213413+0000","last_unstale":"2024-04-25T12:22:34.895285+0000","last_undegraded":"2024-04-25T12:22:34.895285+0000","last_fullsized":"2024-04-25T12:22:34.895285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:59.864079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293155+0000","last_change":"2024-04-25T12:21:53.186487+0000","last_active":"2024-04-25T12:22:35.293155+0000","last_peered":"2024-04-25T12:22:35.293155+0000","last_clean":"2024-04-25T12:22:35.293155+0000","last_became_active":"2024-04-25T12:21:53.186227+0000","last_became_peered":"2024-04-25T12:21:53.186227+0000","last_unstale":"2024-04-25T12:22:35.293155+0000","last_undegraded":"2024-04-25T12:22:35.293155+0000","last_fullsized":"2024-04-25T12:22:35.293155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:20.317103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894312+0000","last_change":"2024-04-25T12:21:58.249806+0000","last_active":"2024-04-25T12:22:34.894312+0000","last_peered":"2024-04-25T12:22:34.894312+0000","last_clean":"2024-04-25T12:22:34.894312+0000","last_became_active":"2024-04-25T12:21:58.248841+0000","last_became_peered":"2024-04-25T12:21:58.248841+0000","last_unstale":"2024-04-25T12:22:34.894312+0000","last_undegraded":"2024-04-25T12:22:34.894312+0000","last_fullsized":"2024-04-25T12:22:34.894312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:18.448118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916576+0000","last_change":"2024-04-25T12:21:54.189948+0000","last_active":"2024-04-25T12:22:34.916576+0000","last_peered":"2024-04-25T12:22:34.916576+0000","last_clean":"2024-04-25T12:22:34.916576+0000","last_became_active":"2024-04-25T12:21:54.189097+0000","last_became_peered":"2024-04-25T12:21:54.189097+0000","last_unstale":"2024-04-25T12:22:34.916576+0000","last_undegraded":"2024-04-25T12:22:34.916576+0000","last_fullsized":"2024-04-25T12:22:34.916576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:09.029536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.888984+0000","last_change":"2024-04-25T12:21:53.206472+0000","last_active":"2024-04-25T12:22:34.888984+0000","last_peered":"2024-04-25T12:22:34.888984+0000","last_clean":"2024-04-25T12:22:34.888984+0000","last_became_active":"2024-04-25T12:21:53.205742+0000","last_became_peered":"2024-04-25T12:21:53.205742+0000","last_unstale":"2024-04-25T12:22:34.888984+0000","last_undegraded":"2024-04-25T12:22:34.888984+0000","last_fullsized":"2024-04-25T12:22:34.888984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:37.444336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978676+0000","last_change":"2024-04-25T12:21:58.261490+0000","last_active":"2024-04-25T12:22:34.978676+0000","last_peered":"2024-04-25T12:22:34.978676+0000","last_clean":"2024-04-25T12:22:34.978676+0000","last_became_active":"2024-04-25T12:21:58.260979+0000","last_became_peered":"2024-04-25T12:21:58.260979+0000","last_unstale":"2024-04-25T12:22:34.978676+0000","last_undegraded":"2024-04-25T12:22:34.978676+0000","last_fullsized":"2024-04-25T12:22:34.978676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:51.396618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890271+0000","last_change":"2024-04-25T12:22:34.890271+0000","last_active":"2024-04-25T12:22:34.890271+0000","last_peered":"2024-04-25T12:22:34.890271+0000","last_clean":"2024-04-25T12:22:34.890271+0000","last_became_active":"2024-04-25T12:22:34.889562+0000","last_became_peered":"2024-04-25T12:22:34.889562+0000","last_unstale":"2024-04-25T12:22:34.890271+0000","last_undegraded":"2024-04-25T12:22:34.890271+0000","last_fullsized":"2024-04-25T12:22:34.890271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:17.476913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030693+0000","last_change":"2024-04-25T12:21:53.206850+0000","last_active":"2024-04-25T12:22:35.030693+0000","last_peered":"2024-04-25T12:22:35.030693+0000","last_clean":"2024-04-25T12:22:35.030693+0000","last_became_active":"2024-04-25T12:21:53.206274+0000","last_became_peered":"2024-04-25T12:21:53.206274+0000","last_unstale":"2024-04-25T12:22:35.030693+0000","last_undegraded":"2024-04-25T12:22:35.030693+0000","last_fullsized":"2024-04-25T12:22:35.030693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:25.867387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979375+0000","last_change":"2024-04-25T12:21:58.346593+0000","last_active":"2024-04-25T12:22:34.979375+0000","last_peered":"2024-04-25T12:22:34.979375+0000","last_clean":"2024-04-25T12:22:34.979375+0000","last_became_active":"2024-04-25T12:21:58.346195+0000","last_became_peered":"2024-04-25T12:21:58.346195+0000","last_unstale":"2024-04-25T12:22:34.979375+0000","last_undegraded":"2024-04-25T12:22:34.979375+0000","last_fullsized":"2024-04-25T12:22:34.979375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:47.745861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915960+0000","last_change":"2024-04-25T12:21:58.347908+0000","last_active":"2024-04-25T12:22:34.915960+0000","last_peered":"2024-04-25T12:22:34.915960+0000","last_clean":"2024-04-25T12:22:34.915960+0000","last_became_active":"2024-04-25T12:21:58.346887+0000","last_became_peered":"2024-04-25T12:21:58.346887+0000","last_unstale":"2024-04-25T12:22:34.915960+0000","last_undegraded":"2024-04-25T12:22:34.915960+0000","last_fullsized":"2024-04-25T12:22:34.915960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:06.228605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.291914+0000","last_change":"2024-04-25T12:21:54.203140+0000","last_active":"2024-04-25T12:22:35.291914+0000","last_peered":"2024-04-25T12:22:35.291914+0000","last_clean":"2024-04-25T12:22:35.291914+0000","last_became_active":"2024-04-25T12:21:54.202399+0000","last_became_peered":"2024-04-25T12:21:54.202399+0000","last_unstale":"2024-04-25T12:22:35.291914+0000","last_undegraded":"2024-04-25T12:22:35.291914+0000","last_fullsized":"2024-04-25T12:22:35.291914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:19.691760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.888025+0000","last_change":"2024-04-25T12:21:53.202038+0000","last_active":"2024-04-25T12:22:34.888025+0000","last_peered":"2024-04-25T12:22:34.888025+0000","last_clean":"2024-04-25T12:22:34.888025+0000","last_became_active":"2024-04-25T12:21:53.189592+0000","last_became_peered":"2024-04-25T12:21:53.189592+0000","last_unstale":"2024-04-25T12:22:34.888025+0000","last_undegraded":"2024-04-25T12:22:34.888025+0000","last_fullsized":"2024-04-25T12:22:34.888025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:38.052120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030482+0000","last_change":"2024-04-25T12:21:58.246247+0000","last_active":"2024-04-25T12:22:35.030482+0000","last_peered":"2024-04-25T12:22:35.030482+0000","last_clean":"2024-04-25T12:22:35.030482+0000","last_became_active":"2024-04-25T12:21:58.245085+0000","last_became_peered":"2024-04-25T12:21:58.245085+0000","last_unstale":"2024-04-25T12:22:35.030482+0000","last_undegraded":"2024-04-25T12:22:35.030482+0000","last_fullsized":"2024-04-25T12:22:35.030482+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:24.660921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978856+0000","last_change":"2024-04-25T12:21:54.207534+0000","last_active":"2024-04-25T12:22:34.978856+0000","last_peered":"2024-04-25T12:22:34.978856+0000","last_clean":"2024-04-25T12:22:34.978856+0000","last_became_active":"2024-04-25T12:21:54.206786+0000","last_became_peered":"2024-04-25T12:21:54.206786+0000","last_unstale":"2024-04-25T12:22:34.978856+0000","last_undegraded":"2024-04-25T12:22:34.978856+0000","last_fullsized":"2024-04-25T12:22:34.978856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:48.775827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979753+0000","last_change":"2024-04-25T12:21:53.190402+0000","last_active":"2024-04-25T12:22:34.979753+0000","last_peered":"2024-04-25T12:22:34.979753+0000","last_clean":"2024-04-25T12:22:34.979753+0000","last_became_active":"2024-04-25T12:21:53.189936+0000","last_became_peered":"2024-04-25T12:21:53.189936+0000","last_unstale":"2024-04-25T12:22:34.979753+0000","last_undegraded":"2024-04-25T12:22:34.979753+0000","last_fullsized":"2024-04-25T12:22:34.979753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:30.984588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029495+0000","last_change":"2024-04-25T12:21:53.186071+0000","last_active":"2024-04-25T12:22:35.029495+0000","last_peered":"2024-04-25T12:22:35.029495+0000","last_clean":"2024-04-25T12:22:35.029495+0000","last_became_active":"2024-04-25T12:21:53.185357+0000","last_became_peered":"2024-04-25T12:21:53.185357+0000","last_unstale":"2024-04-25T12:22:35.029495+0000","last_undegraded":"2024-04-25T12:22:35.029495+0000","last_fullsized":"2024-04-25T12:22:35.029495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:10.148702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916332+0000","last_change":"2024-04-25T12:21:54.205678+0000","last_active":"2024-04-25T12:22:34.916332+0000","last_peered":"2024-04-25T12:22:34.916332+0000","last_clean":"2024-04-25T12:22:34.916332+0000","last_became_active":"2024-04-25T12:21:54.205219+0000","last_became_peered":"2024-04-25T12:21:54.205219+0000","last_unstale":"2024-04-25T12:22:34.916332+0000","last_undegraded":"2024-04-25T12:22:34.916332+0000","last_fullsized":"2024-04-25T12:22:34.916332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:55.152284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884389+0000","last_change":"2024-04-25T12:21:58.257395+0000","last_active":"2024-04-25T12:22:34.884389+0000","last_peered":"2024-04-25T12:22:34.884389+0000","last_clean":"2024-04-25T12:22:34.884389+0000","last_became_active":"2024-04-25T12:21:58.256219+0000","last_became_peered":"2024-04-25T12:21:58.256219+0000","last_unstale":"2024-04-25T12:22:34.884389+0000","last_undegraded":"2024-04-25T12:22:34.884389+0000","last_fullsized":"2024-04-25T12:22:34.884389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:15.119967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979085+0000","last_change":"2024-04-25T12:21:53.194633+0000","last_active":"2024-04-25T12:22:34.979085+0000","last_peered":"2024-04-25T12:22:34.979085+0000","last_clean":"2024-04-25T12:22:34.979085+0000","last_became_active":"2024-04-25T12:21:53.194306+0000","last_became_peered":"2024-04-25T12:21:53.194306+0000","last_unstale":"2024-04-25T12:22:34.979085+0000","last_undegraded":"2024-04-25T12:22:34.979085+0000","last_fullsized":"2024-04-25T12:22:34.979085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:03.566639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893823+0000","last_change":"2024-04-25T12:21:54.201494+0000","last_active":"2024-04-25T12:22:34.893823+0000","last_peered":"2024-04-25T12:22:34.893823+0000","last_clean":"2024-04-25T12:22:34.893823+0000","last_became_active":"2024-04-25T12:21:54.196085+0000","last_became_peered":"2024-04-25T12:21:54.196085+0000","last_unstale":"2024-04-25T12:22:34.893823+0000","last_undegraded":"2024-04-25T12:22:34.893823+0000","last_fullsized":"2024-04-25T12:22:34.893823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:21.183608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979599+0000","last_change":"2024-04-25T12:21:58.261744+0000","last_active":"2024-04-25T12:22:34.979599+0000","last_peered":"2024-04-25T12:22:34.979599+0000","last_clean":"2024-04-25T12:22:34.979599+0000","last_became_active":"2024-04-25T12:21:58.260821+0000","last_became_peered":"2024-04-25T12:21:58.260821+0000","last_unstale":"2024-04-25T12:22:34.979599+0000","last_undegraded":"2024-04-25T12:22:34.979599+0000","last_fullsized":"2024-04-25T12:22:34.979599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:14.169485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029125+0000","last_change":"2024-04-25T12:21:54.201042+0000","last_active":"2024-04-25T12:22:35.029125+0000","last_peered":"2024-04-25T12:22:35.029125+0000","last_clean":"2024-04-25T12:22:35.029125+0000","last_became_active":"2024-04-25T12:21:54.200446+0000","last_became_peered":"2024-04-25T12:21:54.200446+0000","last_unstale":"2024-04-25T12:22:35.029125+0000","last_undegraded":"2024-04-25T12:22:35.029125+0000","last_fullsized":"2024-04-25T12:22:35.029125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:37.866196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884359+0000","last_change":"2024-04-25T12:21:54.188004+0000","last_active":"2024-04-25T12:22:34.884359+0000","last_peered":"2024-04-25T12:22:34.884359+0000","last_clean":"2024-04-25T12:22:34.884359+0000","last_became_active":"2024-04-25T12:21:54.187254+0000","last_became_peered":"2024-04-25T12:21:54.187254+0000","last_unstale":"2024-04-25T12:22:34.884359+0000","last_undegraded":"2024-04-25T12:22:34.884359+0000","last_fullsized":"2024-04-25T12:22:34.884359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:32.252676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887407+0000","last_change":"2024-04-25T12:21:54.206788+0000","last_active":"2024-04-25T12:22:34.887407+0000","last_peered":"2024-04-25T12:22:34.887407+0000","last_clean":"2024-04-25T12:22:34.887407+0000","last_became_active":"2024-04-25T12:21:54.204904+0000","last_became_peered":"2024-04-25T12:21:54.204904+0000","last_unstale":"2024-04-25T12:22:34.887407+0000","last_undegraded":"2024-04-25T12:22:34.887407+0000","last_fullsized":"2024-04-25T12:22:34.887407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:24.928840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916233+0000","last_change":"2024-04-25T12:21:54.204288+0000","last_active":"2024-04-25T12:22:34.916233+0000","last_peered":"2024-04-25T12:22:34.916233+0000","last_clean":"2024-04-25T12:22:34.916233+0000","last_became_active":"2024-04-25T12:21:54.203922+0000","last_became_peered":"2024-04-25T12:21:54.203922+0000","last_unstale":"2024-04-25T12:22:34.916233+0000","last_undegraded":"2024-04-25T12:22:34.916233+0000","last_fullsized":"2024-04-25T12:22:34.916233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:36.299452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980303+0000","last_change":"2024-04-25T12:21:54.208621+0000","last_active":"2024-04-25T12:22:34.980303+0000","last_peered":"2024-04-25T12:22:34.980303+0000","last_clean":"2024-04-25T12:22:34.980303+0000","last_became_active":"2024-04-25T12:21:54.206993+0000","last_became_peered":"2024-04-25T12:21:54.206993+0000","last_unstale":"2024-04-25T12:22:34.980303+0000","last_undegraded":"2024-04-25T12:22:34.980303+0000","last_fullsized":"2024-04-25T12:22:34.980303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:56:08.605883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292881+0000","last_change":"2024-04-25T12:21:54.202203+0000","last_active":"2024-04-25T12:22:35.292881+0000","last_peered":"2024-04-25T12:22:35.292881+0000","last_clean":"2024-04-25T12:22:35.292881+0000","last_became_active":"2024-04-25T12:21:54.201551+0000","last_became_peered":"2024-04-25T12:21:54.201551+0000","last_unstale":"2024-04-25T12:22:35.292881+0000","last_undegraded":"2024-04-25T12:22:35.292881+0000","last_fullsized":"2024-04-25T12:22:35.292881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:12.846584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030100+0000","last_change":"2024-04-25T12:21:54.220705+0000","last_active":"2024-04-25T12:22:35.030100+0000","last_peered":"2024-04-25T12:22:35.030100+0000","last_clean":"2024-04-25T12:22:35.030100+0000","last_became_active":"2024-04-25T12:21:54.220435+0000","last_became_peered":"2024-04-25T12:21:54.220435+0000","last_unstale":"2024-04-25T12:22:35.030100+0000","last_undegraded":"2024-04-25T12:22:35.030100+0000","last_fullsized":"2024-04-25T12:22:35.030100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:27.885210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980397+0000","last_change":"2024-04-25T12:21:54.206568+0000","last_active":"2024-04-25T12:22:34.980397+0000","last_peered":"2024-04-25T12:22:34.980397+0000","last_clean":"2024-04-25T12:22:34.980397+0000","last_became_active":"2024-04-25T12:21:54.204587+0000","last_became_peered":"2024-04-25T12:21:54.204587+0000","last_unstale":"2024-04-25T12:22:34.980397+0000","last_undegraded":"2024-04-25T12:22:34.980397+0000","last_fullsized":"2024-04-25T12:22:34.980397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:37.419230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.295869+0000","last_change":"2024-04-25T12:22:35.295869+0000","last_active":"2024-04-25T12:22:35.295869+0000","last_peered":"2024-04-25T12:22:35.295869+0000","last_clean":"2024-04-25T12:22:35.295869+0000","last_became_active":"2024-04-25T12:22:35.295116+0000","last_became_peered":"2024-04-25T12:22:35.295116+0000","last_unstale":"2024-04-25T12:22:35.295869+0000","last_undegraded":"2024-04-25T12:22:35.295869+0000","last_fullsized":"2024-04-25T12:22:35.295869+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:08.665587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979578+0000","last_change":"2024-04-25T12:21:54.203886+0000","last_active":"2024-04-25T12:22:34.979578+0000","last_peered":"2024-04-25T12:22:34.979578+0000","last_clean":"2024-04-25T12:22:34.979578+0000","last_became_active":"2024-04-25T12:21:54.203464+0000","last_became_peered":"2024-04-25T12:21:54.203464+0000","last_unstale":"2024-04-25T12:22:34.979578+0000","last_undegraded":"2024-04-25T12:22:34.979578+0000","last_fullsized":"2024-04-25T12:22:34.979578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:41.646353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887358+0000","last_change":"2024-04-25T12:21:54.213114+0000","last_active":"2024-04-25T12:22:34.887358+0000","last_peered":"2024-04-25T12:22:34.887358+0000","last_clean":"2024-04-25T12:22:34.887358+0000","last_became_active":"2024-04-25T12:21:54.212559+0000","last_became_peered":"2024-04-25T12:21:54.212559+0000","last_unstale":"2024-04-25T12:22:34.887358+0000","last_undegraded":"2024-04-25T12:22:34.887358+0000","last_fullsized":"2024-04-25T12:22:34.887358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:13.824789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915648+0000","last_change":"2024-04-25T12:21:54.215749+0000","last_active":"2024-04-25T12:22:34.915648+0000","last_peered":"2024-04-25T12:22:34.915648+0000","last_clean":"2024-04-25T12:22:34.915648+0000","last_became_active":"2024-04-25T12:21:54.215446+0000","last_became_peered":"2024-04-25T12:21:54.215446+0000","last_unstale":"2024-04-25T12:22:34.915648+0000","last_undegraded":"2024-04-25T12:22:34.915648+0000","last_fullsized":"2024-04-25T12:22:34.915648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:31.642141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029876+0000","last_change":"2024-04-25T12:21:54.210099+0000","last_active":"2024-04-25T12:22:35.029876+0000","last_peered":"2024-04-25T12:22:35.029876+0000","last_clean":"2024-04-25T12:22:35.029876+0000","last_became_active":"2024-04-25T12:21:54.209393+0000","last_became_peered":"2024-04-25T12:21:54.209393+0000","last_unstale":"2024-04-25T12:22:35.029876+0000","last_undegraded":"2024-04-25T12:22:35.029876+0000","last_fullsized":"2024-04-25T12:22:35.029876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:32.318047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891441+0000","last_change":"2024-04-25T12:21:54.216255+0000","last_active":"2024-04-25T12:22:34.891441+0000","last_peered":"2024-04-25T12:22:34.891441+0000","last_clean":"2024-04-25T12:22:34.891441+0000","last_became_active":"2024-04-25T12:21:54.211787+0000","last_became_peered":"2024-04-25T12:21:54.211787+0000","last_unstale":"2024-04-25T12:22:34.891441+0000","last_undegraded":"2024-04-25T12:22:34.891441+0000","last_fullsized":"2024-04-25T12:22:34.891441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:32.351790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.886612+0000","last_change":"2024-04-25T12:21:54.200503+0000","last_active":"2024-04-25T12:22:34.886612+0000","last_peered":"2024-04-25T12:22:34.886612+0000","last_clean":"2024-04-25T12:22:34.886612+0000","last_became_active":"2024-04-25T12:21:54.200123+0000","last_became_peered":"2024-04-25T12:21:54.200123+0000","last_unstale":"2024-04-25T12:22:34.886612+0000","last_undegraded":"2024-04-25T12:22:34.886612+0000","last_fullsized":"2024-04-25T12:22:34.886612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:04.504889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.889718+0000","last_change":"2024-04-25T12:21:54.220717+0000","last_active":"2024-04-25T12:22:34.889718+0000","last_peered":"2024-04-25T12:22:34.889718+0000","last_clean":"2024-04-25T12:22:34.889718+0000","last_became_active":"2024-04-25T12:21:54.220272+0000","last_became_peered":"2024-04-25T12:21:54.220272+0000","last_unstale":"2024-04-25T12:22:34.889718+0000","last_undegraded":"2024-04-25T12:22:34.889718+0000","last_fullsized":"2024-04-25T12:22:34.889718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:51.165297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.886279+0000","last_change":"2024-04-25T12:21:54.190288+0000","last_active":"2024-04-25T12:22:34.886279+0000","last_peered":"2024-04-25T12:22:34.886279+0000","last_clean":"2024-04-25T12:22:34.886279+0000","last_became_active":"2024-04-25T12:21:54.189535+0000","last_became_peered":"2024-04-25T12:21:54.189535+0000","last_unstale":"2024-04-25T12:22:34.886279+0000","last_undegraded":"2024-04-25T12:22:34.886279+0000","last_fullsized":"2024-04-25T12:22:34.886279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:03.757883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292136+0000","last_change":"2024-04-25T12:21:54.202898+0000","last_active":"2024-04-25T12:22:35.292136+0000","last_peered":"2024-04-25T12:22:35.292136+0000","last_clean":"2024-04-25T12:22:35.292136+0000","last_became_active":"2024-04-25T12:21:54.201641+0000","last_became_peered":"2024-04-25T12:21:54.201641+0000","last_unstale":"2024-04-25T12:22:35.292136+0000","last_undegraded":"2024-04-25T12:22:35.292136+0000","last_fullsized":"2024-04-25T12:22:35.292136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:42.865496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916388+0000","last_change":"2024-04-25T12:21:54.192818+0000","last_active":"2024-04-25T12:22:34.916388+0000","last_peered":"2024-04-25T12:22:34.916388+0000","last_clean":"2024-04-25T12:22:34.916388+0000","last_became_active":"2024-04-25T12:21:54.192052+0000","last_became_peered":"2024-04-25T12:21:54.192052+0000","last_unstale":"2024-04-25T12:22:34.916388+0000","last_undegraded":"2024-04-25T12:22:34.916388+0000","last_fullsized":"2024-04-25T12:22:34.916388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:26.048483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978815+0000","last_change":"2024-04-25T12:21:54.203798+0000","last_active":"2024-04-25T12:22:34.978815+0000","last_peered":"2024-04-25T12:22:34.978815+0000","last_clean":"2024-04-25T12:22:34.978815+0000","last_became_active":"2024-04-25T12:21:54.203472+0000","last_became_peered":"2024-04-25T12:21:54.203472+0000","last_unstale":"2024-04-25T12:22:34.978815+0000","last_undegraded":"2024-04-25T12:22:34.978815+0000","last_fullsized":"2024-04-25T12:22:34.978815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:19.958172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894317+0000","last_change":"2024-04-25T12:21:54.206055+0000","last_active":"2024-04-25T12:22:34.894317+0000","last_peered":"2024-04-25T12:22:34.894317+0000","last_clean":"2024-04-25T12:22:34.894317+0000","last_became_active":"2024-04-25T12:21:54.203030+0000","last_became_peered":"2024-04-25T12:21:54.203030+0000","last_unstale":"2024-04-25T12:22:34.894317+0000","last_undegraded":"2024-04-25T12:22:34.894317+0000","last_fullsized":"2024-04-25T12:22:34.894317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:58.836301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030468+0000","last_change":"2024-04-25T12:21:54.199660+0000","last_active":"2024-04-25T12:22:35.030468+0000","last_peered":"2024-04-25T12:22:35.030468+0000","last_clean":"2024-04-25T12:22:35.030468+0000","last_became_active":"2024-04-25T12:21:54.199362+0000","last_became_peered":"2024-04-25T12:21:54.199362+0000","last_unstale":"2024-04-25T12:22:35.030468+0000","last_undegraded":"2024-04-25T12:22:35.030468+0000","last_fullsized":"2024-04-25T12:22:35.030468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:57.706566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029976+0000","last_change":"2024-04-25T12:21:54.198710+0000","last_active":"2024-04-25T12:22:35.029976+0000","last_peered":"2024-04-25T12:22:35.029976+0000","last_clean":"2024-04-25T12:22:35.029976+0000","last_became_active":"2024-04-25T12:21:54.198432+0000","last_became_peered":"2024-04-25T12:21:54.198432+0000","last_unstale":"2024-04-25T12:22:35.029976+0000","last_undegraded":"2024-04-25T12:22:35.029976+0000","last_fullsized":"2024-04-25T12:22:35.029976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:33.124005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.892012+0000","last_change":"2024-04-25T12:21:54.218474+0000","last_active":"2024-04-25T12:22:34.892012+0000","last_peered":"2024-04-25T12:22:34.892012+0000","last_clean":"2024-04-25T12:22:34.892012+0000","last_became_active":"2024-04-25T12:21:54.216949+0000","last_became_peered":"2024-04-25T12:21:54.216949+0000","last_unstale":"2024-04-25T12:22:34.892012+0000","last_undegraded":"2024-04-25T12:22:34.892012+0000","last_fullsized":"2024-04-25T12:22:34.892012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:56.162843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978272+0000","last_change":"2024-04-25T12:21:54.200590+0000","last_active":"2024-04-25T12:22:34.978272+0000","last_peered":"2024-04-25T12:22:34.978272+0000","last_clean":"2024-04-25T12:22:34.978272+0000","last_became_active":"2024-04-25T12:21:54.200248+0000","last_became_peered":"2024-04-25T12:21:54.200248+0000","last_unstale":"2024-04-25T12:22:34.978272+0000","last_undegraded":"2024-04-25T12:22:34.978272+0000","last_fullsized":"2024-04-25T12:22:34.978272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:12.875315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.889915+0000","last_change":"2024-04-25T12:21:54.197805+0000","last_active":"2024-04-25T12:22:34.889915+0000","last_peered":"2024-04-25T12:22:34.889915+0000","last_clean":"2024-04-25T12:22:34.889915+0000","last_became_active":"2024-04-25T12:21:54.197028+0000","last_became_peered":"2024-04-25T12:21:54.197028+0000","last_unstale":"2024-04-25T12:22:34.889915+0000","last_undegraded":"2024-04-25T12:22:34.889915+0000","last_fullsized":"2024-04-25T12:22:34.889915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:03.069305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.886967+0000","last_change":"2024-04-25T12:21:54.190517+0000","last_active":"2024-04-25T12:22:34.886967+0000","last_peered":"2024-04-25T12:22:34.886967+0000","last_clean":"2024-04-25T12:22:34.886967+0000","last_became_active":"2024-04-25T12:21:54.189711+0000","last_became_peered":"2024-04-25T12:21:54.189711+0000","last_unstale":"2024-04-25T12:22:34.886967+0000","last_undegraded":"2024-04-25T12:22:34.886967+0000","last_fullsized":"2024-04-25T12:22:34.886967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:17.879060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890186+0000","last_change":"2024-04-25T12:21:54.197205+0000","last_active":"2024-04-25T12:22:34.890186+0000","last_peered":"2024-04-25T12:22:34.890186+0000","last_clean":"2024-04-25T12:22:34.890186+0000","last_became_active":"2024-04-25T12:21:54.196933+0000","last_became_peered":"2024-04-25T12:21:54.196933+0000","last_unstale":"2024-04-25T12:22:34.890186+0000","last_undegraded":"2024-04-25T12:22:34.890186+0000","last_fullsized":"2024-04-25T12:22:34.890186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:32.003058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887450+0000","last_change":"2024-04-25T12:21:54.207709+0000","last_active":"2024-04-25T12:22:34.887450+0000","last_peered":"2024-04-25T12:22:34.887450+0000","last_clean":"2024-04-25T12:22:34.887450+0000","last_became_active":"2024-04-25T12:21:54.207027+0000","last_became_peered":"2024-04-25T12:21:54.207027+0000","last_unstale":"2024-04-25T12:22:34.887450+0000","last_undegraded":"2024-04-25T12:22:34.887450+0000","last_fullsized":"2024-04-25T12:22:34.887450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:15.116440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915838+0000","last_change":"2024-04-25T12:21:54.185338+0000","last_active":"2024-04-25T12:22:34.915838+0000","last_peered":"2024-04-25T12:22:34.915838+0000","last_clean":"2024-04-25T12:22:34.915838+0000","last_became_active":"2024-04-25T12:21:54.184502+0000","last_became_peered":"2024-04-25T12:21:54.184502+0000","last_unstale":"2024-04-25T12:22:34.915838+0000","last_undegraded":"2024-04-25T12:22:34.915838+0000","last_fullsized":"2024-04-25T12:22:34.915838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:29.865959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292679+0000","last_change":"2024-04-25T12:21:54.183773+0000","last_active":"2024-04-25T12:22:35.292679+0000","last_peered":"2024-04-25T12:22:35.292679+0000","last_clean":"2024-04-25T12:22:35.292679+0000","last_became_active":"2024-04-25T12:21:54.182924+0000","last_became_peered":"2024-04-25T12:21:54.182924+0000","last_unstale":"2024-04-25T12:22:35.292679+0000","last_undegraded":"2024-04-25T12:22:35.292679+0000","last_fullsized":"2024-04-25T12:22:35.292679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:22.046777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891694+0000","last_change":"2024-04-25T12:21:54.210631+0000","last_active":"2024-04-25T12:22:34.891694+0000","last_peered":"2024-04-25T12:22:34.891694+0000","last_clean":"2024-04-25T12:22:34.891694+0000","last_became_active":"2024-04-25T12:21:54.210333+0000","last_became_peered":"2024-04-25T12:21:54.210333+0000","last_unstale":"2024-04-25T12:22:34.891694+0000","last_undegraded":"2024-04-25T12:22:34.891694+0000","last_fullsized":"2024-04-25T12:22:34.891694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:39.783406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476770,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":888832,"data_stored":710770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476771,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":123662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476770,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":119910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476769,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":119946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542178,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":303104,"data_stored":123662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542179,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":290816,"data_stored":119820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":119980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542178,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":897024,"data_stored":710826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:24:23.144 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:24:23.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.291+0000 7f0342e75640 1 Processor -- start 2024-04-25T12:24:23.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.291+0000 7f0342e75640 1 -- start start 2024-04-25T12:24:23.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.291+0000 7f0342e75640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f033c14fbc0 0x7f033c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:23.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.291+0000 7f0342e75640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f033c14ffa0 0x7f033c0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:23.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.291+0000 7f0342e75640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f033c0c5d70 con 0x7f033c074100 2024-04-25T12:24:23.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.291+0000 7f0342e75640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f033c0c6050 con 0x7f033c14ffa0 2024-04-25T12:24:23.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.291+0000 7f0342e75640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f033c0c6330 con 0x7f033c14fbc0 2024-04-25T12:24:23.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.295+0000 7f033bfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f033c14ffa0 0x7f033c0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:23.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.295+0000 7f033bfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f033c14ffa0 0x7f033c0c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51734/0 (socket says 172.21.15.94:51734) 2024-04-25T12:24:23.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.295+0000 7f033bfff640 1 -- 172.21.15.94:0/263730886 learned_addr learned my addr 172.21.15.94:0/263730886 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:23.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.295+0000 7f0340c11640 1 --2- 172.21.15.94:0/263730886 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f033c14fbc0 0x7f033c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:23.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.295+0000 7f033bfff640 1 -- 172.21.15.94:0/263730886 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f033c14fbc0 msgr2=0x7f033c06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:23.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.295+0000 7f033bfff640 1 --2- 172.21.15.94:0/263730886 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f033c14fbc0 0x7f033c06f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.295+0000 7f033bfff640 1 -- 172.21.15.94:0/263730886 >> v1:172.21.15.111:6789/0 conn(0x7f033c074100 legacy=0x7f033c0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:23.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.295+0000 7f033bfff640 1 -- 172.21.15.94:0/263730886 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033c0c6610 con 0x7f033c14ffa0 2024-04-25T12:24:23.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.295+0000 7f033bfff640 1 --2- 172.21.15.94:0/263730886 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f033c14ffa0 0x7f033c0c8220 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0324009e50 tx=0x7f032401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b21be175c07b93f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:23.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.295+0000 7f033b7fe640 1 -- 172.21.15.94:0/263730886 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03240a5890 con 0x7f033c14ffa0 2024-04-25T12:24:23.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.295+0000 7f033b7fe640 1 -- 172.21.15.94:0/263730886 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03240a5a30 con 0x7f033c14ffa0 2024-04-25T12:24:23.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.295+0000 7f033b7fe640 1 -- 172.21.15.94:0/263730886 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03240a5e00 con 0x7f033c14ffa0 2024-04-25T12:24:23.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.295+0000 7f0342e75640 1 -- 172.21.15.94:0/263730886 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f033c14ffa0 msgr2=0x7f033c0c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:23.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.295+0000 7f0342e75640 1 --2- 172.21.15.94:0/263730886 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f033c14ffa0 0x7f033c0c8220 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0324009e50 tx=0x7f032401c9f0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.295+0000 7f0342e75640 1 -- 172.21.15.94:0/263730886 shutdown_connections 2024-04-25T12:24:23.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.295+0000 7f0342e75640 1 --2- 172.21.15.94:0/263730886 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f033c14ffa0 0x7f033c0c8220 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.295+0000 7f0342e75640 1 --2- 172.21.15.94:0/263730886 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f033c14fbc0 0x7f033c06f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.295+0000 7f0342e75640 1 -- 172.21.15.94:0/263730886 >> 172.21.15.94:0/263730886 conn(0x7f033c06b9d0 msgr2=0x7f033c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:23.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.295+0000 7f0342e75640 1 -- 172.21.15.94:0/263730886 shutdown_connections 2024-04-25T12:24:23.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.295+0000 7f0342e75640 1 -- 172.21.15.94:0/263730886 wait complete. 2024-04-25T12:24:23.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f0342e75640 1 Processor -- start 2024-04-25T12:24:23.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f0342e75640 1 -- start start 2024-04-25T12:24:23.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f0342e75640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f033c074100 0x7f033c0cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:23.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f0342e75640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f033c14fbc0 0x7f033c13dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:23.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f0342e75640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f033c14ffa0 0x7f033c0c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:23.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f0342e75640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f033c166420 con 0x7f033c074100 2024-04-25T12:24:23.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f0342e75640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f033c1662a0 con 0x7f033c14fbc0 2024-04-25T12:24:23.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f0342e75640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f033c1665a0 con 0x7f033c14ffa0 2024-04-25T12:24:23.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f0340c11640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f033c074100 0x7f033c0cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:23.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f0340c11640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f033c074100 0x7f033c0cb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51742/0 (socket says 172.21.15.94:51742) 2024-04-25T12:24:23.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f0340c11640 1 -- 172.21.15.94:0/1095940516 learned_addr learned my addr 172.21.15.94:0/1095940516 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:23.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f033bfff640 1 --2- 172.21.15.94:0/1095940516 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f033c14fbc0 0x7f033c13dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:23.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f0341412640 1 --2- 172.21.15.94:0/1095940516 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f033c14ffa0 0x7f033c0c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:23.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f0340c11640 1 -- 172.21.15.94:0/1095940516 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f033c14ffa0 msgr2=0x7f033c0c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:23.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f0340c11640 1 --2- 172.21.15.94:0/1095940516 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f033c14ffa0 0x7f033c0c3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f0340c11640 1 -- 172.21.15.94:0/1095940516 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f033c14fbc0 msgr2=0x7f033c13dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:23.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f0340c11640 1 --2- 172.21.15.94:0/1095940516 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f033c14fbc0 0x7f033c13dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f0340c11640 1 -- 172.21.15.94:0/1095940516 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033c14c1d0 con 0x7f033c074100 2024-04-25T12:24:23.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f0340c11640 1 --2- 172.21.15.94:0/1095940516 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f033c074100 0x7f033c0cb940 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f032c00c7f0 tx=0x7f032c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:23.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f03397fa640 1 -- 172.21.15.94:0/1095940516 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c015070 con 0x7f033c074100 2024-04-25T12:24:23.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f03397fa640 1 -- 172.21.15.94:0/1095940516 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f032c004240 con 0x7f033c074100 2024-04-25T12:24:23.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f0342e75640 1 -- 172.21.15.94:0/1095940516 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f033c14c4b0 con 0x7f033c074100 2024-04-25T12:24:23.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f03397fa640 1 -- 172.21.15.94:0/1095940516 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c003620 con 0x7f033c074100 2024-04-25T12:24:23.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f0342e75640 1 -- 172.21.15.94:0/1095940516 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f033c14ca70 con 0x7f033c074100 2024-04-25T12:24:23.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f0342e75640 1 -- 172.21.15.94:0/1095940516 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f033c075df0 con 0x7f033c074100 2024-04-25T12:24:23.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f03397fa640 1 -- 172.21.15.94:0/1095940516 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f032c0037c0 con 0x7f033c074100 2024-04-25T12:24:23.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.299+0000 7f03397fa640 1 --2- 172.21.15.94:0/1095940516 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f031c068380 0x7f031c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:23.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.303+0000 7f033bfff640 1 --2- 172.21.15.94:0/1095940516 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f031c068380 0x7f031c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:23.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.303+0000 7f03397fa640 1 -- 172.21.15.94:0/1095940516 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f032c086cd0 con 0x7f033c074100 2024-04-25T12:24:23.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.303+0000 7f033bfff640 1 --2- 172.21.15.94:0/1095940516 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f031c068380 0x7f031c06a840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f03240ae000 tx=0x7f03240a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:23.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.307+0000 7f03397fa640 1 -- 172.21.15.94:0/1095940516 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f032c056e10 con 0x7f033c074100 2024-04-25T12:24:23.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.451+0000 7f0342e75640 1 -- 172.21.15.94:0/1095940516 --> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f033c0c7df0 con 0x7f031c068380 2024-04-25T12:24:23.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.459+0000 7f03397fa640 1 -- 172.21.15.94:0/1095940516 <== mgr.4101 v2:172.21.15.94:6832/549402167 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332539 (secure 0 0 0) 0x7f033c0c7df0 con 0x7f031c068380 2024-04-25T12:24:23.467 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:23.470 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-04-25T12:24:23.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.467+0000 7f0342e75640 1 -- 172.21.15.94:0/1095940516 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f031c068380 msgr2=0x7f031c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:23.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.467+0000 7f0342e75640 1 --2- 172.21.15.94:0/1095940516 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f031c068380 0x7f031c06a840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f03240ae000 tx=0x7f03240a7070 comp rx=0 tx=0).stop 2024-04-25T12:24:23.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.467+0000 7f0342e75640 1 -- 172.21.15.94:0/1095940516 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f033c074100 msgr2=0x7f033c0cb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:23.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.467+0000 7f0342e75640 1 --2- 172.21.15.94:0/1095940516 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f033c074100 0x7f033c0cb940 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f032c00c7f0 tx=0x7f032c00ccb0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.467+0000 7f0342e75640 1 -- 172.21.15.94:0/1095940516 shutdown_connections 2024-04-25T12:24:23.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.467+0000 7f0342e75640 1 --2- 172.21.15.94:0/1095940516 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f031c068380 0x7f031c06a840 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.467+0000 7f0342e75640 1 --2- 172.21.15.94:0/1095940516 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f033c14ffa0 0x7f033c0c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.467+0000 7f0342e75640 1 --2- 172.21.15.94:0/1095940516 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f033c14fbc0 0x7f033c13dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.467+0000 7f0342e75640 1 --2- 172.21.15.94:0/1095940516 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f033c074100 0x7f033c0cb940 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.467+0000 7f0342e75640 1 -- 172.21.15.94:0/1095940516 >> 172.21.15.94:0/1095940516 conn(0x7f033c06b9d0 msgr2=0x7f033c06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:23.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.467+0000 7f0342e75640 1 -- 172.21.15.94:0/1095940516 shutdown_connections 2024-04-25T12:24:23.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.467+0000 7f0342e75640 1 -- 172.21.15.94:0/1095940516 wait complete. 2024-04-25T12:24:23.486 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-04-25T12:24:21.802749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236304,"kb_used_data":3496,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738416,"statfs":{"total":773094113280,"available":772852137984,"internally_reserved":0,"allocated":3579904,"data_stored":2148576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004223"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916423+0000","last_change":"2024-04-25T12:21:53.194776+0000","last_active":"2024-04-25T12:22:34.916423+0000","last_peered":"2024-04-25T12:22:34.916423+0000","last_clean":"2024-04-25T12:22:34.916423+0000","last_became_active":"2024-04-25T12:21:53.194480+0000","last_became_peered":"2024-04-25T12:21:53.194480+0000","last_unstale":"2024-04-25T12:22:34.916423+0000","last_undegraded":"2024-04-25T12:22:34.916423+0000","last_fullsized":"2024-04-25T12:22:34.916423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:52.906255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979743+0000","last_change":"2024-04-25T12:21:54.200481+0000","last_active":"2024-04-25T12:22:34.979743+0000","last_peered":"2024-04-25T12:22:34.979743+0000","last_clean":"2024-04-25T12:22:34.979743+0000","last_became_active":"2024-04-25T12:21:54.199679+0000","last_became_peered":"2024-04-25T12:21:54.199679+0000","last_unstale":"2024-04-25T12:22:34.979743+0000","last_undegraded":"2024-04-25T12:22:34.979743+0000","last_fullsized":"2024-04-25T12:22:34.979743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:59.395265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978194+0000","last_change":"2024-04-25T12:21:58.346732+0000","last_active":"2024-04-25T12:22:34.978194+0000","last_peered":"2024-04-25T12:22:34.978194+0000","last_clean":"2024-04-25T12:22:34.978194+0000","last_became_active":"2024-04-25T12:21:58.346337+0000","last_became_peered":"2024-04-25T12:21:58.346337+0000","last_unstale":"2024-04-25T12:22:34.978194+0000","last_undegraded":"2024-04-25T12:22:34.978194+0000","last_fullsized":"2024-04-25T12:22:34.978194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:20.028661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980382+0000","last_change":"2024-04-25T12:21:53.166281+0000","last_active":"2024-04-25T12:22:34.980382+0000","last_peered":"2024-04-25T12:22:34.980382+0000","last_clean":"2024-04-25T12:22:34.980382+0000","last_became_active":"2024-04-25T12:21:53.165990+0000","last_became_peered":"2024-04-25T12:21:53.165990+0000","last_unstale":"2024-04-25T12:22:34.980382+0000","last_undegraded":"2024-04-25T12:22:34.980382+0000","last_fullsized":"2024-04-25T12:22:34.980382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:07.228743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916094+0000","last_change":"2024-04-25T12:21:54.189754+0000","last_active":"2024-04-25T12:22:34.916094+0000","last_peered":"2024-04-25T12:22:34.916094+0000","last_clean":"2024-04-25T12:22:34.916094+0000","last_became_active":"2024-04-25T12:21:54.188987+0000","last_became_peered":"2024-04-25T12:21:54.188987+0000","last_unstale":"2024-04-25T12:22:34.916094+0000","last_undegraded":"2024-04-25T12:22:34.916094+0000","last_fullsized":"2024-04-25T12:22:34.916094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:29.603368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.892649+0000","last_change":"2024-04-25T12:21:58.251628+0000","last_active":"2024-04-25T12:22:34.892649+0000","last_peered":"2024-04-25T12:22:34.892649+0000","last_clean":"2024-04-25T12:22:34.892649+0000","last_became_active":"2024-04-25T12:21:58.250542+0000","last_became_peered":"2024-04-25T12:21:58.250542+0000","last_unstale":"2024-04-25T12:22:34.892649+0000","last_undegraded":"2024-04-25T12:22:34.892649+0000","last_fullsized":"2024-04-25T12:22:34.892649+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:33.434685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891183+0000","last_change":"2024-04-25T12:21:53.203427+0000","last_active":"2024-04-25T12:22:34.891183+0000","last_peered":"2024-04-25T12:22:34.891183+0000","last_clean":"2024-04-25T12:22:34.891183+0000","last_became_active":"2024-04-25T12:21:53.202760+0000","last_became_peered":"2024-04-25T12:21:53.202760+0000","last_unstale":"2024-04-25T12:22:34.891183+0000","last_undegraded":"2024-04-25T12:22:34.891183+0000","last_fullsized":"2024-04-25T12:22:34.891183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:44.397450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887586+0000","last_change":"2024-04-25T12:21:54.208420+0000","last_active":"2024-04-25T12:22:34.887586+0000","last_peered":"2024-04-25T12:22:34.887586+0000","last_clean":"2024-04-25T12:22:34.887586+0000","last_became_active":"2024-04-25T12:21:54.208093+0000","last_became_peered":"2024-04-25T12:21:54.208093+0000","last_unstale":"2024-04-25T12:22:34.887586+0000","last_undegraded":"2024-04-25T12:22:34.887586+0000","last_fullsized":"2024-04-25T12:22:34.887586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:08.762268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.892999+0000","last_change":"2024-04-25T12:21:58.255963+0000","last_active":"2024-04-25T12:22:34.892999+0000","last_peered":"2024-04-25T12:22:34.892999+0000","last_clean":"2024-04-25T12:22:34.892999+0000","last_became_active":"2024-04-25T12:21:58.254021+0000","last_became_peered":"2024-04-25T12:21:58.254021+0000","last_unstale":"2024-04-25T12:22:34.892999+0000","last_undegraded":"2024-04-25T12:22:34.892999+0000","last_fullsized":"2024-04-25T12:22:34.892999+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:20.528034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890657+0000","last_change":"2024-04-25T12:21:53.208470+0000","last_active":"2024-04-25T12:22:34.890657+0000","last_peered":"2024-04-25T12:22:34.890657+0000","last_clean":"2024-04-25T12:22:34.890657+0000","last_became_active":"2024-04-25T12:21:53.207929+0000","last_became_peered":"2024-04-25T12:21:53.207929+0000","last_unstale":"2024-04-25T12:22:34.890657+0000","last_undegraded":"2024-04-25T12:22:34.890657+0000","last_fullsized":"2024-04-25T12:22:34.890657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:14.904832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887497+0000","last_change":"2024-04-25T12:21:54.206567+0000","last_active":"2024-04-25T12:22:34.887497+0000","last_peered":"2024-04-25T12:22:34.887497+0000","last_clean":"2024-04-25T12:22:34.887497+0000","last_became_active":"2024-04-25T12:21:54.206138+0000","last_became_peered":"2024-04-25T12:21:54.206138+0000","last_unstale":"2024-04-25T12:22:34.887497+0000","last_undegraded":"2024-04-25T12:22:34.887497+0000","last_fullsized":"2024-04-25T12:22:34.887497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:31.698845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893253+0000","last_change":"2024-04-25T12:21:58.245331+0000","last_active":"2024-04-25T12:22:34.893253+0000","last_peered":"2024-04-25T12:22:34.893253+0000","last_clean":"2024-04-25T12:22:34.893253+0000","last_became_active":"2024-04-25T12:21:58.244313+0000","last_became_peered":"2024-04-25T12:21:58.244313+0000","last_unstale":"2024-04-25T12:22:34.893253+0000","last_undegraded":"2024-04-25T12:22:34.893253+0000","last_fullsized":"2024-04-25T12:22:34.893253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:21.595492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029274+0000","last_change":"2024-04-25T12:21:54.208935+0000","last_active":"2024-04-25T12:22:35.029274+0000","last_peered":"2024-04-25T12:22:35.029274+0000","last_clean":"2024-04-25T12:22:35.029274+0000","last_became_active":"2024-04-25T12:21:54.208338+0000","last_became_peered":"2024-04-25T12:21:54.208338+0000","last_unstale":"2024-04-25T12:22:35.029274+0000","last_undegraded":"2024-04-25T12:22:35.029274+0000","last_fullsized":"2024-04-25T12:22:35.029274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:08.485037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890828+0000","last_change":"2024-04-25T12:21:53.203519+0000","last_active":"2024-04-25T12:22:34.890828+0000","last_peered":"2024-04-25T12:22:34.890828+0000","last_clean":"2024-04-25T12:22:34.890828+0000","last_became_active":"2024-04-25T12:21:53.197141+0000","last_became_peered":"2024-04-25T12:21:53.197141+0000","last_unstale":"2024-04-25T12:22:34.890828+0000","last_undegraded":"2024-04-25T12:22:34.890828+0000","last_fullsized":"2024-04-25T12:22:34.890828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:03.010472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894179+0000","last_change":"2024-04-25T12:21:58.250871+0000","last_active":"2024-04-25T12:22:34.894179+0000","last_peered":"2024-04-25T12:22:34.894179+0000","last_clean":"2024-04-25T12:22:34.894179+0000","last_became_active":"2024-04-25T12:21:58.249079+0000","last_became_peered":"2024-04-25T12:21:58.249079+0000","last_unstale":"2024-04-25T12:22:34.894179+0000","last_undegraded":"2024-04-25T12:22:34.894179+0000","last_fullsized":"2024-04-25T12:22:34.894179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:54.201824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978908+0000","last_change":"2024-04-25T12:21:54.209195+0000","last_active":"2024-04-25T12:22:34.978908+0000","last_peered":"2024-04-25T12:22:34.978908+0000","last_clean":"2024-04-25T12:22:34.978908+0000","last_became_active":"2024-04-25T12:21:54.208802+0000","last_became_peered":"2024-04-25T12:21:54.208802+0000","last_unstale":"2024-04-25T12:22:34.978908+0000","last_undegraded":"2024-04-25T12:22:34.978908+0000","last_fullsized":"2024-04-25T12:22:34.978908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:10.846624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293651+0000","last_change":"2024-04-25T12:21:53.165498+0000","last_active":"2024-04-25T12:22:35.293651+0000","last_peered":"2024-04-25T12:22:35.293651+0000","last_clean":"2024-04-25T12:22:35.293651+0000","last_became_active":"2024-04-25T12:21:53.164867+0000","last_became_peered":"2024-04-25T12:21:53.164867+0000","last_unstale":"2024-04-25T12:22:35.293651+0000","last_undegraded":"2024-04-25T12:22:35.293651+0000","last_fullsized":"2024-04-25T12:22:35.293651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:07.312761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893517+0000","last_change":"2024-04-25T12:21:58.260620+0000","last_active":"2024-04-25T12:22:34.893517+0000","last_peered":"2024-04-25T12:22:34.893517+0000","last_clean":"2024-04-25T12:22:34.893517+0000","last_became_active":"2024-04-25T12:21:58.259595+0000","last_became_peered":"2024-04-25T12:21:58.259595+0000","last_unstale":"2024-04-25T12:22:34.893517+0000","last_undegraded":"2024-04-25T12:22:34.893517+0000","last_fullsized":"2024-04-25T12:22:34.893517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:43.230479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979100+0000","last_change":"2024-04-25T12:21:54.206960+0000","last_active":"2024-04-25T12:22:34.979100+0000","last_peered":"2024-04-25T12:22:34.979100+0000","last_clean":"2024-04-25T12:22:34.979100+0000","last_became_active":"2024-04-25T12:21:54.204650+0000","last_became_peered":"2024-04-25T12:21:54.204650+0000","last_unstale":"2024-04-25T12:22:34.979100+0000","last_undegraded":"2024-04-25T12:22:34.979100+0000","last_fullsized":"2024-04-25T12:22:34.979100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:15.888865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293382+0000","last_change":"2024-04-25T12:21:53.193797+0000","last_active":"2024-04-25T12:22:35.293382+0000","last_peered":"2024-04-25T12:22:35.293382+0000","last_clean":"2024-04-25T12:22:35.293382+0000","last_became_active":"2024-04-25T12:21:53.193466+0000","last_became_peered":"2024-04-25T12:21:53.193466+0000","last_unstale":"2024-04-25T12:22:35.293382+0000","last_undegraded":"2024-04-25T12:22:35.293382+0000","last_fullsized":"2024-04-25T12:22:35.293382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:23.341451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292912+0000","last_change":"2024-04-25T12:21:58.348047+0000","last_active":"2024-04-25T12:22:35.292912+0000","last_peered":"2024-04-25T12:22:35.292912+0000","last_clean":"2024-04-25T12:22:35.292912+0000","last_became_active":"2024-04-25T12:21:58.347583+0000","last_became_peered":"2024-04-25T12:21:58.347583+0000","last_unstale":"2024-04-25T12:22:35.292912+0000","last_undegraded":"2024-04-25T12:22:35.292912+0000","last_fullsized":"2024-04-25T12:22:35.292912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:21:48.878907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894218+0000","last_change":"2024-04-25T12:21:54.196479+0000","last_active":"2024-04-25T12:22:34.894218+0000","last_peered":"2024-04-25T12:22:34.894218+0000","last_clean":"2024-04-25T12:22:34.894218+0000","last_became_active":"2024-04-25T12:21:54.195939+0000","last_became_peered":"2024-04-25T12:21:54.195939+0000","last_unstale":"2024-04-25T12:22:34.894218+0000","last_undegraded":"2024-04-25T12:22:34.894218+0000","last_fullsized":"2024-04-25T12:22:34.894218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:17.787145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.886118+0000","last_change":"2024-04-25T12:21:53.198034+0000","last_active":"2024-04-25T12:22:34.886118+0000","last_peered":"2024-04-25T12:22:34.886118+0000","last_clean":"2024-04-25T12:22:34.886118+0000","last_became_active":"2024-04-25T12:21:53.196252+0000","last_became_peered":"2024-04-25T12:21:53.196252+0000","last_unstale":"2024-04-25T12:22:34.886118+0000","last_undegraded":"2024-04-25T12:22:34.886118+0000","last_fullsized":"2024-04-25T12:22:34.886118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:08.329111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.033926+0000","last_change":"2024-04-25T12:22:35.032802+0000","last_active":"2024-04-25T12:22:35.033926+0000","last_peered":"2024-04-25T12:22:35.033926+0000","last_clean":"2024-04-25T12:22:35.033926+0000","last_became_active":"2024-04-25T12:22:35.031906+0000","last_became_peered":"2024-04-25T12:22:35.031906+0000","last_unstale":"2024-04-25T12:22:35.033926+0000","last_undegraded":"2024-04-25T12:22:35.033926+0000","last_fullsized":"2024-04-25T12:22:35.033926+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:40.346041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916736+0000","last_change":"2024-04-25T12:21:54.192601+0000","last_active":"2024-04-25T12:22:34.916736+0000","last_peered":"2024-04-25T12:22:34.916736+0000","last_clean":"2024-04-25T12:22:34.916736+0000","last_became_active":"2024-04-25T12:21:54.191864+0000","last_became_peered":"2024-04-25T12:21:54.191864+0000","last_unstale":"2024-04-25T12:22:34.916736+0000","last_undegraded":"2024-04-25T12:22:34.916736+0000","last_fullsized":"2024-04-25T12:22:34.916736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:50.392769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030915+0000","last_change":"2024-04-25T12:21:53.197793+0000","last_active":"2024-04-25T12:22:35.030915+0000","last_peered":"2024-04-25T12:22:35.030915+0000","last_clean":"2024-04-25T12:22:35.030915+0000","last_became_active":"2024-04-25T12:21:53.197059+0000","last_became_peered":"2024-04-25T12:21:53.197059+0000","last_unstale":"2024-04-25T12:22:35.030915+0000","last_undegraded":"2024-04-25T12:22:35.030915+0000","last_fullsized":"2024-04-25T12:22:35.030915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:58.471408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893581+0000","last_change":"2024-04-25T12:21:58.355166+0000","last_active":"2024-04-25T12:22:34.893581+0000","last_peered":"2024-04-25T12:22:34.893581+0000","last_clean":"2024-04-25T12:22:34.893581+0000","last_became_active":"2024-04-25T12:21:58.353996+0000","last_became_peered":"2024-04-25T12:21:58.353996+0000","last_unstale":"2024-04-25T12:22:34.893581+0000","last_undegraded":"2024-04-25T12:22:34.893581+0000","last_fullsized":"2024-04-25T12:22:34.893581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:22.681720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980643+0000","last_change":"2024-04-25T12:21:54.219182+0000","last_active":"2024-04-25T12:22:34.980643+0000","last_peered":"2024-04-25T12:22:34.980643+0000","last_clean":"2024-04-25T12:22:34.980643+0000","last_became_active":"2024-04-25T12:21:54.218854+0000","last_became_peered":"2024-04-25T12:21:54.218854+0000","last_unstale":"2024-04-25T12:22:34.980643+0000","last_undegraded":"2024-04-25T12:22:34.980643+0000","last_fullsized":"2024-04-25T12:22:34.980643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:08.985962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292883+0000","last_change":"2024-04-25T12:21:53.190102+0000","last_active":"2024-04-25T12:22:35.292883+0000","last_peered":"2024-04-25T12:22:35.292883+0000","last_clean":"2024-04-25T12:22:35.292883+0000","last_became_active":"2024-04-25T12:21:53.189781+0000","last_became_peered":"2024-04-25T12:21:53.189781+0000","last_unstale":"2024-04-25T12:22:35.292883+0000","last_undegraded":"2024-04-25T12:22:35.292883+0000","last_fullsized":"2024-04-25T12:22:35.292883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:52.533217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978106+0000","last_change":"2024-04-25T12:21:58.341932+0000","last_active":"2024-04-25T12:22:34.978106+0000","last_peered":"2024-04-25T12:22:34.978106+0000","last_clean":"2024-04-25T12:22:34.978106+0000","last_became_active":"2024-04-25T12:21:58.341492+0000","last_became_peered":"2024-04-25T12:21:58.341492+0000","last_unstale":"2024-04-25T12:22:34.978106+0000","last_undegraded":"2024-04-25T12:22:34.978106+0000","last_fullsized":"2024-04-25T12:22:34.978106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:51.576036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293382+0000","last_change":"2024-04-25T12:21:54.182541+0000","last_active":"2024-04-25T12:22:35.293382+0000","last_peered":"2024-04-25T12:22:35.293382+0000","last_clean":"2024-04-25T12:22:35.293382+0000","last_became_active":"2024-04-25T12:21:54.181720+0000","last_became_peered":"2024-04-25T12:21:54.181720+0000","last_unstale":"2024-04-25T12:22:35.293382+0000","last_undegraded":"2024-04-25T12:22:35.293382+0000","last_fullsized":"2024-04-25T12:22:35.293382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:00.544076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891591+0000","last_change":"2024-04-25T12:21:53.200521+0000","last_active":"2024-04-25T12:22:34.891591+0000","last_peered":"2024-04-25T12:22:34.891591+0000","last_clean":"2024-04-25T12:22:34.891591+0000","last_became_active":"2024-04-25T12:21:53.196102+0000","last_became_peered":"2024-04-25T12:21:53.196102+0000","last_unstale":"2024-04-25T12:22:34.891591+0000","last_undegraded":"2024-04-25T12:22:34.891591+0000","last_fullsized":"2024-04-25T12:22:34.891591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:54.350452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916195+0000","last_change":"2024-04-25T12:21:58.342064+0000","last_active":"2024-04-25T12:22:34.916195+0000","last_peered":"2024-04-25T12:22:34.916195+0000","last_clean":"2024-04-25T12:22:34.916195+0000","last_became_active":"2024-04-25T12:21:58.341558+0000","last_became_peered":"2024-04-25T12:21:58.341558+0000","last_unstale":"2024-04-25T12:22:34.916195+0000","last_undegraded":"2024-04-25T12:22:34.916195+0000","last_fullsized":"2024-04-25T12:22:34.916195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:11.378767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887849+0000","last_change":"2024-04-25T12:21:54.206427+0000","last_active":"2024-04-25T12:22:34.887849+0000","last_peered":"2024-04-25T12:22:34.887849+0000","last_clean":"2024-04-25T12:22:34.887849+0000","last_became_active":"2024-04-25T12:21:54.205519+0000","last_became_peered":"2024-04-25T12:21:54.205519+0000","last_unstale":"2024-04-25T12:22:34.887849+0000","last_undegraded":"2024-04-25T12:22:34.887849+0000","last_fullsized":"2024-04-25T12:22:34.887849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:59.659460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293573+0000","last_change":"2024-04-25T12:21:53.162914+0000","last_active":"2024-04-25T12:22:35.293573+0000","last_peered":"2024-04-25T12:22:35.293573+0000","last_clean":"2024-04-25T12:22:35.293573+0000","last_became_active":"2024-04-25T12:21:53.162599+0000","last_became_peered":"2024-04-25T12:21:53.162599+0000","last_unstale":"2024-04-25T12:22:35.293573+0000","last_undegraded":"2024-04-25T12:22:35.293573+0000","last_fullsized":"2024-04-25T12:22:35.293573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:23.448280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.919463+0000","last_change":"2024-04-25T12:22:34.919463+0000","last_active":"2024-04-25T12:22:34.919463+0000","last_peered":"2024-04-25T12:22:34.919463+0000","last_clean":"2024-04-25T12:22:34.919463+0000","last_became_active":"2024-04-25T12:22:34.917798+0000","last_became_peered":"2024-04-25T12:22:34.917798+0000","last_unstale":"2024-04-25T12:22:34.919463+0000","last_undegraded":"2024-04-25T12:22:34.919463+0000","last_fullsized":"2024-04-25T12:22:34.919463+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:35.620229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894822+0000","last_change":"2024-04-25T12:21:54.202462+0000","last_active":"2024-04-25T12:22:34.894822+0000","last_peered":"2024-04-25T12:22:34.894822+0000","last_clean":"2024-04-25T12:22:34.894822+0000","last_became_active":"2024-04-25T12:21:54.202112+0000","last_became_peered":"2024-04-25T12:21:54.202112+0000","last_unstale":"2024-04-25T12:22:34.894822+0000","last_undegraded":"2024-04-25T12:22:34.894822+0000","last_fullsized":"2024-04-25T12:22:34.894822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:20.813264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887672+0000","last_change":"2024-04-25T12:21:53.188606+0000","last_active":"2024-04-25T12:22:34.887672+0000","last_peered":"2024-04-25T12:22:34.887672+0000","last_clean":"2024-04-25T12:22:34.887672+0000","last_became_active":"2024-04-25T12:21:53.187855+0000","last_became_peered":"2024-04-25T12:21:53.187855+0000","last_unstale":"2024-04-25T12:22:34.887672+0000","last_undegraded":"2024-04-25T12:22:34.887672+0000","last_fullsized":"2024-04-25T12:22:34.887672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:52.874270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293184+0000","last_change":"2024-04-25T12:21:58.264074+0000","last_active":"2024-04-25T12:22:35.293184+0000","last_peered":"2024-04-25T12:22:35.293184+0000","last_clean":"2024-04-25T12:22:35.293184+0000","last_became_active":"2024-04-25T12:21:58.263425+0000","last_became_peered":"2024-04-25T12:21:58.263425+0000","last_unstale":"2024-04-25T12:22:35.293184+0000","last_undegraded":"2024-04-25T12:22:35.293184+0000","last_fullsized":"2024-04-25T12:22:35.293184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:02.083494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292583+0000","last_change":"2024-04-25T12:21:54.189512+0000","last_active":"2024-04-25T12:22:35.292583+0000","last_peered":"2024-04-25T12:22:35.292583+0000","last_clean":"2024-04-25T12:22:35.292583+0000","last_became_active":"2024-04-25T12:21:54.188587+0000","last_became_peered":"2024-04-25T12:21:54.188587+0000","last_unstale":"2024-04-25T12:22:35.292583+0000","last_undegraded":"2024-04-25T12:22:35.292583+0000","last_fullsized":"2024-04-25T12:22:35.292583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:00.810648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884624+0000","last_change":"2024-04-25T12:21:53.159998+0000","last_active":"2024-04-25T12:22:34.884624+0000","last_peered":"2024-04-25T12:22:34.884624+0000","last_clean":"2024-04-25T12:22:34.884624+0000","last_became_active":"2024-04-25T12:21:53.159714+0000","last_became_peered":"2024-04-25T12:21:53.159714+0000","last_unstale":"2024-04-25T12:22:34.884624+0000","last_undegraded":"2024-04-25T12:22:34.884624+0000","last_fullsized":"2024-04-25T12:22:34.884624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:38.665874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.982542+0000","last_change":"2024-04-25T12:22:34.982542+0000","last_active":"2024-04-25T12:22:34.982542+0000","last_peered":"2024-04-25T12:22:34.982542+0000","last_clean":"2024-04-25T12:22:34.982542+0000","last_became_active":"2024-04-25T12:22:34.981347+0000","last_became_peered":"2024-04-25T12:22:34.981347+0000","last_unstale":"2024-04-25T12:22:34.982542+0000","last_undegraded":"2024-04-25T12:22:34.982542+0000","last_fullsized":"2024-04-25T12:22:34.982542+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:55.180698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915214+0000","last_change":"2024-04-25T12:21:54.205348+0000","last_active":"2024-04-25T12:22:34.915214+0000","last_peered":"2024-04-25T12:22:34.915214+0000","last_clean":"2024-04-25T12:22:34.915214+0000","last_became_active":"2024-04-25T12:21:54.205023+0000","last_became_peered":"2024-04-25T12:21:54.205023+0000","last_unstale":"2024-04-25T12:22:34.915214+0000","last_undegraded":"2024-04-25T12:22:34.915214+0000","last_fullsized":"2024-04-25T12:22:34.915214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:46.381368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.888119+0000","last_change":"2024-04-25T12:21:53.201066+0000","last_active":"2024-04-25T12:22:34.888119+0000","last_peered":"2024-04-25T12:22:34.888119+0000","last_clean":"2024-04-25T12:22:34.888119+0000","last_became_active":"2024-04-25T12:21:53.197081+0000","last_became_peered":"2024-04-25T12:21:53.197081+0000","last_unstale":"2024-04-25T12:22:34.888119+0000","last_undegraded":"2024-04-25T12:22:34.888119+0000","last_fullsized":"2024-04-25T12:22:34.888119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:19.865455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916511+0000","last_change":"2024-04-25T12:21:58.343823+0000","last_active":"2024-04-25T12:22:34.916511+0000","last_peered":"2024-04-25T12:22:34.916511+0000","last_clean":"2024-04-25T12:22:34.916511+0000","last_became_active":"2024-04-25T12:21:58.342796+0000","last_became_peered":"2024-04-25T12:21:58.342796+0000","last_unstale":"2024-04-25T12:22:34.916511+0000","last_undegraded":"2024-04-25T12:22:34.916511+0000","last_fullsized":"2024-04-25T12:22:34.916511+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:14.849636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979107+0000","last_change":"2024-04-25T12:21:54.204569+0000","last_active":"2024-04-25T12:22:34.979107+0000","last_peered":"2024-04-25T12:22:34.979107+0000","last_clean":"2024-04-25T12:22:34.979107+0000","last_became_active":"2024-04-25T12:21:54.204212+0000","last_became_peered":"2024-04-25T12:21:54.204212+0000","last_unstale":"2024-04-25T12:22:34.979107+0000","last_undegraded":"2024-04-25T12:22:34.979107+0000","last_fullsized":"2024-04-25T12:22:34.979107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:44.245327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887147+0000","last_change":"2024-04-25T12:21:53.169844+0000","last_active":"2024-04-25T12:22:34.887147+0000","last_peered":"2024-04-25T12:22:34.887147+0000","last_clean":"2024-04-25T12:22:34.887147+0000","last_became_active":"2024-04-25T12:21:53.168939+0000","last_became_peered":"2024-04-25T12:21:53.168939+0000","last_unstale":"2024-04-25T12:22:34.887147+0000","last_undegraded":"2024-04-25T12:22:34.887147+0000","last_fullsized":"2024-04-25T12:22:34.887147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:57.836476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.888439+0000","last_change":"2024-04-25T12:21:42.610528+0000","last_active":"2024-04-25T12:22:34.888439+0000","last_peered":"2024-04-25T12:22:34.888439+0000","last_clean":"2024-04-25T12:22:34.888439+0000","last_became_active":"2024-04-25T12:21:42.608579+0000","last_became_peered":"2024-04-25T12:21:42.608579+0000","last_unstale":"2024-04-25T12:22:34.888439+0000","last_undegraded":"2024-04-25T12:22:34.888439+0000","last_fullsized":"2024-04-25T12:22:34.888439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:39.904333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:39.904333+0000","last_clean_scrub_stamp":"2024-04-25T12:21:39.904333+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:16.122851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029891+0000","last_change":"2024-04-25T12:21:58.351105+0000","last_active":"2024-04-25T12:22:35.029891+0000","last_peered":"2024-04-25T12:22:35.029891+0000","last_clean":"2024-04-25T12:22:35.029891+0000","last_became_active":"2024-04-25T12:21:58.350087+0000","last_became_peered":"2024-04-25T12:21:58.350087+0000","last_unstale":"2024-04-25T12:22:35.029891+0000","last_undegraded":"2024-04-25T12:22:35.029891+0000","last_fullsized":"2024-04-25T12:22:35.029891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:22.686410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891042+0000","last_change":"2024-04-25T12:21:54.215530+0000","last_active":"2024-04-25T12:22:34.891042+0000","last_peered":"2024-04-25T12:22:34.891042+0000","last_clean":"2024-04-25T12:22:34.891042+0000","last_became_active":"2024-04-25T12:21:54.211077+0000","last_became_peered":"2024-04-25T12:21:54.211077+0000","last_unstale":"2024-04-25T12:22:34.891042+0000","last_undegraded":"2024-04-25T12:22:34.891042+0000","last_fullsized":"2024-04-25T12:22:34.891042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:03.079964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884857+0000","last_change":"2024-04-25T12:21:53.175259+0000","last_active":"2024-04-25T12:22:34.884857+0000","last_peered":"2024-04-25T12:22:34.884857+0000","last_clean":"2024-04-25T12:22:34.884857+0000","last_became_active":"2024-04-25T12:21:53.174980+0000","last_became_peered":"2024-04-25T12:21:53.174980+0000","last_unstale":"2024-04-25T12:22:34.884857+0000","last_undegraded":"2024-04-25T12:22:34.884857+0000","last_fullsized":"2024-04-25T12:22:34.884857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:51.852590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029315+0000","last_change":"2024-04-25T12:21:58.344660+0000","last_active":"2024-04-25T12:22:35.029315+0000","last_peered":"2024-04-25T12:22:35.029315+0000","last_clean":"2024-04-25T12:22:35.029315+0000","last_became_active":"2024-04-25T12:21:58.343502+0000","last_became_peered":"2024-04-25T12:21:58.343502+0000","last_unstale":"2024-04-25T12:22:35.029315+0000","last_undegraded":"2024-04-25T12:22:35.029315+0000","last_fullsized":"2024-04-25T12:22:35.029315+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:46.127740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887959+0000","last_change":"2024-04-25T12:21:54.207666+0000","last_active":"2024-04-25T12:22:34.887959+0000","last_peered":"2024-04-25T12:22:34.887959+0000","last_clean":"2024-04-25T12:22:34.887959+0000","last_became_active":"2024-04-25T12:21:54.206749+0000","last_became_peered":"2024-04-25T12:21:54.206749+0000","last_unstale":"2024-04-25T12:22:34.887959+0000","last_undegraded":"2024-04-25T12:22:34.887959+0000","last_fullsized":"2024-04-25T12:22:34.887959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:36.113364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293367+0000","last_change":"2024-04-25T12:21:53.179412+0000","last_active":"2024-04-25T12:22:35.293367+0000","last_peered":"2024-04-25T12:22:35.293367+0000","last_clean":"2024-04-25T12:22:35.293367+0000","last_became_active":"2024-04-25T12:21:53.179142+0000","last_became_peered":"2024-04-25T12:21:53.179142+0000","last_unstale":"2024-04-25T12:22:35.293367+0000","last_undegraded":"2024-04-25T12:22:35.293367+0000","last_fullsized":"2024-04-25T12:22:35.293367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:08.771439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915942+0000","last_change":"2024-04-25T12:21:58.254119+0000","last_active":"2024-04-25T12:22:34.915942+0000","last_peered":"2024-04-25T12:22:34.915942+0000","last_clean":"2024-04-25T12:22:34.915942+0000","last_became_active":"2024-04-25T12:21:58.253624+0000","last_became_peered":"2024-04-25T12:21:58.253624+0000","last_unstale":"2024-04-25T12:22:34.915942+0000","last_undegraded":"2024-04-25T12:22:34.915942+0000","last_fullsized":"2024-04-25T12:22:34.915942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:54.719908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891979+0000","last_change":"2024-04-25T12:21:54.219803+0000","last_active":"2024-04-25T12:22:34.891979+0000","last_peered":"2024-04-25T12:22:34.891979+0000","last_clean":"2024-04-25T12:22:34.891979+0000","last_became_active":"2024-04-25T12:21:54.219513+0000","last_became_peered":"2024-04-25T12:21:54.219513+0000","last_unstale":"2024-04-25T12:22:34.891979+0000","last_undegraded":"2024-04-25T12:22:34.891979+0000","last_fullsized":"2024-04-25T12:22:34.891979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:03.617773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.886845+0000","last_change":"2024-04-25T12:21:53.159382+0000","last_active":"2024-04-25T12:22:34.886845+0000","last_peered":"2024-04-25T12:22:34.886845+0000","last_clean":"2024-04-25T12:22:34.886845+0000","last_became_active":"2024-04-25T12:21:53.159018+0000","last_became_peered":"2024-04-25T12:21:53.159018+0000","last_unstale":"2024-04-25T12:22:34.886845+0000","last_undegraded":"2024-04-25T12:22:34.886845+0000","last_fullsized":"2024-04-25T12:22:34.886845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:39.868721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.885990+0000","last_change":"2024-04-25T12:21:58.344915+0000","last_active":"2024-04-25T12:22:34.885990+0000","last_peered":"2024-04-25T12:22:34.885990+0000","last_clean":"2024-04-25T12:22:34.885990+0000","last_became_active":"2024-04-25T12:21:58.343839+0000","last_became_peered":"2024-04-25T12:21:58.343839+0000","last_unstale":"2024-04-25T12:22:34.885990+0000","last_undegraded":"2024-04-25T12:22:34.885990+0000","last_fullsized":"2024-04-25T12:22:34.885990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:20.784047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891353+0000","last_change":"2024-04-25T12:21:54.215509+0000","last_active":"2024-04-25T12:22:34.891353+0000","last_peered":"2024-04-25T12:22:34.891353+0000","last_clean":"2024-04-25T12:22:34.891353+0000","last_became_active":"2024-04-25T12:21:54.211719+0000","last_became_peered":"2024-04-25T12:21:54.211719+0000","last_unstale":"2024-04-25T12:22:34.891353+0000","last_undegraded":"2024-04-25T12:22:34.891353+0000","last_fullsized":"2024-04-25T12:22:34.891353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:21.047044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.895010+0000","last_change":"2024-04-25T12:21:53.170513+0000","last_active":"2024-04-25T12:22:34.895010+0000","last_peered":"2024-04-25T12:22:34.895010+0000","last_clean":"2024-04-25T12:22:34.895010+0000","last_became_active":"2024-04-25T12:21:53.169743+0000","last_became_peered":"2024-04-25T12:21:53.169743+0000","last_unstale":"2024-04-25T12:22:34.895010+0000","last_undegraded":"2024-04-25T12:22:34.895010+0000","last_fullsized":"2024-04-25T12:22:34.895010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:03.566639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893058+0000","last_change":"2024-04-25T12:21:58.254432+0000","last_active":"2024-04-25T12:22:34.893058+0000","last_peered":"2024-04-25T12:22:34.893058+0000","last_clean":"2024-04-25T12:22:34.893058+0000","last_became_active":"2024-04-25T12:21:58.253256+0000","last_became_peered":"2024-04-25T12:21:58.253256+0000","last_unstale":"2024-04-25T12:22:34.893058+0000","last_undegraded":"2024-04-25T12:22:34.893058+0000","last_fullsized":"2024-04-25T12:22:34.893058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:13.469118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.896289+0000","last_change":"2024-04-25T12:22:34.896289+0000","last_active":"2024-04-25T12:22:34.896289+0000","last_peered":"2024-04-25T12:22:34.896289+0000","last_clean":"2024-04-25T12:22:34.896289+0000","last_became_active":"2024-04-25T12:22:34.895584+0000","last_became_peered":"2024-04-25T12:22:34.895584+0000","last_unstale":"2024-04-25T12:22:34.896289+0000","last_undegraded":"2024-04-25T12:22:34.896289+0000","last_fullsized":"2024-04-25T12:22:34.896289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:54.648002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884039+0000","last_change":"2024-04-25T12:21:53.163846+0000","last_active":"2024-04-25T12:22:34.884039+0000","last_peered":"2024-04-25T12:22:34.884039+0000","last_clean":"2024-04-25T12:22:34.884039+0000","last_became_active":"2024-04-25T12:21:53.163565+0000","last_became_peered":"2024-04-25T12:21:53.163565+0000","last_unstale":"2024-04-25T12:22:34.884039+0000","last_undegraded":"2024-04-25T12:22:34.884039+0000","last_fullsized":"2024-04-25T12:22:34.884039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:22.297830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916129+0000","last_change":"2024-04-25T12:21:58.250582+0000","last_active":"2024-04-25T12:22:34.916129+0000","last_peered":"2024-04-25T12:22:34.916129+0000","last_clean":"2024-04-25T12:22:34.916129+0000","last_became_active":"2024-04-25T12:21:58.250136+0000","last_became_peered":"2024-04-25T12:21:58.250136+0000","last_unstale":"2024-04-25T12:22:34.916129+0000","last_undegraded":"2024-04-25T12:22:34.916129+0000","last_fullsized":"2024-04-25T12:22:34.916129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:23.786586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030261+0000","last_change":"2024-04-25T12:21:54.200492+0000","last_active":"2024-04-25T12:22:35.030261+0000","last_peered":"2024-04-25T12:22:35.030261+0000","last_clean":"2024-04-25T12:22:35.030261+0000","last_became_active":"2024-04-25T12:21:54.200187+0000","last_became_peered":"2024-04-25T12:21:54.200187+0000","last_unstale":"2024-04-25T12:22:35.030261+0000","last_undegraded":"2024-04-25T12:22:35.030261+0000","last_fullsized":"2024-04-25T12:22:35.030261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:17.428348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029495+0000","last_change":"2024-04-25T12:21:53.186752+0000","last_active":"2024-04-25T12:22:35.029495+0000","last_peered":"2024-04-25T12:22:35.029495+0000","last_clean":"2024-04-25T12:22:35.029495+0000","last_became_active":"2024-04-25T12:21:53.184866+0000","last_became_peered":"2024-04-25T12:21:53.184866+0000","last_unstale":"2024-04-25T12:22:35.029495+0000","last_undegraded":"2024-04-25T12:22:35.029495+0000","last_fullsized":"2024-04-25T12:22:35.029495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:07.228743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980199+0000","last_change":"2024-04-25T12:21:58.344241+0000","last_active":"2024-04-25T12:22:34.980199+0000","last_peered":"2024-04-25T12:22:34.980199+0000","last_clean":"2024-04-25T12:22:34.980199+0000","last_became_active":"2024-04-25T12:21:58.343764+0000","last_became_peered":"2024-04-25T12:21:58.343764+0000","last_unstale":"2024-04-25T12:22:34.980199+0000","last_undegraded":"2024-04-25T12:22:34.980199+0000","last_fullsized":"2024-04-25T12:22:34.980199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:25.931918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890533+0000","last_change":"2024-04-25T12:21:54.216405+0000","last_active":"2024-04-25T12:22:34.890533+0000","last_peered":"2024-04-25T12:22:34.890533+0000","last_clean":"2024-04-25T12:22:34.890533+0000","last_became_active":"2024-04-25T12:21:54.215575+0000","last_became_peered":"2024-04-25T12:21:54.215575+0000","last_unstale":"2024-04-25T12:22:34.890533+0000","last_undegraded":"2024-04-25T12:22:34.890533+0000","last_fullsized":"2024-04-25T12:22:34.890533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:57.935295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887546+0000","last_change":"2024-04-25T12:21:53.198384+0000","last_active":"2024-04-25T12:22:34.887546+0000","last_peered":"2024-04-25T12:22:34.887546+0000","last_clean":"2024-04-25T12:22:34.887546+0000","last_became_active":"2024-04-25T12:21:53.197618+0000","last_became_peered":"2024-04-25T12:21:53.197618+0000","last_unstale":"2024-04-25T12:22:34.887546+0000","last_undegraded":"2024-04-25T12:22:34.887546+0000","last_fullsized":"2024-04-25T12:22:34.887546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:23.368197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979881+0000","last_change":"2024-04-25T12:21:58.342445+0000","last_active":"2024-04-25T12:22:34.979881+0000","last_peered":"2024-04-25T12:22:34.979881+0000","last_clean":"2024-04-25T12:22:34.979881+0000","last_became_active":"2024-04-25T12:21:58.341575+0000","last_became_peered":"2024-04-25T12:21:58.341575+0000","last_unstale":"2024-04-25T12:22:34.979881+0000","last_undegraded":"2024-04-25T12:22:34.979881+0000","last_fullsized":"2024-04-25T12:22:34.979881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:34.553686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915983+0000","last_change":"2024-04-25T12:21:54.200799+0000","last_active":"2024-04-25T12:22:34.915983+0000","last_peered":"2024-04-25T12:22:34.915983+0000","last_clean":"2024-04-25T12:22:34.915983+0000","last_became_active":"2024-04-25T12:21:54.200209+0000","last_became_peered":"2024-04-25T12:21:54.200209+0000","last_unstale":"2024-04-25T12:22:34.915983+0000","last_undegraded":"2024-04-25T12:22:34.915983+0000","last_fullsized":"2024-04-25T12:22:34.915983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:57.958942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916583+0000","last_change":"2024-04-25T12:21:53.168731+0000","last_active":"2024-04-25T12:22:34.916583+0000","last_peered":"2024-04-25T12:22:34.916583+0000","last_clean":"2024-04-25T12:22:34.916583+0000","last_became_active":"2024-04-25T12:21:53.168461+0000","last_became_peered":"2024-04-25T12:21:53.168461+0000","last_unstale":"2024-04-25T12:22:34.916583+0000","last_undegraded":"2024-04-25T12:22:34.916583+0000","last_fullsized":"2024-04-25T12:22:34.916583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:34.935857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887483+0000","last_change":"2024-04-25T12:21:58.344622+0000","last_active":"2024-04-25T12:22:34.887483+0000","last_peered":"2024-04-25T12:22:34.887483+0000","last_clean":"2024-04-25T12:22:34.887483+0000","last_became_active":"2024-04-25T12:21:58.343533+0000","last_became_peered":"2024-04-25T12:21:58.343533+0000","last_unstale":"2024-04-25T12:22:34.887483+0000","last_undegraded":"2024-04-25T12:22:34.887483+0000","last_fullsized":"2024-04-25T12:22:34.887483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:35.536857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891003+0000","last_change":"2024-04-25T12:21:54.216903+0000","last_active":"2024-04-25T12:22:34.891003+0000","last_peered":"2024-04-25T12:22:34.891003+0000","last_clean":"2024-04-25T12:22:34.891003+0000","last_became_active":"2024-04-25T12:21:54.216312+0000","last_became_peered":"2024-04-25T12:21:54.216312+0000","last_unstale":"2024-04-25T12:22:34.891003+0000","last_undegraded":"2024-04-25T12:22:34.891003+0000","last_fullsized":"2024-04-25T12:22:34.891003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:12.963783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'10","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:11.327474+0000","last_change":"2024-04-25T12:21:53.179160+0000","last_active":"2024-04-25T12:24:11.327474+0000","last_peered":"2024-04-25T12:24:11.327474+0000","last_clean":"2024-04-25T12:24:11.327474+0000","last_became_active":"2024-04-25T12:21:53.177229+0000","last_became_peered":"2024-04-25T12:21:53.177229+0000","last_unstale":"2024-04-25T12:24:11.327474+0000","last_undegraded":"2024-04-25T12:24:11.327474+0000","last_fullsized":"2024-04-25T12:24:11.327474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:09.082459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293725+0000","last_change":"2024-04-25T12:21:58.245003+0000","last_active":"2024-04-25T12:22:35.293725+0000","last_peered":"2024-04-25T12:22:35.293725+0000","last_clean":"2024-04-25T12:22:35.293725+0000","last_became_active":"2024-04-25T12:21:58.244500+0000","last_became_peered":"2024-04-25T12:21:58.244500+0000","last_unstale":"2024-04-25T12:22:35.293725+0000","last_undegraded":"2024-04-25T12:22:35.293725+0000","last_fullsized":"2024-04-25T12:22:35.293725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:35.010344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.895285+0000","last_change":"2024-04-25T12:21:54.213845+0000","last_active":"2024-04-25T12:22:34.895285+0000","last_peered":"2024-04-25T12:22:34.895285+0000","last_clean":"2024-04-25T12:22:34.895285+0000","last_became_active":"2024-04-25T12:21:54.213413+0000","last_became_peered":"2024-04-25T12:21:54.213413+0000","last_unstale":"2024-04-25T12:22:34.895285+0000","last_undegraded":"2024-04-25T12:22:34.895285+0000","last_fullsized":"2024-04-25T12:22:34.895285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:59.864079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293155+0000","last_change":"2024-04-25T12:21:53.186487+0000","last_active":"2024-04-25T12:22:35.293155+0000","last_peered":"2024-04-25T12:22:35.293155+0000","last_clean":"2024-04-25T12:22:35.293155+0000","last_became_active":"2024-04-25T12:21:53.186227+0000","last_became_peered":"2024-04-25T12:21:53.186227+0000","last_unstale":"2024-04-25T12:22:35.293155+0000","last_undegraded":"2024-04-25T12:22:35.293155+0000","last_fullsized":"2024-04-25T12:22:35.293155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:20.317103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894312+0000","last_change":"2024-04-25T12:21:58.249806+0000","last_active":"2024-04-25T12:22:34.894312+0000","last_peered":"2024-04-25T12:22:34.894312+0000","last_clean":"2024-04-25T12:22:34.894312+0000","last_became_active":"2024-04-25T12:21:58.248841+0000","last_became_peered":"2024-04-25T12:21:58.248841+0000","last_unstale":"2024-04-25T12:22:34.894312+0000","last_undegraded":"2024-04-25T12:22:34.894312+0000","last_fullsized":"2024-04-25T12:22:34.894312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:18.448118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916576+0000","last_change":"2024-04-25T12:21:54.189948+0000","last_active":"2024-04-25T12:22:34.916576+0000","last_peered":"2024-04-25T12:22:34.916576+0000","last_clean":"2024-04-25T12:22:34.916576+0000","last_became_active":"2024-04-25T12:21:54.189097+0000","last_became_peered":"2024-04-25T12:21:54.189097+0000","last_unstale":"2024-04-25T12:22:34.916576+0000","last_undegraded":"2024-04-25T12:22:34.916576+0000","last_fullsized":"2024-04-25T12:22:34.916576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:09.029536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.888984+0000","last_change":"2024-04-25T12:21:53.206472+0000","last_active":"2024-04-25T12:22:34.888984+0000","last_peered":"2024-04-25T12:22:34.888984+0000","last_clean":"2024-04-25T12:22:34.888984+0000","last_became_active":"2024-04-25T12:21:53.205742+0000","last_became_peered":"2024-04-25T12:21:53.205742+0000","last_unstale":"2024-04-25T12:22:34.888984+0000","last_undegraded":"2024-04-25T12:22:34.888984+0000","last_fullsized":"2024-04-25T12:22:34.888984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:37.444336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978676+0000","last_change":"2024-04-25T12:21:58.261490+0000","last_active":"2024-04-25T12:22:34.978676+0000","last_peered":"2024-04-25T12:22:34.978676+0000","last_clean":"2024-04-25T12:22:34.978676+0000","last_became_active":"2024-04-25T12:21:58.260979+0000","last_became_peered":"2024-04-25T12:21:58.260979+0000","last_unstale":"2024-04-25T12:22:34.978676+0000","last_undegraded":"2024-04-25T12:22:34.978676+0000","last_fullsized":"2024-04-25T12:22:34.978676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:51.396618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890271+0000","last_change":"2024-04-25T12:22:34.890271+0000","last_active":"2024-04-25T12:22:34.890271+0000","last_peered":"2024-04-25T12:22:34.890271+0000","last_clean":"2024-04-25T12:22:34.890271+0000","last_became_active":"2024-04-25T12:22:34.889562+0000","last_became_peered":"2024-04-25T12:22:34.889562+0000","last_unstale":"2024-04-25T12:22:34.890271+0000","last_undegraded":"2024-04-25T12:22:34.890271+0000","last_fullsized":"2024-04-25T12:22:34.890271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:17.476913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030693+0000","last_change":"2024-04-25T12:21:53.206850+0000","last_active":"2024-04-25T12:22:35.030693+0000","last_peered":"2024-04-25T12:22:35.030693+0000","last_clean":"2024-04-25T12:22:35.030693+0000","last_became_active":"2024-04-25T12:21:53.206274+0000","last_became_peered":"2024-04-25T12:21:53.206274+0000","last_unstale":"2024-04-25T12:22:35.030693+0000","last_undegraded":"2024-04-25T12:22:35.030693+0000","last_fullsized":"2024-04-25T12:22:35.030693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:25.867387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979375+0000","last_change":"2024-04-25T12:21:58.346593+0000","last_active":"2024-04-25T12:22:34.979375+0000","last_peered":"2024-04-25T12:22:34.979375+0000","last_clean":"2024-04-25T12:22:34.979375+0000","last_became_active":"2024-04-25T12:21:58.346195+0000","last_became_peered":"2024-04-25T12:21:58.346195+0000","last_unstale":"2024-04-25T12:22:34.979375+0000","last_undegraded":"2024-04-25T12:22:34.979375+0000","last_fullsized":"2024-04-25T12:22:34.979375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:47.745861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915960+0000","last_change":"2024-04-25T12:21:58.347908+0000","last_active":"2024-04-25T12:22:34.915960+0000","last_peered":"2024-04-25T12:22:34.915960+0000","last_clean":"2024-04-25T12:22:34.915960+0000","last_became_active":"2024-04-25T12:21:58.346887+0000","last_became_peered":"2024-04-25T12:21:58.346887+0000","last_unstale":"2024-04-25T12:22:34.915960+0000","last_undegraded":"2024-04-25T12:22:34.915960+0000","last_fullsized":"2024-04-25T12:22:34.915960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:06.228605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.291914+0000","last_change":"2024-04-25T12:21:54.203140+0000","last_active":"2024-04-25T12:22:35.291914+0000","last_peered":"2024-04-25T12:22:35.291914+0000","last_clean":"2024-04-25T12:22:35.291914+0000","last_became_active":"2024-04-25T12:21:54.202399+0000","last_became_peered":"2024-04-25T12:21:54.202399+0000","last_unstale":"2024-04-25T12:22:35.291914+0000","last_undegraded":"2024-04-25T12:22:35.291914+0000","last_fullsized":"2024-04-25T12:22:35.291914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:19.691760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.888025+0000","last_change":"2024-04-25T12:21:53.202038+0000","last_active":"2024-04-25T12:22:34.888025+0000","last_peered":"2024-04-25T12:22:34.888025+0000","last_clean":"2024-04-25T12:22:34.888025+0000","last_became_active":"2024-04-25T12:21:53.189592+0000","last_became_peered":"2024-04-25T12:21:53.189592+0000","last_unstale":"2024-04-25T12:22:34.888025+0000","last_undegraded":"2024-04-25T12:22:34.888025+0000","last_fullsized":"2024-04-25T12:22:34.888025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:38.052120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030482+0000","last_change":"2024-04-25T12:21:58.246247+0000","last_active":"2024-04-25T12:22:35.030482+0000","last_peered":"2024-04-25T12:22:35.030482+0000","last_clean":"2024-04-25T12:22:35.030482+0000","last_became_active":"2024-04-25T12:21:58.245085+0000","last_became_peered":"2024-04-25T12:21:58.245085+0000","last_unstale":"2024-04-25T12:22:35.030482+0000","last_undegraded":"2024-04-25T12:22:35.030482+0000","last_fullsized":"2024-04-25T12:22:35.030482+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:24.660921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978856+0000","last_change":"2024-04-25T12:21:54.207534+0000","last_active":"2024-04-25T12:22:34.978856+0000","last_peered":"2024-04-25T12:22:34.978856+0000","last_clean":"2024-04-25T12:22:34.978856+0000","last_became_active":"2024-04-25T12:21:54.206786+0000","last_became_peered":"2024-04-25T12:21:54.206786+0000","last_unstale":"2024-04-25T12:22:34.978856+0000","last_undegraded":"2024-04-25T12:22:34.978856+0000","last_fullsized":"2024-04-25T12:22:34.978856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:48.775827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979753+0000","last_change":"2024-04-25T12:21:53.190402+0000","last_active":"2024-04-25T12:22:34.979753+0000","last_peered":"2024-04-25T12:22:34.979753+0000","last_clean":"2024-04-25T12:22:34.979753+0000","last_became_active":"2024-04-25T12:21:53.189936+0000","last_became_peered":"2024-04-25T12:21:53.189936+0000","last_unstale":"2024-04-25T12:22:34.979753+0000","last_undegraded":"2024-04-25T12:22:34.979753+0000","last_fullsized":"2024-04-25T12:22:34.979753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:30.984588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029495+0000","last_change":"2024-04-25T12:21:53.186071+0000","last_active":"2024-04-25T12:22:35.029495+0000","last_peered":"2024-04-25T12:22:35.029495+0000","last_clean":"2024-04-25T12:22:35.029495+0000","last_became_active":"2024-04-25T12:21:53.185357+0000","last_became_peered":"2024-04-25T12:21:53.185357+0000","last_unstale":"2024-04-25T12:22:35.029495+0000","last_undegraded":"2024-04-25T12:22:35.029495+0000","last_fullsized":"2024-04-25T12:22:35.029495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:10.148702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916332+0000","last_change":"2024-04-25T12:21:54.205678+0000","last_active":"2024-04-25T12:22:34.916332+0000","last_peered":"2024-04-25T12:22:34.916332+0000","last_clean":"2024-04-25T12:22:34.916332+0000","last_became_active":"2024-04-25T12:21:54.205219+0000","last_became_peered":"2024-04-25T12:21:54.205219+0000","last_unstale":"2024-04-25T12:22:34.916332+0000","last_undegraded":"2024-04-25T12:22:34.916332+0000","last_fullsized":"2024-04-25T12:22:34.916332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:55.152284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884389+0000","last_change":"2024-04-25T12:21:58.257395+0000","last_active":"2024-04-25T12:22:34.884389+0000","last_peered":"2024-04-25T12:22:34.884389+0000","last_clean":"2024-04-25T12:22:34.884389+0000","last_became_active":"2024-04-25T12:21:58.256219+0000","last_became_peered":"2024-04-25T12:21:58.256219+0000","last_unstale":"2024-04-25T12:22:34.884389+0000","last_undegraded":"2024-04-25T12:22:34.884389+0000","last_fullsized":"2024-04-25T12:22:34.884389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:15.119967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979085+0000","last_change":"2024-04-25T12:21:53.194633+0000","last_active":"2024-04-25T12:22:34.979085+0000","last_peered":"2024-04-25T12:22:34.979085+0000","last_clean":"2024-04-25T12:22:34.979085+0000","last_became_active":"2024-04-25T12:21:53.194306+0000","last_became_peered":"2024-04-25T12:21:53.194306+0000","last_unstale":"2024-04-25T12:22:34.979085+0000","last_undegraded":"2024-04-25T12:22:34.979085+0000","last_fullsized":"2024-04-25T12:22:34.979085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:03.566639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893823+0000","last_change":"2024-04-25T12:21:54.201494+0000","last_active":"2024-04-25T12:22:34.893823+0000","last_peered":"2024-04-25T12:22:34.893823+0000","last_clean":"2024-04-25T12:22:34.893823+0000","last_became_active":"2024-04-25T12:21:54.196085+0000","last_became_peered":"2024-04-25T12:21:54.196085+0000","last_unstale":"2024-04-25T12:22:34.893823+0000","last_undegraded":"2024-04-25T12:22:34.893823+0000","last_fullsized":"2024-04-25T12:22:34.893823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:21.183608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979599+0000","last_change":"2024-04-25T12:21:58.261744+0000","last_active":"2024-04-25T12:22:34.979599+0000","last_peered":"2024-04-25T12:22:34.979599+0000","last_clean":"2024-04-25T12:22:34.979599+0000","last_became_active":"2024-04-25T12:21:58.260821+0000","last_became_peered":"2024-04-25T12:21:58.260821+0000","last_unstale":"2024-04-25T12:22:34.979599+0000","last_undegraded":"2024-04-25T12:22:34.979599+0000","last_fullsized":"2024-04-25T12:22:34.979599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:14.169485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029125+0000","last_change":"2024-04-25T12:21:54.201042+0000","last_active":"2024-04-25T12:22:35.029125+0000","last_peered":"2024-04-25T12:22:35.029125+0000","last_clean":"2024-04-25T12:22:35.029125+0000","last_became_active":"2024-04-25T12:21:54.200446+0000","last_became_peered":"2024-04-25T12:21:54.200446+0000","last_unstale":"2024-04-25T12:22:35.029125+0000","last_undegraded":"2024-04-25T12:22:35.029125+0000","last_fullsized":"2024-04-25T12:22:35.029125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:37.866196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884359+0000","last_change":"2024-04-25T12:21:54.188004+0000","last_active":"2024-04-25T12:22:34.884359+0000","last_peered":"2024-04-25T12:22:34.884359+0000","last_clean":"2024-04-25T12:22:34.884359+0000","last_became_active":"2024-04-25T12:21:54.187254+0000","last_became_peered":"2024-04-25T12:21:54.187254+0000","last_unstale":"2024-04-25T12:22:34.884359+0000","last_undegraded":"2024-04-25T12:22:34.884359+0000","last_fullsized":"2024-04-25T12:22:34.884359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:32.252676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887407+0000","last_change":"2024-04-25T12:21:54.206788+0000","last_active":"2024-04-25T12:22:34.887407+0000","last_peered":"2024-04-25T12:22:34.887407+0000","last_clean":"2024-04-25T12:22:34.887407+0000","last_became_active":"2024-04-25T12:21:54.204904+0000","last_became_peered":"2024-04-25T12:21:54.204904+0000","last_unstale":"2024-04-25T12:22:34.887407+0000","last_undegraded":"2024-04-25T12:22:34.887407+0000","last_fullsized":"2024-04-25T12:22:34.887407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:24.928840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916233+0000","last_change":"2024-04-25T12:21:54.204288+0000","last_active":"2024-04-25T12:22:34.916233+0000","last_peered":"2024-04-25T12:22:34.916233+0000","last_clean":"2024-04-25T12:22:34.916233+0000","last_became_active":"2024-04-25T12:21:54.203922+0000","last_became_peered":"2024-04-25T12:21:54.203922+0000","last_unstale":"2024-04-25T12:22:34.916233+0000","last_undegraded":"2024-04-25T12:22:34.916233+0000","last_fullsized":"2024-04-25T12:22:34.916233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:36.299452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980303+0000","last_change":"2024-04-25T12:21:54.208621+0000","last_active":"2024-04-25T12:22:34.980303+0000","last_peered":"2024-04-25T12:22:34.980303+0000","last_clean":"2024-04-25T12:22:34.980303+0000","last_became_active":"2024-04-25T12:21:54.206993+0000","last_became_peered":"2024-04-25T12:21:54.206993+0000","last_unstale":"2024-04-25T12:22:34.980303+0000","last_undegraded":"2024-04-25T12:22:34.980303+0000","last_fullsized":"2024-04-25T12:22:34.980303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:56:08.605883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292881+0000","last_change":"2024-04-25T12:21:54.202203+0000","last_active":"2024-04-25T12:22:35.292881+0000","last_peered":"2024-04-25T12:22:35.292881+0000","last_clean":"2024-04-25T12:22:35.292881+0000","last_became_active":"2024-04-25T12:21:54.201551+0000","last_became_peered":"2024-04-25T12:21:54.201551+0000","last_unstale":"2024-04-25T12:22:35.292881+0000","last_undegraded":"2024-04-25T12:22:35.292881+0000","last_fullsized":"2024-04-25T12:22:35.292881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:12.846584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030100+0000","last_change":"2024-04-25T12:21:54.220705+0000","last_active":"2024-04-25T12:22:35.030100+0000","last_peered":"2024-04-25T12:22:35.030100+0000","last_clean":"2024-04-25T12:22:35.030100+0000","last_became_active":"2024-04-25T12:21:54.220435+0000","last_became_peered":"2024-04-25T12:21:54.220435+0000","last_unstale":"2024-04-25T12:22:35.030100+0000","last_undegraded":"2024-04-25T12:22:35.030100+0000","last_fullsized":"2024-04-25T12:22:35.030100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:27.885210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980397+0000","last_change":"2024-04-25T12:21:54.206568+0000","last_active":"2024-04-25T12:22:34.980397+0000","last_peered":"2024-04-25T12:22:34.980397+0000","last_clean":"2024-04-25T12:22:34.980397+0000","last_became_active":"2024-04-25T12:21:54.204587+0000","last_became_peered":"2024-04-25T12:21:54.204587+0000","last_unstale":"2024-04-25T12:22:34.980397+0000","last_undegraded":"2024-04-25T12:22:34.980397+0000","last_fullsized":"2024-04-25T12:22:34.980397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:37.419230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.295869+0000","last_change":"2024-04-25T12:22:35.295869+0000","last_active":"2024-04-25T12:22:35.295869+0000","last_peered":"2024-04-25T12:22:35.295869+0000","last_clean":"2024-04-25T12:22:35.295869+0000","last_became_active":"2024-04-25T12:22:35.295116+0000","last_became_peered":"2024-04-25T12:22:35.295116+0000","last_unstale":"2024-04-25T12:22:35.295869+0000","last_undegraded":"2024-04-25T12:22:35.295869+0000","last_fullsized":"2024-04-25T12:22:35.295869+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:08.665587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979578+0000","last_change":"2024-04-25T12:21:54.203886+0000","last_active":"2024-04-25T12:22:34.979578+0000","last_peered":"2024-04-25T12:22:34.979578+0000","last_clean":"2024-04-25T12:22:34.979578+0000","last_became_active":"2024-04-25T12:21:54.203464+0000","last_became_peered":"2024-04-25T12:21:54.203464+0000","last_unstale":"2024-04-25T12:22:34.979578+0000","last_undegraded":"2024-04-25T12:22:34.979578+0000","last_fullsized":"2024-04-25T12:22:34.979578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:41.646353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887358+0000","last_change":"2024-04-25T12:21:54.213114+0000","last_active":"2024-04-25T12:22:34.887358+0000","last_peered":"2024-04-25T12:22:34.887358+0000","last_clean":"2024-04-25T12:22:34.887358+0000","last_became_active":"2024-04-25T12:21:54.212559+0000","last_became_peered":"2024-04-25T12:21:54.212559+0000","last_unstale":"2024-04-25T12:22:34.887358+0000","last_undegraded":"2024-04-25T12:22:34.887358+0000","last_fullsized":"2024-04-25T12:22:34.887358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:13.824789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915648+0000","last_change":"2024-04-25T12:21:54.215749+0000","last_active":"2024-04-25T12:22:34.915648+0000","last_peered":"2024-04-25T12:22:34.915648+0000","last_clean":"2024-04-25T12:22:34.915648+0000","last_became_active":"2024-04-25T12:21:54.215446+0000","last_became_peered":"2024-04-25T12:21:54.215446+0000","last_unstale":"2024-04-25T12:22:34.915648+0000","last_undegraded":"2024-04-25T12:22:34.915648+0000","last_fullsized":"2024-04-25T12:22:34.915648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:31.642141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029876+0000","last_change":"2024-04-25T12:21:54.210099+0000","last_active":"2024-04-25T12:22:35.029876+0000","last_peered":"2024-04-25T12:22:35.029876+0000","last_clean":"2024-04-25T12:22:35.029876+0000","last_became_active":"2024-04-25T12:21:54.209393+0000","last_became_peered":"2024-04-25T12:21:54.209393+0000","last_unstale":"2024-04-25T12:22:35.029876+0000","last_undegraded":"2024-04-25T12:22:35.029876+0000","last_fullsized":"2024-04-25T12:22:35.029876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:32.318047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891441+0000","last_change":"2024-04-25T12:21:54.216255+0000","last_active":"2024-04-25T12:22:34.891441+0000","last_peered":"2024-04-25T12:22:34.891441+0000","last_clean":"2024-04-25T12:22:34.891441+0000","last_became_active":"2024-04-25T12:21:54.211787+0000","last_became_peered":"2024-04-25T12:21:54.211787+0000","last_unstale":"2024-04-25T12:22:34.891441+0000","last_undegraded":"2024-04-25T12:22:34.891441+0000","last_fullsized":"2024-04-25T12:22:34.891441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:32.351790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.886612+0000","last_change":"2024-04-25T12:21:54.200503+0000","last_active":"2024-04-25T12:22:34.886612+0000","last_peered":"2024-04-25T12:22:34.886612+0000","last_clean":"2024-04-25T12:22:34.886612+0000","last_became_active":"2024-04-25T12:21:54.200123+0000","last_became_peered":"2024-04-25T12:21:54.200123+0000","last_unstale":"2024-04-25T12:22:34.886612+0000","last_undegraded":"2024-04-25T12:22:34.886612+0000","last_fullsized":"2024-04-25T12:22:34.886612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:04.504889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.889718+0000","last_change":"2024-04-25T12:21:54.220717+0000","last_active":"2024-04-25T12:22:34.889718+0000","last_peered":"2024-04-25T12:22:34.889718+0000","last_clean":"2024-04-25T12:22:34.889718+0000","last_became_active":"2024-04-25T12:21:54.220272+0000","last_became_peered":"2024-04-25T12:21:54.220272+0000","last_unstale":"2024-04-25T12:22:34.889718+0000","last_undegraded":"2024-04-25T12:22:34.889718+0000","last_fullsized":"2024-04-25T12:22:34.889718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:51.165297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.886279+0000","last_change":"2024-04-25T12:21:54.190288+0000","last_active":"2024-04-25T12:22:34.886279+0000","last_peered":"2024-04-25T12:22:34.886279+0000","last_clean":"2024-04-25T12:22:34.886279+0000","last_became_active":"2024-04-25T12:21:54.189535+0000","last_became_peered":"2024-04-25T12:21:54.189535+0000","last_unstale":"2024-04-25T12:22:34.886279+0000","last_undegraded":"2024-04-25T12:22:34.886279+0000","last_fullsized":"2024-04-25T12:22:34.886279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:03.757883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292136+0000","last_change":"2024-04-25T12:21:54.202898+0000","last_active":"2024-04-25T12:22:35.292136+0000","last_peered":"2024-04-25T12:22:35.292136+0000","last_clean":"2024-04-25T12:22:35.292136+0000","last_became_active":"2024-04-25T12:21:54.201641+0000","last_became_peered":"2024-04-25T12:21:54.201641+0000","last_unstale":"2024-04-25T12:22:35.292136+0000","last_undegraded":"2024-04-25T12:22:35.292136+0000","last_fullsized":"2024-04-25T12:22:35.292136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:42.865496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916388+0000","last_change":"2024-04-25T12:21:54.192818+0000","last_active":"2024-04-25T12:22:34.916388+0000","last_peered":"2024-04-25T12:22:34.916388+0000","last_clean":"2024-04-25T12:22:34.916388+0000","last_became_active":"2024-04-25T12:21:54.192052+0000","last_became_peered":"2024-04-25T12:21:54.192052+0000","last_unstale":"2024-04-25T12:22:34.916388+0000","last_undegraded":"2024-04-25T12:22:34.916388+0000","last_fullsized":"2024-04-25T12:22:34.916388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:26.048483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978815+0000","last_change":"2024-04-25T12:21:54.203798+0000","last_active":"2024-04-25T12:22:34.978815+0000","last_peered":"2024-04-25T12:22:34.978815+0000","last_clean":"2024-04-25T12:22:34.978815+0000","last_became_active":"2024-04-25T12:21:54.203472+0000","last_became_peered":"2024-04-25T12:21:54.203472+0000","last_unstale":"2024-04-25T12:22:34.978815+0000","last_undegraded":"2024-04-25T12:22:34.978815+0000","last_fullsized":"2024-04-25T12:22:34.978815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:19.958172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894317+0000","last_change":"2024-04-25T12:21:54.206055+0000","last_active":"2024-04-25T12:22:34.894317+0000","last_peered":"2024-04-25T12:22:34.894317+0000","last_clean":"2024-04-25T12:22:34.894317+0000","last_became_active":"2024-04-25T12:21:54.203030+0000","last_became_peered":"2024-04-25T12:21:54.203030+0000","last_unstale":"2024-04-25T12:22:34.894317+0000","last_undegraded":"2024-04-25T12:22:34.894317+0000","last_fullsized":"2024-04-25T12:22:34.894317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:58.836301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030468+0000","last_change":"2024-04-25T12:21:54.199660+0000","last_active":"2024-04-25T12:22:35.030468+0000","last_peered":"2024-04-25T12:22:35.030468+0000","last_clean":"2024-04-25T12:22:35.030468+0000","last_became_active":"2024-04-25T12:21:54.199362+0000","last_became_peered":"2024-04-25T12:21:54.199362+0000","last_unstale":"2024-04-25T12:22:35.030468+0000","last_undegraded":"2024-04-25T12:22:35.030468+0000","last_fullsized":"2024-04-25T12:22:35.030468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:57.706566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029976+0000","last_change":"2024-04-25T12:21:54.198710+0000","last_active":"2024-04-25T12:22:35.029976+0000","last_peered":"2024-04-25T12:22:35.029976+0000","last_clean":"2024-04-25T12:22:35.029976+0000","last_became_active":"2024-04-25T12:21:54.198432+0000","last_became_peered":"2024-04-25T12:21:54.198432+0000","last_unstale":"2024-04-25T12:22:35.029976+0000","last_undegraded":"2024-04-25T12:22:35.029976+0000","last_fullsized":"2024-04-25T12:22:35.029976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:33.124005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.892012+0000","last_change":"2024-04-25T12:21:54.218474+0000","last_active":"2024-04-25T12:22:34.892012+0000","last_peered":"2024-04-25T12:22:34.892012+0000","last_clean":"2024-04-25T12:22:34.892012+0000","last_became_active":"2024-04-25T12:21:54.216949+0000","last_became_peered":"2024-04-25T12:21:54.216949+0000","last_unstale":"2024-04-25T12:22:34.892012+0000","last_undegraded":"2024-04-25T12:22:34.892012+0000","last_fullsized":"2024-04-25T12:22:34.892012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:56.162843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978272+0000","last_change":"2024-04-25T12:21:54.200590+0000","last_active":"2024-04-25T12:22:34.978272+0000","last_peered":"2024-04-25T12:22:34.978272+0000","last_clean":"2024-04-25T12:22:34.978272+0000","last_became_active":"2024-04-25T12:21:54.200248+0000","last_became_peered":"2024-04-25T12:21:54.200248+0000","last_unstale":"2024-04-25T12:22:34.978272+0000","last_undegraded":"2024-04-25T12:22:34.978272+0000","last_fullsized":"2024-04-25T12:22:34.978272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:12.875315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.889915+0000","last_change":"2024-04-25T12:21:54.197805+0000","last_active":"2024-04-25T12:22:34.889915+0000","last_peered":"2024-04-25T12:22:34.889915+0000","last_clean":"2024-04-25T12:22:34.889915+0000","last_became_active":"2024-04-25T12:21:54.197028+0000","last_became_peered":"2024-04-25T12:21:54.197028+0000","last_unstale":"2024-04-25T12:22:34.889915+0000","last_undegraded":"2024-04-25T12:22:34.889915+0000","last_fullsized":"2024-04-25T12:22:34.889915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:03.069305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.886967+0000","last_change":"2024-04-25T12:21:54.190517+0000","last_active":"2024-04-25T12:22:34.886967+0000","last_peered":"2024-04-25T12:22:34.886967+0000","last_clean":"2024-04-25T12:22:34.886967+0000","last_became_active":"2024-04-25T12:21:54.189711+0000","last_became_peered":"2024-04-25T12:21:54.189711+0000","last_unstale":"2024-04-25T12:22:34.886967+0000","last_undegraded":"2024-04-25T12:22:34.886967+0000","last_fullsized":"2024-04-25T12:22:34.886967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:17.879060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890186+0000","last_change":"2024-04-25T12:21:54.197205+0000","last_active":"2024-04-25T12:22:34.890186+0000","last_peered":"2024-04-25T12:22:34.890186+0000","last_clean":"2024-04-25T12:22:34.890186+0000","last_became_active":"2024-04-25T12:21:54.196933+0000","last_became_peered":"2024-04-25T12:21:54.196933+0000","last_unstale":"2024-04-25T12:22:34.890186+0000","last_undegraded":"2024-04-25T12:22:34.890186+0000","last_fullsized":"2024-04-25T12:22:34.890186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:32.003058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887450+0000","last_change":"2024-04-25T12:21:54.207709+0000","last_active":"2024-04-25T12:22:34.887450+0000","last_peered":"2024-04-25T12:22:34.887450+0000","last_clean":"2024-04-25T12:22:34.887450+0000","last_became_active":"2024-04-25T12:21:54.207027+0000","last_became_peered":"2024-04-25T12:21:54.207027+0000","last_unstale":"2024-04-25T12:22:34.887450+0000","last_undegraded":"2024-04-25T12:22:34.887450+0000","last_fullsized":"2024-04-25T12:22:34.887450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:15.116440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915838+0000","last_change":"2024-04-25T12:21:54.185338+0000","last_active":"2024-04-25T12:22:34.915838+0000","last_peered":"2024-04-25T12:22:34.915838+0000","last_clean":"2024-04-25T12:22:34.915838+0000","last_became_active":"2024-04-25T12:21:54.184502+0000","last_became_peered":"2024-04-25T12:21:54.184502+0000","last_unstale":"2024-04-25T12:22:34.915838+0000","last_undegraded":"2024-04-25T12:22:34.915838+0000","last_fullsized":"2024-04-25T12:22:34.915838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:29.865959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292679+0000","last_change":"2024-04-25T12:21:54.183773+0000","last_active":"2024-04-25T12:22:35.292679+0000","last_peered":"2024-04-25T12:22:35.292679+0000","last_clean":"2024-04-25T12:22:35.292679+0000","last_became_active":"2024-04-25T12:21:54.182924+0000","last_became_peered":"2024-04-25T12:21:54.182924+0000","last_unstale":"2024-04-25T12:22:35.292679+0000","last_undegraded":"2024-04-25T12:22:35.292679+0000","last_fullsized":"2024-04-25T12:22:35.292679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:22.046777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891694+0000","last_change":"2024-04-25T12:21:54.210631+0000","last_active":"2024-04-25T12:22:34.891694+0000","last_peered":"2024-04-25T12:22:34.891694+0000","last_clean":"2024-04-25T12:22:34.891694+0000","last_became_active":"2024-04-25T12:21:54.210333+0000","last_became_peered":"2024-04-25T12:21:54.210333+0000","last_unstale":"2024-04-25T12:22:34.891694+0000","last_undegraded":"2024-04-25T12:22:34.891694+0000","last_fullsized":"2024-04-25T12:22:34.891694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:39.783406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476770,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":888832,"data_stored":710770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476771,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":123662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476770,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":119910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476769,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":119946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542178,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":303104,"data_stored":123662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542179,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":290816,"data_stored":119820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":119980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542178,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":897024,"data_stored":710826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:24:23.492 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T12:24:23.492 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T12:24:23.492 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T12:24:23.492 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T12:24:23.493 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T12:24:23.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.635+0000 7f61b5c8b640 1 Processor -- start 2024-04-25T12:24:23.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.635+0000 7f61b5c8b640 1 -- start start 2024-04-25T12:24:23.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.639+0000 7f61b5c8b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f61b014fbc0 0x7f61b006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:23.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.639+0000 7f61b5c8b640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f61b0074100 0x7f61b00c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:23.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.639+0000 7f61b5c8b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61b00c5d70 con 0x7f61b014ffa0 2024-04-25T12:24:23.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.639+0000 7f61b5c8b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f61b00c6050 con 0x7f61b014fbc0 2024-04-25T12:24:23.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.639+0000 7f61b5c8b640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f61b00c6330 con 0x7f61b0074100 2024-04-25T12:24:23.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.639+0000 7f61af7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f61b014fbc0 0x7f61b006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:23.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.639+0000 7f61aeffd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f61b014ffa0 0x7f61b00c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39242/0 (socket says 172.21.15.94:39242) 2024-04-25T12:24:23.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.639+0000 7f61aeffd640 1 -- 172.21.15.94:0/883138303 learned_addr learned my addr 172.21.15.94:0/883138303 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:23.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.639+0000 7f61affff640 1 --2- 172.21.15.94:0/883138303 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f61b0074100 0x7f61b00c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:23.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.639+0000 7f61af7fe640 1 -- 172.21.15.94:0/883138303 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f61b0074100 msgr2=0x7f61b00c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:23.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.639+0000 7f61af7fe640 1 --2- 172.21.15.94:0/883138303 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f61b0074100 0x7f61b00c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.639+0000 7f61ae7fc640 1 -- 172.21.15.94:0/883138303 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3815330542 0 0) 0x7f61b00c5d70 con 0x7f61b014ffa0 2024-04-25T12:24:23.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.639+0000 7f61af7fe640 1 -- 172.21.15.94:0/883138303 >> v1:172.21.15.94:6789/0 conn(0x7f61b014ffa0 legacy=0x7f61b00c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:23.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.639+0000 7f61af7fe640 1 -- 172.21.15.94:0/883138303 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b00c6610 con 0x7f61b014fbc0 2024-04-25T12:24:23.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.639+0000 7f61affff640 1 --2- 172.21.15.94:0/883138303 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f61b0074100 0x7f61b00c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:23.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.639+0000 7f61af7fe640 1 --2- 172.21.15.94:0/883138303 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f61b014fbc0 0x7f61b006f700 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f61a00097c0 tx=0x7f61a001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c2cffd9ac08867 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:23.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.639+0000 7f61ae7fc640 1 -- 172.21.15.94:0/883138303 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a00aa620 con 0x7f61b014fbc0 2024-04-25T12:24:23.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.639+0000 7f61ae7fc640 1 -- 172.21.15.94:0/883138303 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a00af070 con 0x7f61b014fbc0 2024-04-25T12:24:23.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.639+0000 7f61ae7fc640 1 -- 172.21.15.94:0/883138303 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a00aa9e0 con 0x7f61b014fbc0 2024-04-25T12:24:23.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.639+0000 7f61b5c8b640 1 -- 172.21.15.94:0/883138303 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f61b014fbc0 msgr2=0x7f61b006f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:23.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.639+0000 7f61b5c8b640 1 --2- 172.21.15.94:0/883138303 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f61b014fbc0 0x7f61b006f700 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f61a00097c0 tx=0x7f61a001c4a0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61b5c8b640 1 -- 172.21.15.94:0/883138303 shutdown_connections 2024-04-25T12:24:23.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61b5c8b640 1 --2- 172.21.15.94:0/883138303 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f61b0074100 0x7f61b00c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61b5c8b640 1 --2- 172.21.15.94:0/883138303 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f61b014fbc0 0x7f61b006f700 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61b5c8b640 1 -- 172.21.15.94:0/883138303 >> 172.21.15.94:0/883138303 conn(0x7f61b006b9d0 msgr2=0x7f61b006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:23.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61b5c8b640 1 -- 172.21.15.94:0/883138303 shutdown_connections 2024-04-25T12:24:23.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61b5c8b640 1 -- 172.21.15.94:0/883138303 wait complete. 2024-04-25T12:24:23.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61b5c8b640 1 Processor -- start 2024-04-25T12:24:23.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61b5c8b640 1 -- start start 2024-04-25T12:24:23.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61b5c8b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f61b0074100 0x7f61b0150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:23.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61b5c8b640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f61b014fbc0 0x7f61b014a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:23.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61b5c8b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f61b014ffa0 0x7f61b00ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:23.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61b5c8b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f61b00c8ab0 con 0x7f61b014ffa0 2024-04-25T12:24:23.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61b5c8b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f61b00c8930 con 0x7f61b0074100 2024-04-25T12:24:23.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61b5c8b640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f61b0166090 con 0x7f61b014fbc0 2024-04-25T12:24:23.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61affff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f61b014ffa0 0x7f61b00ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:23.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61affff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f61b014ffa0 0x7f61b00ca800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51766/0 (socket says 172.21.15.94:51766) 2024-04-25T12:24:23.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61affff640 1 -- 172.21.15.94:0/436075050 learned_addr learned my addr 172.21.15.94:0/436075050 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:23.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61af7fe640 1 --2- 172.21.15.94:0/436075050 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f61b0074100 0x7f61b0150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:23.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61aeffd640 1 --2- 172.21.15.94:0/436075050 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f61b014fbc0 0x7f61b014a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:23.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61affff640 1 -- 172.21.15.94:0/436075050 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f61b014fbc0 msgr2=0x7f61b014a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:23.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61affff640 1 --2- 172.21.15.94:0/436075050 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f61b014fbc0 0x7f61b014a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61affff640 1 -- 172.21.15.94:0/436075050 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f61b0074100 msgr2=0x7f61b0150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:23.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61affff640 1 --2- 172.21.15.94:0/436075050 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f61b0074100 0x7f61b0150ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61affff640 1 -- 172.21.15.94:0/436075050 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b0152150 con 0x7f61b014ffa0 2024-04-25T12:24:23.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61affff640 1 --2- 172.21.15.94:0/436075050 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f61b014ffa0 0x7f61b00ca800 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f61a800ce70 tx=0x7f61a800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:23.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f6197fff640 1 -- 172.21.15.94:0/436075050 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a8003ba0 con 0x7f61b014ffa0 2024-04-25T12:24:23.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f6197fff640 1 -- 172.21.15.94:0/436075050 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a8003d60 con 0x7f61b014ffa0 2024-04-25T12:24:23.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f6197fff640 1 -- 172.21.15.94:0/436075050 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a800d880 con 0x7f61b014ffa0 2024-04-25T12:24:23.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61b5c8b640 1 -- 172.21.15.94:0/436075050 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b0152430 con 0x7f61b014ffa0 2024-04-25T12:24:23.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.643+0000 7f61b5c8b640 1 -- 172.21.15.94:0/436075050 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b01529f0 con 0x7f61b014ffa0 2024-04-25T12:24:23.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.647+0000 7f61b5c8b640 1 -- 172.21.15.94:0/436075050 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61b00ca500 con 0x7f61b014ffa0 2024-04-25T12:24:23.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.647+0000 7f6197fff640 1 -- 172.21.15.94:0/436075050 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f61a800da20 con 0x7f61b014ffa0 2024-04-25T12:24:23.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.647+0000 7f6197fff640 1 --2- 172.21.15.94:0/436075050 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f619c068380 0x7f619c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:23.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.647+0000 7f61af7fe640 1 --2- 172.21.15.94:0/436075050 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f619c068380 0x7f619c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:23.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.647+0000 7f6197fff640 1 -- 172.21.15.94:0/436075050 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f61a80877a0 con 0x7f61b014ffa0 2024-04-25T12:24:23.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.647+0000 7f61af7fe640 1 --2- 172.21.15.94:0/436075050 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f619c068380 0x7f619c06a840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f61a00ae000 tx=0x7f61a00a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:23.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.651+0000 7f6197fff640 1 -- 172.21.15.94:0/436075050 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f61b00ca500 con 0x7f61b014ffa0 2024-04-25T12:24:23.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.843+0000 7f61b5c8b640 1 -- 172.21.15.94:0/436075050 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f61b0075df0 con 0x7f61b014ffa0 2024-04-25T12:24:23.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.851+0000 7f6197fff640 1 -- 172.21.15.94:0/436075050 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+168082 (secure 0 0 0) 0x7f61a80578e0 con 0x7f61b014ffa0 2024-04-25T12:24:23.858 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:23.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.855+0000 7f61b5c8b640 1 -- 172.21.15.94:0/436075050 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f619c068380 msgr2=0x7f619c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:23.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.855+0000 7f61b5c8b640 1 --2- 172.21.15.94:0/436075050 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f619c068380 0x7f619c06a840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f61a00ae000 tx=0x7f61a00a7000 comp rx=0 tx=0).stop 2024-04-25T12:24:23.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.855+0000 7f61b5c8b640 1 -- 172.21.15.94:0/436075050 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f61b014ffa0 msgr2=0x7f61b00ca800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:23.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.855+0000 7f61b5c8b640 1 --2- 172.21.15.94:0/436075050 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f61b014ffa0 0x7f61b00ca800 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f61a800ce70 tx=0x7f61a800a710 comp rx=0 tx=0).stop 2024-04-25T12:24:23.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.855+0000 7f61b5c8b640 1 -- 172.21.15.94:0/436075050 shutdown_connections 2024-04-25T12:24:23.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.855+0000 7f61b5c8b640 1 --2- 172.21.15.94:0/436075050 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f619c068380 0x7f619c06a840 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.855+0000 7f61b5c8b640 1 --2- 172.21.15.94:0/436075050 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f61b014fbc0 0x7f61b014a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.855+0000 7f61b5c8b640 1 --2- 172.21.15.94:0/436075050 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f61b014ffa0 0x7f61b00ca800 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.855+0000 7f61b5c8b640 1 --2- 172.21.15.94:0/436075050 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f61b0074100 0x7f61b0150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.855+0000 7f61b5c8b640 1 -- 172.21.15.94:0/436075050 >> 172.21.15.94:0/436075050 conn(0x7f61b006b9d0 msgr2=0x7f61b006e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:23.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.855+0000 7f61b5c8b640 1 -- 172.21.15.94:0/436075050 shutdown_connections 2024-04-25T12:24:23.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.855+0000 7f61b5c8b640 1 -- 172.21.15.94:0/436075050 wait complete. 2024-04-25T12:24:23.873 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":549402167},{"type":"v1","addr":"172.21.15.94:6833","nonce":549402167}]},"active_addr":"172.21.15.94:6833/549402167","active_change":"2024-04-25T12:21:33.727023+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4104,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.94:0","nonce":2118560211}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.94:0","nonce":1302964638}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.94:0","nonce":3515430042}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.94:0","nonce":2332806116}]}]} 2024-04-25T12:24:23.878 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T12:24:23.878 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T12:24:23.879 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:24:23.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.987+0000 7f01998a7640 1 Processor -- start 2024-04-25T12:24:23.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.991+0000 7f01998a7640 1 -- start start 2024-04-25T12:24:23.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.991+0000 7f01998a7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f019414ffa0 0x7f019406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:23.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.991+0000 7f01998a7640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f0194074100 0x7f01940c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:23.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.991+0000 7f01998a7640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01940c5d70 con 0x7f019414fbc0 2024-04-25T12:24:23.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.991+0000 7f01998a7640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f01940c6050 con 0x7f019414ffa0 2024-04-25T12:24:23.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.991+0000 7f01998a7640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f01940c6330 con 0x7f0194074100 2024-04-25T12:24:23.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.991+0000 7f018a7fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f019414ffa0 0x7f019406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:23.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.991+0000 7f018a7fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f019414ffa0 0x7f019406f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51768/0 (socket says 172.21.15.94:51768) 2024-04-25T12:24:23.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.991+0000 7f018a7fc640 1 -- 172.21.15.94:0/3078001720 learned_addr learned my addr 172.21.15.94:0/3078001720 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:23.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.991+0000 7f01937fe640 1 --2- 172.21.15.94:0/3078001720 >> v2:172.21.15.111:3300/0 conn(0x7f0194074100 0x7f01940c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:23.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.991+0000 7f018a7fc640 1 -- 172.21.15.94:0/3078001720 >> v2:172.21.15.111:3300/0 conn(0x7f0194074100 msgr2=0x7f01940c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:23.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.991+0000 7f018a7fc640 1 --2- 172.21.15.94:0/3078001720 >> v2:172.21.15.111:3300/0 conn(0x7f0194074100 0x7f01940c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.991+0000 7f018a7fc640 1 -- 172.21.15.94:0/3078001720 >> v1:172.21.15.111:6789/0 conn(0x7f019414fbc0 legacy=0x7f01940c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:23.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.991+0000 7f018a7fc640 1 -- 172.21.15.94:0/3078001720 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01940c6610 con 0x7f019414ffa0 2024-04-25T12:24:23.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.991+0000 7f018a7fc640 1 --2- 172.21.15.94:0/3078001720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f019414ffa0 0x7f019406f700 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f017c009870 tx=0x7f017c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc523d23252781b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:23.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.991+0000 7f01927fc640 1 -- 172.21.15.94:0/3078001720 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c0aa660 con 0x7f019414ffa0 2024-04-25T12:24:23.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.991+0000 7f01927fc640 1 -- 172.21.15.94:0/3078001720 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f017c0af070 con 0x7f019414ffa0 2024-04-25T12:24:23.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.991+0000 7f01927fc640 1 -- 172.21.15.94:0/3078001720 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c0aaa20 con 0x7f019414ffa0 2024-04-25T12:24:23.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f01998a7640 1 -- 172.21.15.94:0/3078001720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f019414ffa0 msgr2=0x7f019406f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:23.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f01998a7640 1 --2- 172.21.15.94:0/3078001720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f019414ffa0 0x7f019406f700 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f017c009870 tx=0x7f017c01c4e0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f01998a7640 1 -- 172.21.15.94:0/3078001720 shutdown_connections 2024-04-25T12:24:23.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f01998a7640 1 --2- 172.21.15.94:0/3078001720 >> v2:172.21.15.111:3300/0 conn(0x7f0194074100 0x7f01940c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f01998a7640 1 --2- 172.21.15.94:0/3078001720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f019414ffa0 0x7f019406f700 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:23.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f01998a7640 1 -- 172.21.15.94:0/3078001720 >> 172.21.15.94:0/3078001720 conn(0x7f019406b9d0 msgr2=0x7f019406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:23.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f01998a7640 1 -- 172.21.15.94:0/3078001720 shutdown_connections 2024-04-25T12:24:23.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f01998a7640 1 -- 172.21.15.94:0/3078001720 wait complete. 2024-04-25T12:24:24.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f01998a7640 1 Processor -- start 2024-04-25T12:24:24.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f01998a7640 1 -- start start 2024-04-25T12:24:24.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f01998a7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0194074100 0x7f01941450a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f01998a7640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f019414fbc0 0x7f01941472e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f01998a7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f019414ffa0 0x7f0194147820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f01998a7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f01940c8ab0 con 0x7f0194074100 2024-04-25T12:24:24.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f01998a7640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f01940c8930 con 0x7f019414ffa0 2024-04-25T12:24:24.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f01998a7640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f0194166090 con 0x7f019414fbc0 2024-04-25T12:24:24.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f0192ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0194074100 0x7f01941450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f0192ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0194074100 0x7f01941450a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51782/0 (socket says 172.21.15.94:51782) 2024-04-25T12:24:24.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f0192ffd640 1 -- 172.21.15.94:0/2866987655 learned_addr learned my addr 172.21.15.94:0/2866987655 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:24.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f018a7fc640 1 --2- 172.21.15.94:0/2866987655 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f019414fbc0 0x7f01941472e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f01937fe640 1 --2- 172.21.15.94:0/2866987655 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f019414ffa0 0x7f0194147820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f0192ffd640 1 -- 172.21.15.94:0/2866987655 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f019414fbc0 msgr2=0x7f01941472e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f0192ffd640 1 --2- 172.21.15.94:0/2866987655 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f019414fbc0 0x7f01941472e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f0192ffd640 1 -- 172.21.15.94:0/2866987655 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f019414ffa0 msgr2=0x7f0194147820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f0192ffd640 1 --2- 172.21.15.94:0/2866987655 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f019414ffa0 0x7f0194147820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f0192ffd640 1 -- 172.21.15.94:0/2866987655 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f019415a930 con 0x7f0194074100 2024-04-25T12:24:24.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f0192ffd640 1 --2- 172.21.15.94:0/2866987655 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0194074100 0x7f01941450a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f018400c480 tx=0x7f018400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f0190ff9640 1 -- 172.21.15.94:0/2866987655 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0184012830 con 0x7f0194074100 2024-04-25T12:24:24.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f0190ff9640 1 -- 172.21.15.94:0/2866987655 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0184017070 con 0x7f0194074100 2024-04-25T12:24:24.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f01998a7640 1 -- 172.21.15.94:0/2866987655 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0194146be0 con 0x7f0194074100 2024-04-25T12:24:24.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f0190ff9640 1 -- 172.21.15.94:0/2866987655 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0184012c30 con 0x7f0194074100 2024-04-25T12:24:24.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.995+0000 7f01998a7640 1 -- 172.21.15.94:0/2866987655 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f019415bc00 con 0x7f0194074100 2024-04-25T12:24:24.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.999+0000 7f01998a7640 1 -- 172.21.15.94:0/2866987655 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0194075df0 con 0x7f0194074100 2024-04-25T12:24:24.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.999+0000 7f0190ff9640 1 -- 172.21.15.94:0/2866987655 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f018401c460 con 0x7f0194074100 2024-04-25T12:24:24.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.999+0000 7f0190ff9640 1 --2- 172.21.15.94:0/2866987655 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0174068380 0x7f017406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.999+0000 7f0190ff9640 1 -- 172.21.15.94:0/2866987655 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f0184086af0 con 0x7f0194074100 2024-04-25T12:24:24.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.999+0000 7f018a7fc640 1 --2- 172.21.15.94:0/2866987655 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0174068380 0x7f017406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:23.999+0000 7f018a7fc640 1 --2- 172.21.15.94:0/2866987655 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0174068380 0x7f017406a840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f017c0ae000 tx=0x7f017c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.003+0000 7f0190ff9640 1 -- 172.21.15.94:0/2866987655 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0184056d50 con 0x7f0194074100 2024-04-25T12:24:24.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.163+0000 7f01998a7640 1 -- 172.21.15.94:0/2866987655 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01940c7df0 con 0x7f0194074100 2024-04-25T12:24:24.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.167+0000 7f0190ff9640 1 -- 172.21.15.94:0/2866987655 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18873 (secure 0 0 0) 0x7f0184056650 con 0x7f0194074100 2024-04-25T12:24:24.170 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:24.171 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"7059a9e2-aec4-4b84-b942-caf531e15da3","created":"2024-04-25T12:21:29.118508+0000","modified":"2024-04-25T12:22:34.871807+0000","last_up_change":"2024-04-25T12:21:40.912605+0000","last_in_change":"2024-04-25T12:21:31.372905+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:39.781011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:51.465886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:52.470540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:56.209936+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"640a65ef-0734-468a-a8f5-9ed70cf75c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6809","nonce":2553247564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6811","nonce":2553247564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6815","nonce":2553247564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6813","nonce":2553247564}]},"public_addr":"172.21.15.94:6809/2553247564","cluster_addr":"172.21.15.94:6811/2553247564","heartbeat_back_addr":"172.21.15.94:6815/2553247564","heartbeat_front_addr":"172.21.15.94:6813/2553247564","state":["exists","up"]},{"osd":1,"uuid":"d6e886e6-c8c1-4761-9a4c-abc6961c7c81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6818","nonce":2492806478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6822","nonce":2492806478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6830","nonce":2492806478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6826","nonce":2492806478}]},"public_addr":"172.21.15.94:6818/2492806478","cluster_addr":"172.21.15.94:6822/2492806478","heartbeat_back_addr":"172.21.15.94:6830/2492806478","heartbeat_front_addr":"172.21.15.94:6826/2492806478","state":["exists","up"]},{"osd":2,"uuid":"ba20f409-ed46-43b6-b16d-43dc4622c042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6801","nonce":1485061290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6803","nonce":1485061290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6807","nonce":1485061290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6805","nonce":1485061290}]},"public_addr":"172.21.15.94:6801/1485061290","cluster_addr":"172.21.15.94:6803/1485061290","heartbeat_back_addr":"172.21.15.94:6807/1485061290","heartbeat_front_addr":"172.21.15.94:6805/1485061290","state":["exists","up"]},{"osd":3,"uuid":"85816a2b-3a3f-4ec8-8373-8230d948396f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6819","nonce":1548488434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6823","nonce":1548488434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6829","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6831","nonce":1548488434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6827","nonce":1548488434}]},"public_addr":"172.21.15.94:6819/1548488434","cluster_addr":"172.21.15.94:6823/1548488434","heartbeat_back_addr":"172.21.15.94:6831/1548488434","heartbeat_front_addr":"172.21.15.94:6827/1548488434","state":["exists","up"]},{"osd":4,"uuid":"b4a953b7-01d6-4623-9324-63135fdaf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6811","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6814","nonce":4070977083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6817","nonce":4070977083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6823","nonce":4070977083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6819","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6821","nonce":4070977083}]},"public_addr":"172.21.15.111:6814/4070977083","cluster_addr":"172.21.15.111:6817/4070977083","heartbeat_back_addr":"172.21.15.111:6823/4070977083","heartbeat_front_addr":"172.21.15.111:6821/4070977083","state":["exists","up"]},{"osd":5,"uuid":"c0acc514-427d-41bf-a965-b8463cebf045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6803","nonce":1054925605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6809","nonce":1054925605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6820","nonce":1054925605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6815","nonce":1054925605}]},"public_addr":"172.21.15.111:6803/1054925605","cluster_addr":"172.21.15.111:6809/1054925605","heartbeat_back_addr":"172.21.15.111:6820/1054925605","heartbeat_front_addr":"172.21.15.111:6815/1054925605","state":["exists","up"]},{"osd":6,"uuid":"26ff742f-5a57-44a7-a095-f04d6e87f885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6825","nonce":3619235078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6827","nonce":3619235078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6831","nonce":3619235078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6829","nonce":3619235078}]},"public_addr":"172.21.15.111:6825/3619235078","cluster_addr":"172.21.15.111:6827/3619235078","heartbeat_back_addr":"172.21.15.111:6831/3619235078","heartbeat_front_addr":"172.21.15.111:6829/3619235078","state":["exists","up"]},{"osd":7,"uuid":"9c214cba-693a-4b25-aad7-05a5b0006e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6801","nonce":558758517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6805","nonce":558758517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6813","nonce":558758517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6807","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6808","nonce":558758517}]},"public_addr":"172.21.15.111:6801/558758517","cluster_addr":"172.21.15.111:6805/558758517","heartbeat_back_addr":"172.21.15.111:6813/558758517","heartbeat_front_addr":"172.21.15.111:6808/558758517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.664958+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.853375+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.654455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:37.033852+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.968691+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.856013+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.913496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.848565+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:24:24.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.167+0000 7f01998a7640 1 -- 172.21.15.94:0/2866987655 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0174068380 msgr2=0x7f017406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.167+0000 7f01998a7640 1 --2- 172.21.15.94:0/2866987655 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0174068380 0x7f017406a840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f017c0ae000 tx=0x7f017c0a7000 comp rx=0 tx=0).stop 2024-04-25T12:24:24.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.167+0000 7f01998a7640 1 -- 172.21.15.94:0/2866987655 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0194074100 msgr2=0x7f01941450a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.167+0000 7f01998a7640 1 --2- 172.21.15.94:0/2866987655 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0194074100 0x7f01941450a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f018400c480 tx=0x7f018400c940 comp rx=0 tx=0).stop 2024-04-25T12:24:24.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.167+0000 7f01998a7640 1 -- 172.21.15.94:0/2866987655 shutdown_connections 2024-04-25T12:24:24.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.167+0000 7f01998a7640 1 --2- 172.21.15.94:0/2866987655 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0174068380 0x7f017406a840 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.167+0000 7f01998a7640 1 --2- 172.21.15.94:0/2866987655 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f019414fbc0 0x7f01941472e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.167+0000 7f01998a7640 1 --2- 172.21.15.94:0/2866987655 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f019414ffa0 0x7f0194147820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.167+0000 7f01998a7640 1 --2- 172.21.15.94:0/2866987655 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0194074100 0x7f01941450a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.167+0000 7f01998a7640 1 -- 172.21.15.94:0/2866987655 >> 172.21.15.94:0/2866987655 conn(0x7f019406b9d0 msgr2=0x7f019414caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:24.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.167+0000 7f01998a7640 1 -- 172.21.15.94:0/2866987655 shutdown_connections 2024-04-25T12:24:24.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.167+0000 7f01998a7640 1 -- 172.21.15.94:0/2866987655 wait complete. 2024-04-25T12:24:24.188 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T12:24:24.189 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:24:24.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.299+0000 7f56c3b94640 1 Processor -- start 2024-04-25T12:24:24.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.299+0000 7f56c3b94640 1 -- start start 2024-04-25T12:24:24.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.299+0000 7f56c3b94640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56bc14fbc0 0x7f56bc06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.299+0000 7f56c3b94640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f56bc14ffa0 0x7f56bc0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.299+0000 7f56c3b94640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56bc0c5d70 con 0x7f56bc074100 2024-04-25T12:24:24.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.299+0000 7f56c3b94640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f56bc0c6050 con 0x7f56bc14ffa0 2024-04-25T12:24:24.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.299+0000 7f56c3b94640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f56bc0c6330 con 0x7f56bc14fbc0 2024-04-25T12:24:24.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.303+0000 7f56c1930640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56bc14fbc0 0x7f56bc06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.303+0000 7f56c1930640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56bc14fbc0 0x7f56bc06f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.94:49950/0 (socket says 172.21.15.94:49950) 2024-04-25T12:24:24.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.303+0000 7f56c1930640 1 -- 172.21.15.94:0/155357360 learned_addr learned my addr 172.21.15.94:0/155357360 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:24.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.303+0000 7f56c112f640 1 --2- 172.21.15.94:0/155357360 >> v2:172.21.15.111:3300/0 conn(0x7f56bc14ffa0 0x7f56bc0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.303+0000 7f56c112f640 1 -- 172.21.15.94:0/155357360 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56bc14fbc0 msgr2=0x7f56bc06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:24.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.303+0000 7f56c112f640 1 --2- 172.21.15.94:0/155357360 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56bc14fbc0 0x7f56bc06f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.303+0000 7f56c112f640 1 -- 172.21.15.94:0/155357360 >> v1:172.21.15.111:6789/0 conn(0x7f56bc074100 legacy=0x7f56bc0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.303+0000 7f56c112f640 1 -- 172.21.15.94:0/155357360 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56bc0c6610 con 0x7f56bc14ffa0 2024-04-25T12:24:24.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.303+0000 7f56c112f640 1 --2- 172.21.15.94:0/155357360 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f56bc14ffa0 0x7f56bc0c8220 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f56a8009d90 tx=0x7f56a801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bd8156b7f6d87f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.303+0000 7f56c092e640 1 -- 172.21.15.94:0/155357360 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a80b2070 con 0x7f56bc14ffa0 2024-04-25T12:24:24.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.303+0000 7f56c092e640 1 -- 172.21.15.94:0/155357360 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56a80a5a50 con 0x7f56bc14ffa0 2024-04-25T12:24:24.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.303+0000 7f56c092e640 1 -- 172.21.15.94:0/155357360 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a80a5e20 con 0x7f56bc14ffa0 2024-04-25T12:24:24.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c3b94640 1 -- 172.21.15.94:0/155357360 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f56bc14ffa0 msgr2=0x7f56bc0c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c3b94640 1 --2- 172.21.15.94:0/155357360 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f56bc14ffa0 0x7f56bc0c8220 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f56a8009d90 tx=0x7f56a801c970 comp rx=0 tx=0).stop 2024-04-25T12:24:24.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c3b94640 1 -- 172.21.15.94:0/155357360 shutdown_connections 2024-04-25T12:24:24.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c3b94640 1 --2- 172.21.15.94:0/155357360 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f56bc14ffa0 0x7f56bc0c8220 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c3b94640 1 --2- 172.21.15.94:0/155357360 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56bc14fbc0 0x7f56bc06f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c3b94640 1 -- 172.21.15.94:0/155357360 >> 172.21.15.94:0/155357360 conn(0x7f56bc06b9d0 msgr2=0x7f56bc06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:24.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c3b94640 1 -- 172.21.15.94:0/155357360 shutdown_connections 2024-04-25T12:24:24.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c3b94640 1 -- 172.21.15.94:0/155357360 wait complete. 2024-04-25T12:24:24.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c3b94640 1 Processor -- start 2024-04-25T12:24:24.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c3b94640 1 -- start start 2024-04-25T12:24:24.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c3b94640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f56bc074100 0x7f56bc162fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c3b94640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56bc14fbc0 0x7f56bc13f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c3b94640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56bc14ffa0 0x7f56bc14e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c3b94640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f56bc166420 con 0x7f56bc14ffa0 2024-04-25T12:24:24.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c3b94640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f56bc1662a0 con 0x7f56bc074100 2024-04-25T12:24:24.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c3b94640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f56bc1665a0 con 0x7f56bc14fbc0 2024-04-25T12:24:24.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c2131640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56bc14ffa0 0x7f56bc14e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c2131640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56bc14ffa0 0x7f56bc14e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51792/0 (socket says 172.21.15.94:51792) 2024-04-25T12:24:24.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c2131640 1 -- 172.21.15.94:0/649752207 learned_addr learned my addr 172.21.15.94:0/649752207 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:24.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c1930640 1 --2- 172.21.15.94:0/649752207 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f56bc074100 0x7f56bc162fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c112f640 1 --2- 172.21.15.94:0/649752207 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56bc14fbc0 0x7f56bc13f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c2131640 1 -- 172.21.15.94:0/649752207 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56bc14fbc0 msgr2=0x7f56bc13f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c2131640 1 --2- 172.21.15.94:0/649752207 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56bc14fbc0 0x7f56bc13f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c2131640 1 -- 172.21.15.94:0/649752207 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f56bc074100 msgr2=0x7f56bc162fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c2131640 1 --2- 172.21.15.94:0/649752207 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f56bc074100 0x7f56bc162fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c2131640 1 -- 172.21.15.94:0/649752207 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56bc1f4170 con 0x7f56bc14ffa0 2024-04-25T12:24:24.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c1930640 1 --2- 172.21.15.94:0/649752207 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f56bc074100 0x7f56bc162fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:24.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c2131640 1 --2- 172.21.15.94:0/649752207 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56bc14ffa0 0x7f56bc14e410 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f56b400c3c0 tx=0x7f56b400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56ba7fc640 1 -- 172.21.15.94:0/649752207 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b40052d0 con 0x7f56bc14ffa0 2024-04-25T12:24:24.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56ba7fc640 1 -- 172.21.15.94:0/649752207 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56b4005470 con 0x7f56bc14ffa0 2024-04-25T12:24:24.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c3b94640 1 -- 172.21.15.94:0/649752207 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56bc1f75d0 con 0x7f56bc14ffa0 2024-04-25T12:24:24.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56ba7fc640 1 -- 172.21.15.94:0/649752207 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b4007260 con 0x7f56bc14ffa0 2024-04-25T12:24:24.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c3b94640 1 -- 172.21.15.94:0/649752207 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56bc1f7b70 con 0x7f56bc14ffa0 2024-04-25T12:24:24.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.307+0000 7f56c3b94640 1 -- 172.21.15.94:0/649752207 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56bc075df0 con 0x7f56bc14ffa0 2024-04-25T12:24:24.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.311+0000 7f56ba7fc640 1 -- 172.21.15.94:0/649752207 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f56b4007400 con 0x7f56bc14ffa0 2024-04-25T12:24:24.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.311+0000 7f56ba7fc640 1 --2- 172.21.15.94:0/649752207 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f56a4068380 0x7f56a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.311+0000 7f56ba7fc640 1 -- 172.21.15.94:0/649752207 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f56b40862a0 con 0x7f56bc14ffa0 2024-04-25T12:24:24.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.311+0000 7f56c1930640 1 --2- 172.21.15.94:0/649752207 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f56a4068380 0x7f56a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.311+0000 7f56c1930640 1 --2- 172.21.15.94:0/649752207 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f56a4068380 0x7f56a406a840 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009ad0 tx=0x7f56ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.315+0000 7f56ba7fc640 1 -- 172.21.15.94:0/649752207 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f56b40563e0 con 0x7f56bc14ffa0 2024-04-25T12:24:24.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.463+0000 7f56c3b94640 1 -- 172.21.15.94:0/649752207 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f56bc0c7df0 con 0x7f56bc14ffa0 2024-04-25T12:24:24.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.467+0000 7f56ba7fc640 1 -- 172.21.15.94:0/649752207 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18873 (secure 0 0 0) 0x7f56b4055ce0 con 0x7f56bc14ffa0 2024-04-25T12:24:24.471 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:24.471 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"7059a9e2-aec4-4b84-b942-caf531e15da3","created":"2024-04-25T12:21:29.118508+0000","modified":"2024-04-25T12:22:34.871807+0000","last_up_change":"2024-04-25T12:21:40.912605+0000","last_in_change":"2024-04-25T12:21:31.372905+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:39.781011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:51.465886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:52.470540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:56.209936+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"640a65ef-0734-468a-a8f5-9ed70cf75c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6809","nonce":2553247564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6811","nonce":2553247564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6815","nonce":2553247564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6813","nonce":2553247564}]},"public_addr":"172.21.15.94:6809/2553247564","cluster_addr":"172.21.15.94:6811/2553247564","heartbeat_back_addr":"172.21.15.94:6815/2553247564","heartbeat_front_addr":"172.21.15.94:6813/2553247564","state":["exists","up"]},{"osd":1,"uuid":"d6e886e6-c8c1-4761-9a4c-abc6961c7c81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6818","nonce":2492806478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6822","nonce":2492806478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6830","nonce":2492806478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6826","nonce":2492806478}]},"public_addr":"172.21.15.94:6818/2492806478","cluster_addr":"172.21.15.94:6822/2492806478","heartbeat_back_addr":"172.21.15.94:6830/2492806478","heartbeat_front_addr":"172.21.15.94:6826/2492806478","state":["exists","up"]},{"osd":2,"uuid":"ba20f409-ed46-43b6-b16d-43dc4622c042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6801","nonce":1485061290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6803","nonce":1485061290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6807","nonce":1485061290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6805","nonce":1485061290}]},"public_addr":"172.21.15.94:6801/1485061290","cluster_addr":"172.21.15.94:6803/1485061290","heartbeat_back_addr":"172.21.15.94:6807/1485061290","heartbeat_front_addr":"172.21.15.94:6805/1485061290","state":["exists","up"]},{"osd":3,"uuid":"85816a2b-3a3f-4ec8-8373-8230d948396f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6819","nonce":1548488434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6823","nonce":1548488434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6829","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6831","nonce":1548488434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6827","nonce":1548488434}]},"public_addr":"172.21.15.94:6819/1548488434","cluster_addr":"172.21.15.94:6823/1548488434","heartbeat_back_addr":"172.21.15.94:6831/1548488434","heartbeat_front_addr":"172.21.15.94:6827/1548488434","state":["exists","up"]},{"osd":4,"uuid":"b4a953b7-01d6-4623-9324-63135fdaf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6811","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6814","nonce":4070977083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6817","nonce":4070977083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6823","nonce":4070977083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6819","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6821","nonce":4070977083}]},"public_addr":"172.21.15.111:6814/4070977083","cluster_addr":"172.21.15.111:6817/4070977083","heartbeat_back_addr":"172.21.15.111:6823/4070977083","heartbeat_front_addr":"172.21.15.111:6821/4070977083","state":["exists","up"]},{"osd":5,"uuid":"c0acc514-427d-41bf-a965-b8463cebf045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6803","nonce":1054925605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6809","nonce":1054925605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6820","nonce":1054925605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6815","nonce":1054925605}]},"public_addr":"172.21.15.111:6803/1054925605","cluster_addr":"172.21.15.111:6809/1054925605","heartbeat_back_addr":"172.21.15.111:6820/1054925605","heartbeat_front_addr":"172.21.15.111:6815/1054925605","state":["exists","up"]},{"osd":6,"uuid":"26ff742f-5a57-44a7-a095-f04d6e87f885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6825","nonce":3619235078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6827","nonce":3619235078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6831","nonce":3619235078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6829","nonce":3619235078}]},"public_addr":"172.21.15.111:6825/3619235078","cluster_addr":"172.21.15.111:6827/3619235078","heartbeat_back_addr":"172.21.15.111:6831/3619235078","heartbeat_front_addr":"172.21.15.111:6829/3619235078","state":["exists","up"]},{"osd":7,"uuid":"9c214cba-693a-4b25-aad7-05a5b0006e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6801","nonce":558758517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6805","nonce":558758517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6813","nonce":558758517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6807","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6808","nonce":558758517}]},"public_addr":"172.21.15.111:6801/558758517","cluster_addr":"172.21.15.111:6805/558758517","heartbeat_back_addr":"172.21.15.111:6813/558758517","heartbeat_front_addr":"172.21.15.111:6808/558758517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.664958+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.853375+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.654455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:37.033852+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.968691+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.856013+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.913496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.848565+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:24:24.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.467+0000 7f56c3b94640 1 -- 172.21.15.94:0/649752207 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f56a4068380 msgr2=0x7f56a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.467+0000 7f56c3b94640 1 --2- 172.21.15.94:0/649752207 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f56a4068380 0x7f56a406a840 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009ad0 tx=0x7f56ac008040 comp rx=0 tx=0).stop 2024-04-25T12:24:24.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.467+0000 7f56c3b94640 1 -- 172.21.15.94:0/649752207 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56bc14ffa0 msgr2=0x7f56bc14e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.467+0000 7f56c3b94640 1 --2- 172.21.15.94:0/649752207 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56bc14ffa0 0x7f56bc14e410 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f56b400c3c0 tx=0x7f56b400c880 comp rx=0 tx=0).stop 2024-04-25T12:24:24.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.467+0000 7f56c3b94640 1 -- 172.21.15.94:0/649752207 shutdown_connections 2024-04-25T12:24:24.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.467+0000 7f56c3b94640 1 --2- 172.21.15.94:0/649752207 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f56a4068380 0x7f56a406a840 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.467+0000 7f56c3b94640 1 --2- 172.21.15.94:0/649752207 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56bc14fbc0 0x7f56bc13f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.467+0000 7f56c3b94640 1 --2- 172.21.15.94:0/649752207 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56bc14ffa0 0x7f56bc14e410 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.467+0000 7f56c3b94640 1 --2- 172.21.15.94:0/649752207 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f56bc074100 0x7f56bc162fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.467+0000 7f56c3b94640 1 -- 172.21.15.94:0/649752207 >> 172.21.15.94:0/649752207 conn(0x7f56bc06b9d0 msgr2=0x7f56bc0c7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:24.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.467+0000 7f56c3b94640 1 -- 172.21.15.94:0/649752207 shutdown_connections 2024-04-25T12:24:24.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.467+0000 7f56c3b94640 1 -- 172.21.15.94:0/649752207 wait complete. 2024-04-25T12:24:24.488 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T12:24:24.488 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T12:24:24.488 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T12:24:24.489 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T12:24:24.489 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T12:24:24.490 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T12:24:24.490 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T12:24:24.490 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T12:24:24.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effd5419640 1 Processor -- start 2024-04-25T12:24:24.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effd5419640 1 -- start start 2024-04-25T12:24:24.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effd5419640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effd00cab50 0x7effd016ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effd5419640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effd00728c0 con 0x7effd0072f80 2024-04-25T12:24:24.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effd5419640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effd0072b40 con 0x7effd01595f0 2024-04-25T12:24:24.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effd5419640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7effd00735d0 con 0x7effd00cab50 2024-04-25T12:24:24.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effcf7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7effd0072f80 0x7effd00c7e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39244/0 (socket says 172.21.15.94:39244) 2024-04-25T12:24:24.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effcf7fe640 1 -- 172.21.15.94:0/3363188257 learned_addr learned my addr 172.21.15.94:0/3363188257 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:24.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effceffd640 1 -- 172.21.15.94:0/3363188257 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1853929608 0 0) 0x7effc0001120 con 0x7effd0072f80 2024-04-25T12:24:24.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effceffd640 1 -- 172.21.15.94:0/3363188257 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effb8003530 con 0x7effd0072f80 2024-04-25T12:24:24.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effd4c18640 1 --2- 172.21.15.94:0/3363188257 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effd00cab50 0x7effd016ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effceffd640 1 -- 172.21.15.94:0/3363188257 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3751312412 0 0) 0x7effb8003530 con 0x7effd0072f80 2024-04-25T12:24:24.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effceffd640 1 -- 172.21.15.94:0/3363188257 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effd00cab50 msgr2=0x7effd016ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:24.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effceffd640 1 --2- 172.21.15.94:0/3363188257 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effd00cab50 0x7effd016ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effceffd640 1 -- 172.21.15.94:0/3363188257 >> v1:172.21.15.111:6789/0 conn(0x7effd01595f0 legacy=0x7effd006c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effceffd640 1 -- 172.21.15.94:0/3363188257 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd006ba70 con 0x7effd0072f80 2024-04-25T12:24:24.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effceffd640 1 -- 172.21.15.94:0/3363188257 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7effc0001870 con 0x7effd0072f80 2024-04-25T12:24:24.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effceffd640 1 -- 172.21.15.94:0/3363188257 >> v1:172.21.15.94:6789/0 conn(0x7effd0072f80 legacy=0x7effd00c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effceffd640 1 --2- 172.21.15.94:0/3363188257 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effb8003a60 0x7effb8003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effceffd640 1 --2- 172.21.15.94:0/3363188257 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effb8004810 0x7effb8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effceffd640 1 --2- 172.21.15.94:0/3363188257 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effb80051d0 0x7effb800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effceffd640 1 -- 172.21.15.94:0/3363188257 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7effd00735d0 con 0x7effb8004810 2024-04-25T12:24:24.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effceffd640 1 -- 172.21.15.94:0/3363188257 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7effb800c040 con 0x7effb80051d0 2024-04-25T12:24:24.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effceffd640 1 -- 172.21.15.94:0/3363188257 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7effb800c240 con 0x7effb8003a60 2024-04-25T12:24:24.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effd4c18640 1 --2- 172.21.15.94:0/3363188257 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effb80051d0 0x7effb800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effcf7fe640 1 --2- 172.21.15.94:0/3363188257 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effb8004810 0x7effb8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effcffff640 1 --2- 172.21.15.94:0/3363188257 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effb8003a60 0x7effb8003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7f9d0a220640 1 Processor -- start 2024-04-25T12:24:24.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7f9d0a220640 1 -- start start 2024-04-25T12:24:24.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effcf7fe640 1 -- 172.21.15.94:0/3363188257 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effb8003a60 msgr2=0x7effb8003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:24.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effcf7fe640 1 --2- 172.21.15.94:0/3363188257 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effb8003a60 0x7effb8003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effcf7fe640 1 -- 172.21.15.94:0/3363188257 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effb80051d0 msgr2=0x7effb800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:24.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effcf7fe640 1 --2- 172.21.15.94:0/3363188257 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effb80051d0 0x7effb800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7effcf7fe640 1 -- 172.21.15.94:0/3363188257 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd006ba70 con 0x7effb8004810 2024-04-25T12:24:24.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7f194e8c5640 1 Processor -- start 2024-04-25T12:24:24.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.659+0000 7f194e8c5640 1 -- start start 2024-04-25T12:24:24.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f9d0a220640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9d04155280 0x7f9d040c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f194e8c5640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f19480714f0 0x7f19480c8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f9d0a220640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d04155660 con 0x7f9d0415f010 2024-04-25T12:24:24.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f194e8c5640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f194806f700 0x7f19481685d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f9d0a220640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d0415b7c0 con 0x7f9d040c92f0 2024-04-25T12:24:24.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f9d0a220640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f9d0415eb80 con 0x7f9d04155280 2024-04-25T12:24:24.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f194e8c5640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19480c72f0 con 0x7f19480c88d0 2024-04-25T12:24:24.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f1947fff640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f19480714f0 0x7f19480c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f194e8c5640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f19480c6430 con 0x7f194806f700 2024-04-25T12:24:24.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f194e8c5640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f1948068360 con 0x7f19480714f0 2024-04-25T12:24:24.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f1947fff640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f19480714f0 0x7f19480c8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.94:53514/0 (socket says 172.21.15.94:53514) 2024-04-25T12:24:24.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f1947fff640 1 -- 172.21.15.94:0/1314197398 learned_addr learned my addr 172.21.15.94:0/1314197398 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:24.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f82a15a0640 1 Processor -- start 2024-04-25T12:24:24.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f82a15a0640 1 -- start start 2024-04-25T12:24:24.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f8ab759e640 1 Processor -- start 2024-04-25T12:24:24.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f8ab759e640 1 -- start start 2024-04-25T12:24:24.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f9d09a1f640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f9d040c92f0 0x7f9d040c3ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.94:35888/0 (socket says 172.21.15.94:35888) 2024-04-25T12:24:24.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f9d09a1f640 1 -- 172.21.15.94:0/1339105610 learned_addr learned my addr 172.21.15.94:0/1339105610 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:24.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f194ce62640 1 --2- 172.21.15.94:0/1314197398 >> v2:172.21.15.94:3300/0 conn(0x7f194806f700 0x7f19481685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f1947fff640 1 -- 172.21.15.94:0/1314197398 >> v2:172.21.15.94:3300/0 conn(0x7f194806f700 msgr2=0x7f19481685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:24.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f1947fff640 1 --2- 172.21.15.94:0/1314197398 >> v2:172.21.15.94:3300/0 conn(0x7f194806f700 0x7f19481685d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f1947fff640 1 -- 172.21.15.94:0/1314197398 >> v1:172.21.15.94:6789/0 conn(0x7f19480c88d0 legacy=0x7f1948167ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f1947fff640 1 -- 172.21.15.94:0/1314197398 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19480c75d0 con 0x7f19480714f0 2024-04-25T12:24:24.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f9d0921e640 1 --2- 172.21.15.94:0/1339105610 >> v2:172.21.15.94:3300/0 conn(0x7f9d04155280 0x7f9d040c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f9cfbfff640 1 -- 172.21.15.94:0/1339105610 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1569950247 0 0) 0x7f9d0415b7c0 con 0x7f9d040c92f0 2024-04-25T12:24:24.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f9cfbfff640 1 -- 172.21.15.94:0/1339105610 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cf0003530 con 0x7f9d040c92f0 2024-04-25T12:24:24.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f9d0921e640 1 -- 172.21.15.94:0/1339105610 >> v1:172.21.15.111:6789/0 conn(0x7f9d040c92f0 legacy=0x7f9d040c3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f9d0921e640 1 -- 172.21.15.94:0/1339105610 >> v1:172.21.15.94:6789/0 conn(0x7f9d0415f010 legacy=0x7f9d0415aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:24.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f9d0921e640 1 -- 172.21.15.94:0/1339105610 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d0415baa0 con 0x7f9d04155280 2024-04-25T12:24:24.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7effcf7fe640 1 --2- 172.21.15.94:0/3363188257 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effb8004810 0x7effb8004c90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7effd00c78e0 tx=0x7effc001f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4a8293225e0985 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f82a15a0640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f829c0c40d0 0x7f829c15fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f82a15a0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f829c15ff90 0x7f829c1590c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f82a15a0640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f829c06c920 con 0x7f829c15f670 2024-04-25T12:24:24.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f82a15a0640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f829c0c7d00 con 0x7f829c15ff90 2024-04-25T12:24:24.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f82a15a0640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f829c0c73d0 con 0x7f829c0c40d0 2024-04-25T12:24:24.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f82a0d9f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f829c15ff90 0x7f829c1590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7effceffd640 1 -- 172.21.15.94:0/3363188257 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc000c0e0 con 0x7effb8004810 2024-04-25T12:24:24.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7effceffd640 1 -- 172.21.15.94:0/3363188257 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc0005ae0 con 0x7effb8004810 2024-04-25T12:24:24.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7effceffd640 1 -- 172.21.15.94:0/3363188257 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc0007070 con 0x7effb8004810 2024-04-25T12:24:24.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f82a0d9f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f829c15ff90 0x7f829c1590c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51834/0 (socket says 172.21.15.94:51834) 2024-04-25T12:24:24.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f829b7fe640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f829c0c40d0 0x7f829c15fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f82a0d9f640 1 -- 172.21.15.94:0/2936495442 learned_addr learned my addr 172.21.15.94:0/2936495442 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:24.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f63e6fdf640 1 Processor -- start 2024-04-25T12:24:24.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f8ab759e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8ab00d5cd0 0x7f8ab00dc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f8ab759e640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f8ab0046570 0x7f8ab0006fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f8ab759e640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ab0046cd0 con 0x7f8ab0047d70 2024-04-25T12:24:24.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f8ab759e640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f8ab0051f90 con 0x7f8ab00d5cd0 2024-04-25T12:24:24.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f8ab759e640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f8ab00478e0 con 0x7f8ab0046570 2024-04-25T12:24:24.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f63e6fdf640 1 -- start start 2024-04-25T12:24:24.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f8ab659c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8ab00d5cd0 0x7f8ab00dc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f8ab659c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8ab00d5cd0 0x7f8ab00dc490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51842/0 (socket says 172.21.15.94:51842) 2024-04-25T12:24:24.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f8ab659c640 1 -- 172.21.15.94:0/4181951020 learned_addr learned my addr 172.21.15.94:0/4181951020 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:24.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f829b7fe640 1 -- 172.21.15.94:0/2936495442 >> v2:172.21.15.94:3300/0 conn(0x7f829c15ff90 msgr2=0x7f829c1590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:24.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f829b7fe640 1 --2- 172.21.15.94:0/2936495442 >> v2:172.21.15.94:3300/0 conn(0x7f829c15ff90 0x7f829c1590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f829b7fe640 1 -- 172.21.15.94:0/2936495442 >> v1:172.21.15.111:6789/0 conn(0x7f829c15f670 legacy=0x7f829c0c8190 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T12:24:24.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f829b7fe640 1 -- 172.21.15.94:0/2936495442 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829c0c76b0 con 0x7f829c0c40d0 2024-04-25T12:24:24.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.663+0000 7f8ab5d9b640 1 --2- 172.21.15.94:0/4181951020 >> v2:172.21.15.111:3300/0 conn(0x7f8ab0046570 0x7f8ab0006fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7effd5419640 1 -- 172.21.15.94:0/3363188257 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effb8004810 msgr2=0x7effb8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7effd5419640 1 --2- 172.21.15.94:0/3363188257 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effb8004810 0x7effb8004c90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7effd00c78e0 tx=0x7effc001f3c0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7effd4c18640 1 -- 172.21.15.94:0/3363188257 reap_dead start 2024-04-25T12:24:24.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7fc75dd55640 1 Processor -- start 2024-04-25T12:24:24.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7fc75dd55640 1 -- start start 2024-04-25T12:24:24.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f63e6fdf640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f63e00c7a40 0x7f63e01598c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f63e6fdf640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f63e015c360 0x7f63e00ce550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f63e6fdf640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e015cc10 con 0x7f63e0152f00 2024-04-25T12:24:24.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f63e6fdf640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f63e015cef0 con 0x7f63e015c360 2024-04-25T12:24:24.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f63e6fdf640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f63e015d1d0 con 0x7f63e00c7a40 2024-04-25T12:24:24.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f8ab659c640 1 -- 172.21.15.94:0/4181951020 >> v2:172.21.15.111:3300/0 conn(0x7f8ab0046570 msgr2=0x7f8ab0006fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:24.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f8ab659c640 1 --2- 172.21.15.94:0/4181951020 >> v2:172.21.15.111:3300/0 conn(0x7f8ab0046570 0x7f8ab0006fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f8ab659c640 1 -- 172.21.15.94:0/4181951020 >> v1:172.21.15.111:6789/0 conn(0x7f8ab0047d70 legacy=0x7f8ab004c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:24.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f8ab659c640 1 -- 172.21.15.94:0/4181951020 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab0046fb0 con 0x7f8ab00d5cd0 2024-04-25T12:24:24.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f63e4d7b640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f63e0152f00 0x7f63e0070dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.94:35924/0 (socket says 172.21.15.94:35924) 2024-04-25T12:24:24.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f63e4d7b640 1 -- 172.21.15.94:0/2922333638 learned_addr learned my addr 172.21.15.94:0/2922333638 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:24.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f63dffff640 1 --2- 172.21.15.94:0/2922333638 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f63e00c7a40 0x7f63e01598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7effd5419640 1 -- 172.21.15.94:0/3363188257 shutdown_connections 2024-04-25T12:24:24.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7effd5419640 1 -- 172.21.15.94:0/3363188257 >> 172.21.15.94:0/3363188257 conn(0x7effd00c9f10 msgr2=0x7effd00ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:24.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7effd5419640 1 -- 172.21.15.94:0/3363188257 shutdown_connections 2024-04-25T12:24:24.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7effd5419640 1 -- 172.21.15.94:0/3363188257 wait complete. 2024-04-25T12:24:24.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f63e557c640 1 --2- 172.21.15.94:0/2922333638 >> v2:172.21.15.111:3300/0 conn(0x7f63e015c360 0x7f63e00ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f1947fff640 1 --2- 172.21.15.94:0/1314197398 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19480714f0 0x7f19480c8390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f19480686f0 tx=0x7f193801c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acd5361f90568214 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f63e557c640 1 -- 172.21.15.94:0/2922333638 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f63e00c7a40 msgr2=0x7f63e01598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:24.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f63e557c640 1 --2- 172.21.15.94:0/2922333638 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f63e00c7a40 0x7f63e01598c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f63e557c640 1 -- 172.21.15.94:0/2922333638 >> v1:172.21.15.111:6789/0 conn(0x7f63e0152f00 legacy=0x7f63e0070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f63e557c640 1 -- 172.21.15.94:0/2922333638 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e01590c0 con 0x7f63e015c360 2024-04-25T12:24:24.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f9d0921e640 1 --2- 172.21.15.94:0/1339105610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9d04155280 0x7f9d040c45b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9d000097c0 tx=0x7f9d00027460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a7fd97815588ea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f1946ffd640 1 -- 172.21.15.94:0/1314197398 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19380b0070 con 0x7f19480714f0 2024-04-25T12:24:24.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f1946ffd640 1 -- 172.21.15.94:0/1314197398 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19380ab600 con 0x7f19480714f0 2024-04-25T12:24:24.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f1946ffd640 1 -- 172.21.15.94:0/1314197398 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19380ab9d0 con 0x7f19480714f0 2024-04-25T12:24:24.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f9cfbfff640 1 -- 172.21.15.94:0/1339105610 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d000bc070 con 0x7f9d04155280 2024-04-25T12:24:24.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f9cfbfff640 1 -- 172.21.15.94:0/1339105610 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d000b0e50 con 0x7f9d04155280 2024-04-25T12:24:24.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f9cfbfff640 1 -- 172.21.15.94:0/1339105610 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d000b7820 con 0x7f9d04155280 2024-04-25T12:24:24.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7fc75cd53640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc7580c8f90 0x7fc758151870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39266/0 (socket says 172.21.15.94:39266) 2024-04-25T12:24:24.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7fc75cd53640 1 -- 172.21.15.94:0/3167020980 learned_addr learned my addr 172.21.15.94:0/3167020980 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:24.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7fc75dd55640 1 --2- 172.21.15.94:0/3167020980 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc7580c9370 0x7fc758073670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7fc75dd55640 1 -- 172.21.15.94:0/3167020980 --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7580722f0 con 0x7fc7580c8f90 2024-04-25T12:24:24.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f9d0a220640 1 -- 172.21.15.94:0/1339105610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9d04155280 msgr2=0x7f9d040c45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f9d0a220640 1 --2- 172.21.15.94:0/1339105610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9d04155280 0x7f9d040c45b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9d000097c0 tx=0x7f9d00027460 comp rx=0 tx=0).stop 2024-04-25T12:24:24.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f829b7fe640 1 --2- 172.21.15.94:0/2936495442 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f829c0c40d0 0x7f829c15fa50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8294009d90 tx=0x7f829401c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=337413e0c5ba9a1e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f8ab659c640 1 --2- 172.21.15.94:0/4181951020 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ab00d5cd0 0x7f8ab00dc490 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000eef0 tx=0x7f8aac0213a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24a61fd99a7cfd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7fc757fff640 1 --2- 172.21.15.94:0/3167020980 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc7580c9370 0x7fc758073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f9d0a220640 1 -- 172.21.15.94:0/1339105610 shutdown_connections 2024-04-25T12:24:24.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f9d0a220640 1 --2- 172.21.15.94:0/1339105610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9d04155280 0x7f9d040c45b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f9d0a220640 1 -- 172.21.15.94:0/1339105610 >> 172.21.15.94:0/1339105610 conn(0x7f9d0406eb20 msgr2=0x7f9d0406ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:24.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7fc7577fe640 1 -- 172.21.15.94:0/3167020980 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1917881527 0 0) 0x7fc7580722f0 con 0x7fc7580c8f90 2024-04-25T12:24:24.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7fc75dd55640 1 -- 172.21.15.94:0/3167020980 --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7580725d0 con 0x7fc758151f80 2024-04-25T12:24:24.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7fc75dd55640 1 -- 172.21.15.94:0/3167020980 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fc7580731e0 con 0x7fc7580c9370 2024-04-25T12:24:24.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f194e8c5640 1 -- 172.21.15.94:0/1314197398 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19480714f0 msgr2=0x7f19480c8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f194e8c5640 1 --2- 172.21.15.94:0/1314197398 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19480714f0 0x7f19480c8390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f19480686f0 tx=0x7f193801c400 comp rx=0 tx=0).stop 2024-04-25T12:24:24.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7effd5419640 1 Processor -- start 2024-04-25T12:24:24.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7effd5419640 1 -- start start 2024-04-25T12:24:24.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7fc7577fe640 1 -- 172.21.15.94:0/3167020980 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc748003530 con 0x7fc7580c8f90 2024-04-25T12:24:24.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f194e8c5640 1 -- 172.21.15.94:0/1314197398 shutdown_connections 2024-04-25T12:24:24.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f194e8c5640 1 --2- 172.21.15.94:0/1314197398 >> v2:172.21.15.94:3300/0 conn(0x7f194806f700 0x7f19481685d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f194e8c5640 1 --2- 172.21.15.94:0/1314197398 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19480714f0 0x7f19480c8390 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f194e8c5640 1 -- 172.21.15.94:0/1314197398 >> 172.21.15.94:0/1314197398 conn(0x7f194806b9d0 msgr2=0x7f194806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:24.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f8ab559a640 1 -- 172.21.15.94:0/4181951020 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac0b6070 con 0x7f8ab00d5cd0 2024-04-25T12:24:24.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f8ab559a640 1 -- 172.21.15.94:0/4181951020 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aac0b1600 con 0x7f8ab00d5cd0 2024-04-25T12:24:24.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f8ab559a640 1 -- 172.21.15.94:0/4181951020 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac0b19d0 con 0x7f8ab00d5cd0 2024-04-25T12:24:24.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f9d0a220640 1 -- 172.21.15.94:0/1339105610 shutdown_connections 2024-04-25T12:24:24.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7fc7577fe640 1 -- 172.21.15.94:0/3167020980 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3406915284 0 0) 0x7fc7580725d0 con 0x7fc758151f80 2024-04-25T12:24:24.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7fc7577fe640 1 -- 172.21.15.94:0/3167020980 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7580722f0 con 0x7fc758151f80 2024-04-25T12:24:24.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f9d0a220640 1 -- 172.21.15.94:0/1339105610 wait complete. 2024-04-25T12:24:24.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7effd5419640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effb8004810 0x7effd015b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7effd5419640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effd00c66f0 0x7effd00c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7effd5419640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effd0159c40 0x7effd01f4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7effd5419640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7effd00738b0 con 0x7effd0159c40 2024-04-25T12:24:24.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7effd5419640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7effd01599d0 con 0x7effb8004810 2024-04-25T12:24:24.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7effd5419640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7effd015f2f0 con 0x7effd00c66f0 2024-04-25T12:24:24.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7fe04b331640 1 Processor -- start 2024-04-25T12:24:24.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7fe04b331640 1 -- start start 2024-04-25T12:24:24.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f8ab759e640 1 -- 172.21.15.94:0/4181951020 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ab00d5cd0 msgr2=0x7f8ab00dc490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f8ab759e640 1 --2- 172.21.15.94:0/4181951020 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ab00d5cd0 0x7f8ab00dc490 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000eef0 tx=0x7f8aac0213a0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.667+0000 7f194e8c5640 1 -- 172.21.15.94:0/1314197398 shutdown_connections 2024-04-25T12:24:24.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7effcf7fe640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effd00c66f0 0x7effd00c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f8ab759e640 1 -- 172.21.15.94:0/4181951020 shutdown_connections 2024-04-25T12:24:24.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f8ab759e640 1 --2- 172.21.15.94:0/4181951020 >> v2:172.21.15.111:3300/0 conn(0x7f8ab0046570 0x7f8ab0006fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f8ab759e640 1 --2- 172.21.15.94:0/4181951020 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ab00d5cd0 0x7f8ab00dc490 secure :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000eef0 tx=0x7f8aac0213a0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f8ab759e640 1 -- 172.21.15.94:0/4181951020 >> 172.21.15.94:0/4181951020 conn(0x7f8ab00512b0 msgr2=0x7f8ab00516c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:24.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7effcffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effb8004810 0x7effd015b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7effcf7fe640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effd00c66f0 0x7effd00c5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.94:49998/0 (socket says 172.21.15.94:49998) 2024-04-25T12:24:24.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7effcf7fe640 1 -- 172.21.15.94:0/1048390002 learned_addr learned my addr 172.21.15.94:0/1048390002 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:24.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7effd4c18640 1 --2- 172.21.15.94:0/1048390002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effd0159c40 0x7effd01f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f194e8c5640 1 -- 172.21.15.94:0/1314197398 wait complete. 2024-04-25T12:24:24.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f63e557c640 1 --2- 172.21.15.94:0/2922333638 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f63e015c360 0x7f63e00ce550 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f63d8009d90 tx=0x7f63d801f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fab807d2a5527fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f829affd640 1 -- 172.21.15.94:0/2936495442 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82940b2070 con 0x7f829c0c40d0 2024-04-25T12:24:24.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f829affd640 1 -- 172.21.15.94:0/2936495442 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82940a58c0 con 0x7f829c0c40d0 2024-04-25T12:24:24.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7effd4c18640 1 -- 172.21.15.94:0/1048390002 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effd00c66f0 msgr2=0x7effd00c5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7effd4c18640 1 --2- 172.21.15.94:0/1048390002 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effd00c66f0 0x7effd00c5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7effd4c18640 1 -- 172.21.15.94:0/1048390002 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effb8004810 msgr2=0x7effd015b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7effd4c18640 1 --2- 172.21.15.94:0/1048390002 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effb8004810 0x7effd015b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f829affd640 1 -- 172.21.15.94:0/2936495442 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82940a5c90 con 0x7f829c0c40d0 2024-04-25T12:24:24.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7effd4c18640 1 -- 172.21.15.94:0/1048390002 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd01f90a0 con 0x7effd0159c40 2024-04-25T12:24:24.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f63df7fe640 1 -- 172.21.15.94:0/2922333638 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d80b4070 con 0x7f63e015c360 2024-04-25T12:24:24.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f63df7fe640 1 -- 172.21.15.94:0/2922333638 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63d80af600 con 0x7f63e015c360 2024-04-25T12:24:24.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f63e6fdf640 1 -- 172.21.15.94:0/2922333638 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f63e015c360 msgr2=0x7f63e00ce550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f63e6fdf640 1 --2- 172.21.15.94:0/2922333638 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f63e015c360 0x7f63e00ce550 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f63d8009d90 tx=0x7f63d801f150 comp rx=0 tx=0).stop 2024-04-25T12:24:24.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f82a15a0640 1 -- 172.21.15.94:0/2936495442 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f829c0c40d0 msgr2=0x7f829c15fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f82a15a0640 1 --2- 172.21.15.94:0/2936495442 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f829c0c40d0 0x7f829c15fa50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8294009d90 tx=0x7f829401c930 comp rx=0 tx=0).stop 2024-04-25T12:24:24.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f82a15a0640 1 -- 172.21.15.94:0/2936495442 shutdown_connections 2024-04-25T12:24:24.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f82a15a0640 1 --2- 172.21.15.94:0/2936495442 >> v2:172.21.15.94:3300/0 conn(0x7f829c15ff90 0x7f829c1590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f82a15a0640 1 --2- 172.21.15.94:0/2936495442 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f829c0c40d0 0x7f829c15fa50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f82a15a0640 1 -- 172.21.15.94:0/2936495442 >> 172.21.15.94:0/2936495442 conn(0x7f829c0c9330 msgr2=0x7f829c0c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:24.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7fc757fff640 1 -- 172.21.15.94:0/3167020980 >> v1:172.21.15.111:6789/0 conn(0x7fc758151f80 legacy=0x7fc7581622f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7fc757fff640 1 -- 172.21.15.94:0/3167020980 >> v1:172.21.15.94:6789/0 conn(0x7fc7580c8f90 legacy=0x7fc758151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7fc757fff640 1 -- 172.21.15.94:0/3167020980 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7580728b0 con 0x7fc7580c9370 2024-04-25T12:24:24.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7effd4c18640 1 --2- 172.21.15.94:0/1048390002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effd0159c40 0x7effd01f4c40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7effd0074740 tx=0x7effc80115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7effccff9640 1 -- 172.21.15.94:0/1048390002 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc8011e10 con 0x7effd0159c40 2024-04-25T12:24:24.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7effccff9640 1 -- 172.21.15.94:0/1048390002 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc801b070 con 0x7effd0159c40 2024-04-25T12:24:24.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7effccff9640 1 -- 172.21.15.94:0/1048390002 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc80039a0 con 0x7effd0159c40 2024-04-25T12:24:24.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f194e8c5640 1 Processor -- start 2024-04-25T12:24:24.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7fe04b331640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe03c0d4b50 0x7fe03c0d4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f63e6fdf640 1 -- 172.21.15.94:0/2922333638 shutdown_connections 2024-04-25T12:24:24.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f63e6fdf640 1 --2- 172.21.15.94:0/2922333638 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f63e015c360 0x7f63e00ce550 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f63e6fdf640 1 --2- 172.21.15.94:0/2922333638 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f63e00c7a40 0x7f63e01598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f63e6fdf640 1 -- 172.21.15.94:0/2922333638 >> 172.21.15.94:0/2922333638 conn(0x7f63e006f0a0 msgr2=0x7f63e006f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:24.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f63e6fdf640 1 -- 172.21.15.94:0/2922333638 shutdown_connections 2024-04-25T12:24:24.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f82a15a0640 1 -- 172.21.15.94:0/2936495442 shutdown_connections 2024-04-25T12:24:24.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f82a15a0640 1 -- 172.21.15.94:0/2936495442 wait complete. 2024-04-25T12:24:24.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f8ab759e640 1 -- 172.21.15.94:0/4181951020 shutdown_connections 2024-04-25T12:24:24.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f9d0a220640 1 Processor -- start 2024-04-25T12:24:24.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f9d0a220640 1 -- start start 2024-04-25T12:24:24.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7fc757fff640 1 --2- 172.21.15.94:0/3167020980 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc7580c9370 0x7fc758073670 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc744009820 tx=0x7fc74401ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a51b1014930fd9f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7fc7577fe640 1 -- 172.21.15.94:0/3167020980 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7440b5070 con 0x7fc7580c9370 2024-04-25T12:24:24.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7fc7577fe640 1 -- 172.21.15.94:0/3167020980 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7440a89b0 con 0x7fc7580c9370 2024-04-25T12:24:24.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7fc7577fe640 1 -- 172.21.15.94:0/3167020980 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7440a8d60 con 0x7fc7580c9370 2024-04-25T12:24:24.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f194e8c5640 1 -- start start 2024-04-25T12:24:24.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f194e8c5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f194806f700 0x7f1948173ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f194e8c5640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19480714f0 0x7f1948215810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f194e8c5640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f19480c88d0 0x7f194816dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f194e8c5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f19480c7f00 con 0x7f194806f700 2024-04-25T12:24:24.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f194e8c5640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f194816cf40 con 0x7f19480714f0 2024-04-25T12:24:24.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f194e8c5640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f194816d0c0 con 0x7f19480c88d0 2024-04-25T12:24:24.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f1947fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f194806f700 0x7f1948173ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f19477fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19480714f0 0x7f1948215810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f1947fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f194806f700 0x7f1948173ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51872/0 (socket says 172.21.15.94:51872) 2024-04-25T12:24:24.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f1947fff640 1 -- 172.21.15.94:0/1318455764 learned_addr learned my addr 172.21.15.94:0/1318455764 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:24.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f194ce62640 1 --2- 172.21.15.94:0/1318455764 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f19480c88d0 0x7f194816dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7effd5419640 1 -- 172.21.15.94:0/1048390002 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effd015a140 con 0x7effd0159c40 2024-04-25T12:24:24.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7effd5419640 1 -- 172.21.15.94:0/1048390002 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effd01f85c0 con 0x7effd0159c40 2024-04-25T12:24:24.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7effd5419640 1 -- 172.21.15.94:0/1048390002 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7effd015a420 con 0x7effd0159c40 2024-04-25T12:24:24.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7fe0498ce640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe03c0d4b50 0x7fe03c0d4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7fe0498ce640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe03c0d4b50 0x7fe03c0d4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51858/0 (socket says 172.21.15.94:51858) 2024-04-25T12:24:24.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7fe0490cd640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fe03c00e2b0 0x7fe03c005ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.94:35936/0 (socket says 172.21.15.94:35936) 2024-04-25T12:24:24.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7fe0498ce640 1 -- 172.21.15.94:0/997469390 learned_addr learned my addr 172.21.15.94:0/997469390 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:24.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7fe04b331640 1 -- 172.21.15.94:0/997469390 --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe03c045fc0 con 0x7fe03c046d80 2024-04-25T12:24:24.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7fe04b331640 1 -- 172.21.15.94:0/997469390 --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe03c0462a0 con 0x7fe03c00e2b0 2024-04-25T12:24:24.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7fe04b331640 1 -- 172.21.15.94:0/997469390 --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fe03c0dbd50 con 0x7fe03c0d4b50 2024-04-25T12:24:24.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7fe03bfff640 1 -- 172.21.15.94:0/997469390 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3189560894 0 0) 0x7fe03c0462a0 con 0x7fe03c00e2b0 2024-04-25T12:24:24.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7fe03bfff640 1 -- 172.21.15.94:0/997469390 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe030007940 con 0x7fe03c00e2b0 2024-04-25T12:24:24.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7f63e6fdf640 1 -- 172.21.15.94:0/2922333638 wait complete. 2024-04-25T12:24:24.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f63e6fdf640 1 Processor -- start 2024-04-25T12:24:24.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f82a15a0640 1 Processor -- start 2024-04-25T12:24:24.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f1947fff640 1 -- 172.21.15.94:0/1318455764 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f19480c88d0 msgr2=0x7f194816dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f1947fff640 1 --2- 172.21.15.94:0/1318455764 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f19480c88d0 0x7f194816dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f1947fff640 1 -- 172.21.15.94:0/1318455764 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19480714f0 msgr2=0x7f1948215810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f1947fff640 1 --2- 172.21.15.94:0/1318455764 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19480714f0 0x7f1948215810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f1947fff640 1 -- 172.21.15.94:0/1318455764 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19480c2ff0 con 0x7f194806f700 2024-04-25T12:24:24.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f1947fff640 1 --2- 172.21.15.94:0/1318455764 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f194806f700 0x7f1948173ec0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f193801a030 tx=0x7f19380191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7fc75dd55640 1 -- 172.21.15.94:0/3167020980 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc7580c9370 msgr2=0x7fc758073670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7fc75dd55640 1 --2- 172.21.15.94:0/3167020980 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc7580c9370 0x7fc758073670 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc744009820 tx=0x7fc74401ecd0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7fc75dd55640 1 -- 172.21.15.94:0/3167020980 shutdown_connections 2024-04-25T12:24:24.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7fc75dd55640 1 --2- 172.21.15.94:0/3167020980 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc7580c9370 0x7fc758073670 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc744009820 tx=0x7fc74401ecd0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7fc75dd55640 1 -- 172.21.15.94:0/3167020980 >> 172.21.15.94:0/3167020980 conn(0x7fc75806f940 msgr2=0x7fc75806fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:24.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f9d0a220640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d040c92f0 0x7f9d04071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f9d0a220640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d04155280 0x7f9d041efd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f1944ff9640 1 -- 172.21.15.94:0/1318455764 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19380b0070 con 0x7f194806f700 2024-04-25T12:24:24.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f1944ff9640 1 -- 172.21.15.94:0/1318455764 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19380b1040 con 0x7f194806f700 2024-04-25T12:24:24.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f1944ff9640 1 -- 172.21.15.94:0/1318455764 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19380aa7b0 con 0x7f194806f700 2024-04-25T12:24:24.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f194e8c5640 1 -- 172.21.15.94:0/1318455764 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19482160e0 con 0x7f194806f700 2024-04-25T12:24:24.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f9d0921e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d040c92f0 0x7f9d04071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f9d0921e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d040c92f0 0x7f9d04071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.94:53566/0 (socket says 172.21.15.94:53566) 2024-04-25T12:24:24.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f9d0921e640 1 -- 172.21.15.94:0/2403463493 learned_addr learned my addr 172.21.15.94:0/2403463493 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:24.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f63e6fdf640 1 -- start start 2024-04-25T12:24:24.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f63e6fdf640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f63e00c7a40 0x7f63e006df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f63e6fdf640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f63e0152f00 0x7f63e014a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f63e6fdf640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63e015c360 0x7f63e014af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f63e6fdf640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f63e015c810 con 0x7f63e015c360 2024-04-25T12:24:24.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f63e6fdf640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f63e0158d70 con 0x7f63e00c7a40 2024-04-25T12:24:24.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f63e6fdf640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f63e015c990 con 0x7f63e0152f00 2024-04-25T12:24:24.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f9d0a220640 1 --2- 172.21.15.94:0/2403463493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9d0415f010 0x7f9d041f0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f9d08a1d640 1 --2- 172.21.15.94:0/2403463493 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d04155280 0x7f9d041efd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f63e557c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63e015c360 0x7f63e014af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f63e557c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63e015c360 0x7f63e014af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51878/0 (socket says 172.21.15.94:51878) 2024-04-25T12:24:24.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f63e557c640 1 -- 172.21.15.94:0/1221363427 learned_addr learned my addr 172.21.15.94:0/1221363427 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:24.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f63e4d7b640 1 --2- 172.21.15.94:0/1221363427 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f63e00c7a40 0x7f63e006df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f9d0a220640 1 -- 172.21.15.94:0/2403463493 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0415e810 con 0x7f9d0415f010 2024-04-25T12:24:24.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f9d0a220640 1 -- 172.21.15.94:0/2403463493 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0415f430 con 0x7f9d040c92f0 2024-04-25T12:24:24.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f9d0a220640 1 -- 172.21.15.94:0/2403463493 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f9d0415bd80 con 0x7f9d04155280 2024-04-25T12:24:24.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f194e8c5640 1 -- 172.21.15.94:0/1318455764 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1948170210 con 0x7f194806f700 2024-04-25T12:24:24.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f63dffff640 1 --2- 172.21.15.94:0/1221363427 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f63e0152f00 0x7f63e014a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f63e557c640 1 -- 172.21.15.94:0/1221363427 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f63e0152f00 msgr2=0x7f63e014a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f63e557c640 1 --2- 172.21.15.94:0/1221363427 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f63e0152f00 0x7f63e014a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f63e557c640 1 -- 172.21.15.94:0/1221363427 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f63e00c7a40 msgr2=0x7f63e006df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f63e557c640 1 --2- 172.21.15.94:0/1221363427 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f63e00c7a40 0x7f63e006df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f63e557c640 1 -- 172.21.15.94:0/1221363427 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e00c9960 con 0x7f63e015c360 2024-04-25T12:24:24.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f63e4d7b640 1 --2- 172.21.15.94:0/1221363427 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f63e00c7a40 0x7f63e006df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:24:24.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f8ab759e640 1 -- 172.21.15.94:0/4181951020 wait complete. 2024-04-25T12:24:24.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f8ab759e640 1 Processor -- start 2024-04-25T12:24:24.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f9d0921e640 1 -- 172.21.15.94:0/2403463493 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d04155280 msgr2=0x7f9d041efd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f9d0921e640 1 --2- 172.21.15.94:0/2403463493 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d04155280 0x7f9d041efd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f9d0921e640 1 -- 172.21.15.94:0/2403463493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9d0415f010 msgr2=0x7f9d041f0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f9d0921e640 1 --2- 172.21.15.94:0/2403463493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9d0415f010 0x7f9d041f0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f9d0921e640 1 -- 172.21.15.94:0/2403463493 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d04074270 con 0x7f9d040c92f0 2024-04-25T12:24:24.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f9d0921e640 1 --2- 172.21.15.94:0/2403463493 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d040c92f0 0x7f9d04071de0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9d00025090 tx=0x7f9d00024200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f194e8c5640 1 -- 172.21.15.94:0/1318455764 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1948075df0 con 0x7f194806f700 2024-04-25T12:24:24.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f1944ff9640 1 -- 172.21.15.94:0/1318455764 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f19380aa950 con 0x7f194806f700 2024-04-25T12:24:24.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7effccff9640 1 -- 172.21.15.94:0/1048390002 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7effc8003b40 con 0x7effd0159c40 2024-04-25T12:24:24.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7effccff9640 1 --2- 172.21.15.94:0/1048390002 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7effbc068480 0x7effbc06a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7effccff9640 1 -- 172.21.15.94:0/1048390002 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7effc80873a0 con 0x7effd0159c40 2024-04-25T12:24:24.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7effccff9640 1 --2- 172.21.15.94:0/1048390002 >> [v2:172.21.15.111:6824/3619235078,v1:172.21.15.111:6825/3619235078] conn(0x7effbc071e20 0x7effbc0742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7effccff9640 1 -- 172.21.15.94:0/1048390002 --> [v2:172.21.15.111:6824/3619235078,v1:172.21.15.111:6825/3619235078] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7effc801de80 con 0x7effbc071e20 2024-04-25T12:24:24.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7fe0498ce640 1 -- 172.21.15.94:0/997469390 >> v1:172.21.15.111:6789/0 conn(0x7fe03c00e2b0 legacy=0x7fe03c005ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7fe0498ce640 1 -- 172.21.15.94:0/997469390 >> v1:172.21.15.94:6789/0 conn(0x7fe03c046d80 legacy=0x7fe03c04b0a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T12:24:24.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.671+0000 7fe0498ce640 1 -- 172.21.15.94:0/997469390 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe03c046580 con 0x7fe03c0d4b50 2024-04-25T12:24:24.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f63e557c640 1 --2- 172.21.15.94:0/1221363427 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63e015c360 0x7f63e014af20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f63d80b2040 tx=0x7f63d801bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f82a15a0640 1 -- start start 2024-04-25T12:24:24.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f9cf9ffb640 1 -- 172.21.15.94:0/2403463493 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d000bc040 con 0x7f9d040c92f0 2024-04-25T12:24:24.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f9cf9ffb640 1 -- 172.21.15.94:0/2403463493 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d000c6070 con 0x7f9d040c92f0 2024-04-25T12:24:24.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f9d0a220640 1 -- 172.21.15.94:0/2403463493 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d041ed9f0 con 0x7f9d040c92f0 2024-04-25T12:24:24.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f1944ff9640 1 --2- 172.21.15.94:0/1318455764 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f19340683d0 0x7f193406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7effcffff640 1 --2- 172.21.15.94:0/1048390002 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7effbc068480 0x7effbc06a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7effcf7fe640 1 --2- 172.21.15.94:0/1048390002 >> [v2:172.21.15.111:6824/3619235078,v1:172.21.15.111:6825/3619235078] conn(0x7effbc071e20 0x7effbc0742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f9cf9ffb640 1 -- 172.21.15.94:0/2403463493 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d000c0650 con 0x7f9d040c92f0 2024-04-25T12:24:24.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f9d0a220640 1 -- 172.21.15.94:0/2403463493 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d041edc90 con 0x7f9d040c92f0 2024-04-25T12:24:24.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7effcffff640 1 --2- 172.21.15.94:0/1048390002 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7effbc068480 0x7effbc06a940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7effc4007fd0 tx=0x7effc4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7effccff9640 1 -- 172.21.15.94:0/1048390002 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7effc808e050 con 0x7effd0159c40 2024-04-25T12:24:24.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f63dd7fa640 1 -- 172.21.15.94:0/1221363427 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d80bf020 con 0x7f63e015c360 2024-04-25T12:24:24.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7fc75dd55640 1 -- 172.21.15.94:0/3167020980 shutdown_connections 2024-04-25T12:24:24.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f1944ff9640 1 -- 172.21.15.94:0/1318455764 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f193811ed60 con 0x7f194806f700 2024-04-25T12:24:24.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f1944ff9640 1 --2- 172.21.15.94:0/1318455764 >> [v2:172.21.15.111:6802/1054925605,v1:172.21.15.111:6803/1054925605] conn(0x7f1934071df0 0x7f1934074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f1944ff9640 1 -- 172.21.15.94:0/1318455764 --> [v2:172.21.15.111:6802/1054925605,v1:172.21.15.111:6803/1054925605] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f19380bbe80 con 0x7f1934071df0 2024-04-25T12:24:24.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f1944ff9640 1 -- 172.21.15.94:0/1318455764 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f19380ec880 con 0x7f194806f700 2024-04-25T12:24:24.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7effcf7fe640 1 --2- 172.21.15.94:0/1048390002 >> [v2:172.21.15.111:6824/3619235078,v1:172.21.15.111:6825/3619235078] conn(0x7effbc071e20 0x7effbc0742c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.675+0000 7f8ab759e640 1 -- start start 2024-04-25T12:24:24.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f8ab759e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8ab0046570 0x7f8ab01643d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f8ab759e640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8ab0047d70 0x7f8ab0048ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f8ab759e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ab0048360 0x7f8ab00367d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f8ab759e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab00d60b0 con 0x7f8ab0048360 2024-04-25T12:24:24.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f8ab759e640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab0047570 con 0x7f8ab0046570 2024-04-25T12:24:24.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f8ab759e640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab004c8d0 con 0x7f8ab0047d70 2024-04-25T12:24:24.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f82a15a0640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f829c0c40d0 0x7f829c152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f82a15a0640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f829c15f670 0x7f829c15d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f82a15a0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f829c200e90 0x7f829c201340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f82a15a0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f829c0c3a20 con 0x7f829c200e90 2024-04-25T12:24:24.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f82a15a0640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f829c0c38a0 con 0x7f829c15f670 2024-04-25T12:24:24.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f82a15a0640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f829c16c4c0 con 0x7f829c0c40d0 2024-04-25T12:24:24.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f63e6fdf640 1 -- 172.21.15.94:0/1221363427 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e01f8700 con 0x7f63e015c360 2024-04-25T12:24:24.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f63e6fdf640 1 -- 172.21.15.94:0/1221363427 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e01f8cc0 con 0x7f63e015c360 2024-04-25T12:24:24.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f63dd7fa640 1 -- 172.21.15.94:0/1221363427 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63d80ba750 con 0x7f63e015c360 2024-04-25T12:24:24.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f63dd7fa640 1 -- 172.21.15.94:0/1221363427 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d80b4040 con 0x7f63e015c360 2024-04-25T12:24:24.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f63e6fdf640 1 -- 172.21.15.94:0/1221363427 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f63e01f84b0 con 0x7f63e015c360 2024-04-25T12:24:24.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7fc75dd55640 1 -- 172.21.15.94:0/3167020980 wait complete. 2024-04-25T12:24:24.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f829bfff640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f829c0c40d0 0x7f829c152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f82a0d9f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f829c200e90 0x7f829c201340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f82a0d9f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f829c200e90 0x7f829c201340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51888/0 (socket says 172.21.15.94:51888) 2024-04-25T12:24:24.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f82a0d9f640 1 -- 172.21.15.94:0/4252220397 learned_addr learned my addr 172.21.15.94:0/4252220397 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:24.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f8ab5d9b640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8ab0047d70 0x7f8ab0048ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f8ab5d9b640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8ab0047d70 0x7f8ab0048ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.94:50058/0 (socket says 172.21.15.94:50058) 2024-04-25T12:24:24.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f8ab5d9b640 1 -- 172.21.15.94:0/1822196911 learned_addr learned my addr 172.21.15.94:0/1822196911 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:24.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f194ce62640 1 --2- 172.21.15.94:0/1318455764 >> [v2:172.21.15.111:6802/1054925605,v1:172.21.15.111:6803/1054925605] conn(0x7f1934071df0 0x7f1934074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f82a0d9f640 1 -- 172.21.15.94:0/4252220397 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f829c0c40d0 msgr2=0x7f829c152300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f82a0d9f640 1 --2- 172.21.15.94:0/4252220397 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f829c0c40d0 0x7f829c152300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f82a0d9f640 1 -- 172.21.15.94:0/4252220397 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f829c15f670 msgr2=0x7f829c15d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f82a0d9f640 1 --2- 172.21.15.94:0/4252220397 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f829c15f670 0x7f829c15d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f82a0d9f640 1 -- 172.21.15.94:0/4252220397 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829c152840 con 0x7f829c200e90 2024-04-25T12:24:24.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f8ab5d9b640 1 -- 172.21.15.94:0/1822196911 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8ab0046570 msgr2=0x7f8ab01643d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T12:24:24.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f8ab5d9b640 1 --2- 172.21.15.94:0/1822196911 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8ab0046570 0x7f8ab01643d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f8ab5d9b640 1 -- 172.21.15.94:0/1822196911 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ab0048360 msgr2=0x7f8ab00367d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f8ab5d9b640 1 --2- 172.21.15.94:0/1822196911 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8ab0048360 0x7f8ab00367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f8ab5d9b640 1 -- 172.21.15.94:0/1822196911 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab0008580 con 0x7f8ab0047d70 2024-04-25T12:24:24.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f9d0a220640 1 -- 172.21.15.94:0/2403463493 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9d04076360 con 0x7f9d040c92f0 2024-04-25T12:24:24.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f82a0d9f640 1 --2- 172.21.15.94:0/4252220397 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f829c200e90 0x7f829c201340 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f829000e880 tx=0x7f829000ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7fe0498ce640 1 --2- 172.21.15.94:0/997469390 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe03c0d4b50 0x7fe03c0d4fa0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe0440512e0 tx=0x7fe044098bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2972cda53a6b8e82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f8ab5d9b640 1 --2- 172.21.15.94:0/1822196911 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8ab0047d70 0x7f8ab0048ec0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80512e0 tx=0x7f8ab806db60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f8aa6ffd640 1 -- 172.21.15.94:0/1822196911 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab80693c0 con 0x7f8ab0047d70 2024-04-25T12:24:24.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f8aa6ffd640 1 -- 172.21.15.94:0/1822196911 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ab8069560 con 0x7f8ab0047d70 2024-04-25T12:24:24.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f8ab759e640 1 -- 172.21.15.94:0/1822196911 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab0161fb0 con 0x7f8ab0047d70 2024-04-25T12:24:24.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f8ab759e640 1 -- 172.21.15.94:0/1822196911 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab0163bd0 con 0x7f8ab0047d70 2024-04-25T12:24:24.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f8298ff9640 1 -- 172.21.15.94:0/4252220397 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8290017070 con 0x7f829c200e90 2024-04-25T12:24:24.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f19477fe640 1 --2- 172.21.15.94:0/1318455764 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f19340683d0 0x7f193406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f194ce62640 1 --2- 172.21.15.94:0/1318455764 >> [v2:172.21.15.111:6802/1054925605,v1:172.21.15.111:6803/1054925605] conn(0x7f1934071df0 0x7f1934074290 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7fc75dd55640 1 Processor -- start 2024-04-25T12:24:24.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7fc75dd55640 1 -- start start 2024-04-25T12:24:24.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7fc75dd55640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc7580c8f90 0x7fc7580cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7fc75dd55640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc758151f80 0x7fc7581f8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7fc75dd55640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7580c5250 0x7fc7581f87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7fc75dd55640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc7580c98f0 con 0x7fc7580c5250 2024-04-25T12:24:24.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7fc75dd55640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc758072e70 con 0x7fc758151f80 2024-04-25T12:24:24.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7fc75dd55640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fc7580c9a70 con 0x7fc7580c8f90 2024-04-25T12:24:24.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7f19477fe640 1 --2- 172.21.15.94:0/1318455764 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f19340683d0 0x7f193406a890 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f194816a660 tx=0x7f193c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f63dd7fa640 1 -- 172.21.15.94:0/1221363427 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f63d80c2020 con 0x7f63e015c360 2024-04-25T12:24:24.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7f63dd7fa640 1 --2- 172.21.15.94:0/1221363427 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f63c4068380 0x7f63c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7f63dd7fa640 1 -- 172.21.15.94:0/1221363427 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f63d8125910 con 0x7f63e015c360 2024-04-25T12:24:24.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7f63dd7fa640 1 --2- 172.21.15.94:0/1221363427 >> [v2:172.21.15.94:6808/2553247564,v1:172.21.15.94:6809/2553247564] conn(0x7f63c4071d20 0x7f63c40741c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7f63dd7fa640 1 -- 172.21.15.94:0/1221363427 --> [v2:172.21.15.94:6808/2553247564,v1:172.21.15.94:6809/2553247564] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63d80b7e50 con 0x7f63c4071d20 2024-04-25T12:24:24.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7f63dd7fa640 1 -- 172.21.15.94:0/1221363427 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f63d8125da0 con 0x7f63e015c360 2024-04-25T12:24:24.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7f63dffff640 1 --2- 172.21.15.94:0/1221363427 >> [v2:172.21.15.94:6808/2553247564,v1:172.21.15.94:6809/2553247564] conn(0x7f63c4071d20 0x7f63c40741c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7f63e4d7b640 1 --2- 172.21.15.94:0/1221363427 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f63c4068380 0x7f63c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7f63dffff640 1 --2- 172.21.15.94:0/1221363427 >> [v2:172.21.15.94:6808/2553247564,v1:172.21.15.94:6809/2553247564] conn(0x7f63c4071d20 0x7f63c40741c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7f63e4d7b640 1 --2- 172.21.15.94:0/1221363427 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f63c4068380 0x7f63c406a840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f63cc000f70 tx=0x7f63cc007e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f8298ff9640 1 -- 172.21.15.94:0/4252220397 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f829000c940 con 0x7f829c200e90 2024-04-25T12:24:24.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f8298ff9640 1 -- 172.21.15.94:0/4252220397 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829000cd30 con 0x7f829c200e90 2024-04-25T12:24:24.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7f82a15a0640 1 -- 172.21.15.94:0/4252220397 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f829c201880 con 0x7f829c200e90 2024-04-25T12:24:24.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7f82a15a0640 1 -- 172.21.15.94:0/4252220397 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f829c15ef20 con 0x7f829c200e90 2024-04-25T12:24:24.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7f82a15a0640 1 -- 172.21.15.94:0/4252220397 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f829c15f160 con 0x7f829c200e90 2024-04-25T12:24:24.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f8aa6ffd640 1 -- 172.21.15.94:0/1822196911 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8069b50 con 0x7f8ab0047d70 2024-04-25T12:24:24.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f8ab759e640 1 -- 172.21.15.94:0/1822196911 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8ab0037540 con 0x7f8ab0047d70 2024-04-25T12:24:24.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f9cf9ffb640 1 -- 172.21.15.94:0/2403463493 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9d000e6ab0 con 0x7f9d040c92f0 2024-04-25T12:24:24.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.679+0000 7f9cf9ffb640 1 --2- 172.21.15.94:0/2403463493 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f9ce80683b0 0x7f9ce806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7f9cf9ffb640 1 -- 172.21.15.94:0/2403463493 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f9d0012cb20 con 0x7f9d040c92f0 2024-04-25T12:24:24.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7f9cf9ffb640 1 --2- 172.21.15.94:0/2403463493 >> [v2:172.21.15.94:6817/1548488434,v1:172.21.15.94:6819/1548488434] conn(0x7f9ce8071d50 0x7f9ce80741f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7f9cf9ffb640 1 -- 172.21.15.94:0/2403463493 --> [v2:172.21.15.94:6817/1548488434,v1:172.21.15.94:6819/1548488434] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d000cce70 con 0x7f9ce8071d50 2024-04-25T12:24:24.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7f9cf9ffb640 1 -- 172.21.15.94:0/2403463493 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9d0012cf10 con 0x7f9d040c92f0 2024-04-25T12:24:24.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7f9d08a1d640 1 --2- 172.21.15.94:0/2403463493 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f9ce80683b0 0x7f9ce806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7f9d09a1f640 1 --2- 172.21.15.94:0/2403463493 >> [v2:172.21.15.94:6817/1548488434,v1:172.21.15.94:6819/1548488434] conn(0x7f9ce8071d50 0x7f9ce80741f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7f9d09a1f640 1 --2- 172.21.15.94:0/2403463493 >> [v2:172.21.15.94:6817/1548488434,v1:172.21.15.94:6819/1548488434] conn(0x7f9ce8071d50 0x7f9ce80741f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7f9d08a1d640 1 --2- 172.21.15.94:0/2403463493 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f9ce80683b0 0x7f9ce806a870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9d04148240 tx=0x7f9cf4009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7fc75d554640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7580c5250 0x7fc7581f87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7fc75d554640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7580c5250 0x7fc7581f87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51904/0 (socket says 172.21.15.94:51904) 2024-04-25T12:24:24.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7fc75d554640 1 -- 172.21.15.94:0/1031048227 learned_addr learned my addr 172.21.15.94:0/1031048227 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:24.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7fc75cd53640 1 --2- 172.21.15.94:0/1031048227 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc7580c8f90 0x7fc7580cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7fc75d554640 1 -- 172.21.15.94:0/1031048227 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc7580c8f90 msgr2=0x7fc7580cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7fc75d554640 1 --2- 172.21.15.94:0/1031048227 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc7580c8f90 0x7fc7580cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7fc75d554640 1 -- 172.21.15.94:0/1031048227 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc758151f80 msgr2=0x7fc7581f8280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T12:24:24.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7fc75d554640 1 --2- 172.21.15.94:0/1031048227 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc758151f80 0x7fc7581f8280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7fc75d554640 1 -- 172.21.15.94:0/1031048227 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75814bfc0 con 0x7fc7580c5250 2024-04-25T12:24:24.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7fc75d554640 1 --2- 172.21.15.94:0/1031048227 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7580c5250 0x7fc7581f87c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc75000c730 tx=0x7fc75000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7effccff9640 1 -- 172.21.15.94:0/1048390002 <== osd.6 v2:172.21.15.111:6824/3619235078 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7effc801de80 con 0x7effbc071e20 2024-04-25T12:24:24.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7fe03bfff640 1 -- 172.21.15.94:0/997469390 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe044121810 con 0x7fe03c0d4b50 2024-04-25T12:24:24.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7fe03bfff640 1 -- 172.21.15.94:0/997469390 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0441219f0 con 0x7fe03c0d4b50 2024-04-25T12:24:24.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7fe03bfff640 1 -- 172.21.15.94:0/997469390 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe044121e60 con 0x7fe03c0d4b50 2024-04-25T12:24:24.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7f63dd7fa640 1 -- 172.21.15.94:0/1221363427 <== osd.0 v2:172.21.15.94:6808/2553247564 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f63d80b7e50 con 0x7f63c4071d20 2024-04-25T12:24:24.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7f9cf9ffb640 1 -- 172.21.15.94:0/2403463493 <== osd.3 v2:172.21.15.94:6817/1548488434 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9d000cce70 con 0x7f9ce8071d50 2024-04-25T12:24:24.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7fc7557fa640 1 -- 172.21.15.94:0/1031048227 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc750003b80 con 0x7fc7580c5250 2024-04-25T12:24:24.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7fc7557fa640 1 -- 172.21.15.94:0/1031048227 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc750003d20 con 0x7fc7580c5250 2024-04-25T12:24:24.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7fc75dd55640 1 -- 172.21.15.94:0/1031048227 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc75814c2a0 con 0x7fc7580c5250 2024-04-25T12:24:24.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7fc75dd55640 1 -- 172.21.15.94:0/1031048227 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7580c3d70 con 0x7fc7580c5250 2024-04-25T12:24:24.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7fc7557fa640 1 -- 172.21.15.94:0/1031048227 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc750005310 con 0x7fc7580c5250 2024-04-25T12:24:24.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7fc75dd55640 1 -- 172.21.15.94:0/1031048227 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc7580c4430 con 0x7fc7580c5250 2024-04-25T12:24:24.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7f1944ff9640 1 -- 172.21.15.94:0/1318455764 <== osd.5 v2:172.21.15.111:6802/1054925605 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f19380bbe80 con 0x7f1934071df0 2024-04-25T12:24:24.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7fc7557fa640 1 -- 172.21.15.94:0/1031048227 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc7500054b0 con 0x7fc7580c5250 2024-04-25T12:24:24.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7fc7557fa640 1 --2- 172.21.15.94:0/1031048227 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc73c068450 0x7fc73c06a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7fc7557fa640 1 -- 172.21.15.94:0/1031048227 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fc750087660 con 0x7fc7580c5250 2024-04-25T12:24:24.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7fc7557fa640 1 --2- 172.21.15.94:0/1031048227 >> [v2:172.21.15.111:6811/4070977083,v1:172.21.15.111:6814/4070977083] conn(0x7fc73c071e60 0x7fc73c074300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7fc7557fa640 1 -- 172.21.15.94:0/1031048227 --> [v2:172.21.15.111:6811/4070977083,v1:172.21.15.111:6814/4070977083] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc73c0749d0 con 0x7fc73c071e60 2024-04-25T12:24:24.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7fc7557fa640 1 -- 172.21.15.94:0/1031048227 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc750087a50 con 0x7fc7580c5250 2024-04-25T12:24:24.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7fc75cd53640 1 --2- 172.21.15.94:0/1031048227 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc73c068450 0x7fc73c06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7fc75cd53640 1 --2- 172.21.15.94:0/1031048227 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc73c068450 0x7fc73c06a910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc74c007ab0 tx=0x7fc74c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7fc757fff640 1 --2- 172.21.15.94:0/1031048227 >> [v2:172.21.15.111:6811/4070977083,v1:172.21.15.111:6814/4070977083] conn(0x7fc73c071e60 0x7fc73c074300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7f8298ff9640 1 -- 172.21.15.94:0/4252220397 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f829001a070 con 0x7f829c200e90 2024-04-25T12:24:24.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7f8298ff9640 1 --2- 172.21.15.94:0/4252220397 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f82880683b0 0x7f828806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7f8298ff9640 1 -- 172.21.15.94:0/4252220397 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f82900871a0 con 0x7f829c200e90 2024-04-25T12:24:24.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7f8298ff9640 1 --2- 172.21.15.94:0/4252220397 >> [v2:172.21.15.94:6816/2492806478,v1:172.21.15.94:6818/2492806478] conn(0x7f8288071d40 0x7f82880741e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7f8298ff9640 1 -- 172.21.15.94:0/4252220397 --> [v2:172.21.15.94:6816/2492806478,v1:172.21.15.94:6818/2492806478] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f829000e020 con 0x7f8288071d40 2024-04-25T12:24:24.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7f8298ff9640 1 -- 172.21.15.94:0/4252220397 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8290087590 con 0x7f829c200e90 2024-04-25T12:24:24.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7f829b7fe640 1 --2- 172.21.15.94:0/4252220397 >> [v2:172.21.15.94:6816/2492806478,v1:172.21.15.94:6818/2492806478] conn(0x7f8288071d40 0x7f82880741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7f829b7fe640 1 --2- 172.21.15.94:0/4252220397 >> [v2:172.21.15.94:6816/2492806478,v1:172.21.15.94:6818/2492806478] conn(0x7f8288071d40 0x7f82880741e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7f829bfff640 1 --2- 172.21.15.94:0/4252220397 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f82880683b0 0x7f828806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7f829bfff640 1 --2- 172.21.15.94:0/4252220397 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f82880683b0 0x7f828806a870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f828c00a7d0 tx=0x7f828c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7f8298ff9640 1 -- 172.21.15.94:0/4252220397 <== osd.1 v2:172.21.15.94:6816/2492806478 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f829000e020 con 0x7f8288071d40 2024-04-25T12:24:24.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7fe04b331640 1 -- 172.21.15.94:0/997469390 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe03c0d4b50 msgr2=0x7fe03c0d4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.683+0000 7fe04b331640 1 --2- 172.21.15.94:0/997469390 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe03c0d4b50 0x7fe03c0d4fa0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe0440512e0 tx=0x7fe044098bb0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7fe04b331640 1 -- 172.21.15.94:0/997469390 shutdown_connections 2024-04-25T12:24:24.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7fe04b331640 1 --2- 172.21.15.94:0/997469390 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe03c0d4b50 0x7fe03c0d4fa0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7fe04b331640 1 -- 172.21.15.94:0/997469390 >> 172.21.15.94:0/997469390 conn(0x7fe03c050190 msgr2=0x7fe03c0505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:24.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.691+0000 7fe04b331640 1 -- 172.21.15.94:0/997469390 shutdown_connections 2024-04-25T12:24:24.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.691+0000 7fe04b331640 1 -- 172.21.15.94:0/997469390 wait complete. 2024-04-25T12:24:24.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.691+0000 7fc757fff640 1 --2- 172.21.15.94:0/1031048227 >> [v2:172.21.15.111:6811/4070977083,v1:172.21.15.111:6814/4070977083] conn(0x7fc73c071e60 0x7fc73c074300 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.691+0000 7fe04b331640 1 Processor -- start 2024-04-25T12:24:24.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.691+0000 7fe04b331640 1 -- start start 2024-04-25T12:24:24.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.691+0000 7fc7557fa640 1 -- 172.21.15.94:0/1031048227 <== osd.4 v2:172.21.15.111:6811/4070977083 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc73c0749d0 con 0x7fc73c071e60 2024-04-25T12:24:24.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.691+0000 7fe04b331640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe03c00e2b0 0x7fe03c0d7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.691+0000 7fe0490cd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe03c00e2b0 0x7fe03c0d7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.691+0000 7fe0490cd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe03c00e2b0 0x7fe03c0d7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51908/0 (socket says 172.21.15.94:51908) 2024-04-25T12:24:24.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.691+0000 7fe0490cd640 1 -- 172.21.15.94:0/2679989032 learned_addr learned my addr 172.21.15.94:0/2679989032 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:24.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.691+0000 7fe04b331640 1 --2- 172.21.15.94:0/2679989032 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe03c046d80 0x7fe03c0ddd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.691+0000 7fe04b331640 1 --2- 172.21.15.94:0/2679989032 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe03c0d4b50 0x7fe03c177440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.691+0000 7fe04b331640 1 -- 172.21.15.94:0/2679989032 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c0468f0 con 0x7fe03c00e2b0 2024-04-25T12:24:24.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.691+0000 7fe04b331640 1 -- 172.21.15.94:0/2679989032 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c0db760 con 0x7fe03c046d80 2024-04-25T12:24:24.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.691+0000 7fe04b331640 1 -- 172.21.15.94:0/2679989032 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe03c04c940 con 0x7fe03c0d4b50 2024-04-25T12:24:24.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7f8aa6ffd640 1 -- 172.21.15.94:0/1822196911 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8ab8069cf0 con 0x7f8ab0047d70 2024-04-25T12:24:24.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7f8aa6ffd640 1 --2- 172.21.15.94:0/1822196911 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8a980683b0 0x7f8a9806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7f8aa6ffd640 1 -- 172.21.15.94:0/1822196911 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f8ab81037c0 con 0x7f8ab0047d70 2024-04-25T12:24:24.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7f8aa6ffd640 1 --2- 172.21.15.94:0/1822196911 >> [v2:172.21.15.94:6800/1485061290,v1:172.21.15.94:6801/1485061290] conn(0x7f8a98071dd0 0x7f8a98074270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7f8aa6ffd640 1 -- 172.21.15.94:0/1822196911 --> [v2:172.21.15.94:6800/1485061290,v1:172.21.15.94:6801/1485061290] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a98074940 con 0x7f8a98071dd0 2024-04-25T12:24:24.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7f8aa6ffd640 1 -- 172.21.15.94:0/1822196911 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8ab8103bb0 con 0x7f8ab0047d70 2024-04-25T12:24:24.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7f8ab6d9d640 1 --2- 172.21.15.94:0/1822196911 >> [v2:172.21.15.94:6800/1485061290,v1:172.21.15.94:6801/1485061290] conn(0x7f8a98071dd0 0x7f8a98074270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.687+0000 7f8ab659c640 1 --2- 172.21.15.94:0/1822196911 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8a980683b0 0x7f8a9806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.691+0000 7f8ab6d9d640 1 --2- 172.21.15.94:0/1822196911 >> [v2:172.21.15.94:6800/1485061290,v1:172.21.15.94:6801/1485061290] conn(0x7f8a98071dd0 0x7f8a98074270 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.691+0000 7f8ab659c640 1 --2- 172.21.15.94:0/1822196911 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8a980683b0 0x7f8a9806a870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0b3000 tx=0x7f8aac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.691+0000 7f8aa6ffd640 1 -- 172.21.15.94:0/1822196911 <== osd.2 v2:172.21.15.94:6800/1485061290 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8a98074940 con 0x7f8a98071dd0 2024-04-25T12:24:24.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.695+0000 7fe0490cd640 1 -- 172.21.15.94:0/2679989032 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe03c0d4b50 msgr2=0x7fe03c177440 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T12:24:24.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.695+0000 7fe0490cd640 1 --2- 172.21.15.94:0/2679989032 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe03c0d4b50 0x7fe03c177440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.695+0000 7fe0490cd640 1 -- 172.21.15.94:0/2679989032 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe03c046d80 msgr2=0x7fe03c0ddd20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T12:24:24.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.695+0000 7fe0490cd640 1 --2- 172.21.15.94:0/2679989032 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe03c046d80 0x7fe03c0ddd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.695+0000 7fe0490cd640 1 -- 172.21.15.94:0/2679989032 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe03c0dd3b0 con 0x7fe03c00e2b0 2024-04-25T12:24:24.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.695+0000 7fe0490cd640 1 --2- 172.21.15.94:0/2679989032 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe03c00e2b0 0x7fe03c0d7d30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe03400c500 tx=0x7fe03400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.695+0000 7fe039ffb640 1 -- 172.21.15.94:0/2679989032 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe034018070 con 0x7fe03c00e2b0 2024-04-25T12:24:24.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.695+0000 7fe039ffb640 1 -- 172.21.15.94:0/2679989032 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe034007500 con 0x7fe03c00e2b0 2024-04-25T12:24:24.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.695+0000 7fe04b331640 1 -- 172.21.15.94:0/2679989032 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe03c0dd650 con 0x7fe03c00e2b0 2024-04-25T12:24:24.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.695+0000 7fe039ffb640 1 -- 172.21.15.94:0/2679989032 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe034004a30 con 0x7fe03c00e2b0 2024-04-25T12:24:24.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.695+0000 7fe04b331640 1 -- 172.21.15.94:0/2679989032 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe03c174220 con 0x7fe03c00e2b0 2024-04-25T12:24:24.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.695+0000 7fe039ffb640 1 -- 172.21.15.94:0/2679989032 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe03401b070 con 0x7fe03c00e2b0 2024-04-25T12:24:24.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.695+0000 7fe04b331640 1 -- 172.21.15.94:0/2679989032 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe03c0053a0 con 0x7fe03c00e2b0 2024-04-25T12:24:24.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.695+0000 7fe039ffb640 1 --2- 172.21.15.94:0/2679989032 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe0280683b0 0x7fe02806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.699+0000 7fe039ffb640 1 -- 172.21.15.94:0/2679989032 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fe0340861f0 con 0x7fe03c00e2b0 2024-04-25T12:24:24.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.699+0000 7fe0488cc640 1 --2- 172.21.15.94:0/2679989032 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe0280683b0 0x7fe02806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.699+0000 7fe039ffb640 1 --2- 172.21.15.94:0/2679989032 >> [v2:172.21.15.111:6800/558758517,v1:172.21.15.111:6801/558758517] conn(0x7fe028071d40 0x7fe0280741e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.699+0000 7fe039ffb640 1 -- 172.21.15.94:0/2679989032 --> [v2:172.21.15.111:6800/558758517,v1:172.21.15.111:6801/558758517] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe0280748b0 con 0x7fe028071d40 2024-04-25T12:24:24.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.699+0000 7fe039ffb640 1 -- 172.21.15.94:0/2679989032 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe03408d050 con 0x7fe03c00e2b0 2024-04-25T12:24:24.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.699+0000 7fe0488cc640 1 --2- 172.21.15.94:0/2679989032 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe0280683b0 0x7fe02806a870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe040006fd0 tx=0x7fe040006bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.699+0000 7fe0498ce640 1 --2- 172.21.15.94:0/2679989032 >> [v2:172.21.15.111:6800/558758517,v1:172.21.15.111:6801/558758517] conn(0x7fe028071d40 0x7fe0280741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.699+0000 7fe0498ce640 1 --2- 172.21.15.94:0/2679989032 >> [v2:172.21.15.111:6800/558758517,v1:172.21.15.111:6801/558758517] conn(0x7fe028071d40 0x7fe0280741e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.699+0000 7fe039ffb640 1 -- 172.21.15.94:0/2679989032 <== osd.7 v2:172.21.15.111:6800/558758517 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe0280748b0 con 0x7fe028071d40 2024-04-25T12:24:24.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.703+0000 7f9d0a220640 1 -- 172.21.15.94:0/2403463493 --> [v2:172.21.15.94:6817/1548488434,v1:172.21.15.94:6819/1548488434] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9d040c8190 con 0x7f9ce8071d50 2024-04-25T12:24:24.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.707+0000 7f9cf9ffb640 1 -- 172.21.15.94:0/2403463493 <== osd.3 v2:172.21.15.94:6817/1548488434 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9d040c8190 con 0x7f9ce8071d50 2024-04-25T12:24:24.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.707+0000 7f9d0a220640 1 -- 172.21.15.94:0/2403463493 >> [v2:172.21.15.94:6817/1548488434,v1:172.21.15.94:6819/1548488434] conn(0x7f9ce8071d50 msgr2=0x7f9ce80741f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.707+0000 7f9d0a220640 1 --2- 172.21.15.94:0/2403463493 >> [v2:172.21.15.94:6817/1548488434,v1:172.21.15.94:6819/1548488434] conn(0x7f9ce8071d50 0x7f9ce80741f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.707+0000 7f9d0a220640 1 -- 172.21.15.94:0/2403463493 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f9ce80683b0 msgr2=0x7f9ce806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.707+0000 7f9d0a220640 1 --2- 172.21.15.94:0/2403463493 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f9ce80683b0 0x7f9ce806a870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9d04148240 tx=0x7f9cf4009060 comp rx=0 tx=0).stop 2024-04-25T12:24:24.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.707+0000 7f9d0a220640 1 -- 172.21.15.94:0/2403463493 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d040c92f0 msgr2=0x7f9d04071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.707+0000 7f9d0a220640 1 --2- 172.21.15.94:0/2403463493 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d040c92f0 0x7f9d04071de0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9d00025090 tx=0x7f9d00024200 comp rx=0 tx=0).stop 2024-04-25T12:24:24.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.707+0000 7f9d09a1f640 1 -- 172.21.15.94:0/2403463493 reap_dead start 2024-04-25T12:24:24.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.707+0000 7f9d0a220640 1 -- 172.21.15.94:0/2403463493 shutdown_connections 2024-04-25T12:24:24.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.707+0000 7f9d0a220640 1 -- 172.21.15.94:0/2403463493 >> 172.21.15.94:0/2403463493 conn(0x7f9d0406eb20 msgr2=0x7f9d040c4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:24.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.707+0000 7f9d0a220640 1 -- 172.21.15.94:0/2403463493 shutdown_connections 2024-04-25T12:24:24.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.707+0000 7f9d0a220640 1 -- 172.21.15.94:0/2403463493 wait complete. 2024-04-25T12:24:24.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.703+0000 7effd5419640 1 -- 172.21.15.94:0/1048390002 --> [v2:172.21.15.111:6824/3619235078,v1:172.21.15.111:6825/3619235078] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7effd0069b50 con 0x7effbc071e20 2024-04-25T12:24:24.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.703+0000 7effccff9640 1 -- 172.21.15.94:0/1048390002 <== osd.6 v2:172.21.15.111:6824/3619235078 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7effd0069b50 con 0x7effbc071e20 2024-04-25T12:24:24.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.703+0000 7effd5419640 1 -- 172.21.15.94:0/1048390002 >> [v2:172.21.15.111:6824/3619235078,v1:172.21.15.111:6825/3619235078] conn(0x7effbc071e20 msgr2=0x7effbc0742c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.703+0000 7effd5419640 1 --2- 172.21.15.94:0/1048390002 >> [v2:172.21.15.111:6824/3619235078,v1:172.21.15.111:6825/3619235078] conn(0x7effbc071e20 0x7effbc0742c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.703+0000 7effd5419640 1 -- 172.21.15.94:0/1048390002 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7effbc068480 msgr2=0x7effbc06a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.703+0000 7effd5419640 1 --2- 172.21.15.94:0/1048390002 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7effbc068480 0x7effbc06a940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7effc4007fd0 tx=0x7effc4009040 comp rx=0 tx=0).stop 2024-04-25T12:24:24.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.703+0000 7effd5419640 1 -- 172.21.15.94:0/1048390002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effd0159c40 msgr2=0x7effd01f4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.703+0000 7effd5419640 1 --2- 172.21.15.94:0/1048390002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effd0159c40 0x7effd01f4c40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7effd0074740 tx=0x7effc80115a0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.711+0000 7f194e8c5640 1 -- 172.21.15.94:0/1318455764 --> [v2:172.21.15.111:6802/1054925605,v1:172.21.15.111:6803/1054925605] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f194816d840 con 0x7f1934071df0 2024-04-25T12:24:24.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.711+0000 7f1944ff9640 1 -- 172.21.15.94:0/1318455764 <== osd.5 v2:172.21.15.111:6802/1054925605 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f194816d840 con 0x7f1934071df0 2024-04-25T12:24:24.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f194e8c5640 1 -- 172.21.15.94:0/1318455764 >> [v2:172.21.15.111:6802/1054925605,v1:172.21.15.111:6803/1054925605] conn(0x7f1934071df0 msgr2=0x7f1934074290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f194e8c5640 1 --2- 172.21.15.94:0/1318455764 >> [v2:172.21.15.111:6802/1054925605,v1:172.21.15.111:6803/1054925605] conn(0x7f1934071df0 0x7f1934074290 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f194e8c5640 1 -- 172.21.15.94:0/1318455764 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f19340683d0 msgr2=0x7f193406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f194e8c5640 1 --2- 172.21.15.94:0/1318455764 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f19340683d0 0x7f193406a890 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f194816a660 tx=0x7f193c009040 comp rx=0 tx=0).stop 2024-04-25T12:24:24.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f194e8c5640 1 -- 172.21.15.94:0/1318455764 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f194806f700 msgr2=0x7f1948173ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f194e8c5640 1 --2- 172.21.15.94:0/1318455764 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f194806f700 0x7f1948173ec0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f193801a030 tx=0x7f19380191a0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f194ce62640 1 -- 172.21.15.94:0/1318455764 reap_dead start 2024-04-25T12:24:24.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f194e8c5640 1 -- 172.21.15.94:0/1318455764 shutdown_connections 2024-04-25T12:24:24.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f194e8c5640 1 -- 172.21.15.94:0/1318455764 >> 172.21.15.94:0/1318455764 conn(0x7f194806b9d0 msgr2=0x7f1948073b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:24.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f194e8c5640 1 -- 172.21.15.94:0/1318455764 shutdown_connections 2024-04-25T12:24:24.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f194e8c5640 1 -- 172.21.15.94:0/1318455764 wait complete. 2024-04-25T12:24:24.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f63e6fdf640 1 -- 172.21.15.94:0/1221363427 --> [v2:172.21.15.94:6808/2553247564,v1:172.21.15.94:6809/2553247564] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f63e0076440 con 0x7f63c4071d20 2024-04-25T12:24:24.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f82a15a0640 1 -- 172.21.15.94:0/4252220397 --> [v2:172.21.15.94:6816/2492806478,v1:172.21.15.94:6818/2492806478] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f829c15f160 con 0x7f8288071d40 2024-04-25T12:24:24.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f63dd7fa640 1 -- 172.21.15.94:0/1221363427 <== osd.0 v2:172.21.15.94:6808/2553247564 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f63e0076440 con 0x7f63c4071d20 2024-04-25T12:24:24.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f8298ff9640 1 -- 172.21.15.94:0/4252220397 <== osd.1 v2:172.21.15.94:6816/2492806478 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f829c15f160 con 0x7f8288071d40 2024-04-25T12:24:24.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f82a15a0640 1 -- 172.21.15.94:0/4252220397 >> [v2:172.21.15.94:6816/2492806478,v1:172.21.15.94:6818/2492806478] conn(0x7f8288071d40 msgr2=0x7f82880741e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f82a15a0640 1 --2- 172.21.15.94:0/4252220397 >> [v2:172.21.15.94:6816/2492806478,v1:172.21.15.94:6818/2492806478] conn(0x7f8288071d40 0x7f82880741e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f63e6fdf640 1 -- 172.21.15.94:0/1221363427 >> [v2:172.21.15.94:6808/2553247564,v1:172.21.15.94:6809/2553247564] conn(0x7f63c4071d20 msgr2=0x7f63c40741c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f63e6fdf640 1 --2- 172.21.15.94:0/1221363427 >> [v2:172.21.15.94:6808/2553247564,v1:172.21.15.94:6809/2553247564] conn(0x7f63c4071d20 0x7f63c40741c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f82a15a0640 1 -- 172.21.15.94:0/4252220397 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f82880683b0 msgr2=0x7f828806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f82a15a0640 1 --2- 172.21.15.94:0/4252220397 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f82880683b0 0x7f828806a870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f828c00a7d0 tx=0x7f828c008040 comp rx=0 tx=0).stop 2024-04-25T12:24:24.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f82a15a0640 1 -- 172.21.15.94:0/4252220397 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f829c200e90 msgr2=0x7f829c201340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f82a15a0640 1 --2- 172.21.15.94:0/4252220397 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f829c200e90 0x7f829c201340 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f829000e880 tx=0x7f829000ed40 comp rx=0 tx=0).stop 2024-04-25T12:24:24.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f82a0d9f640 1 -- 172.21.15.94:0/4252220397 reap_dead start 2024-04-25T12:24:24.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f63e6fdf640 1 -- 172.21.15.94:0/1221363427 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f63c4068380 msgr2=0x7f63c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f63e6fdf640 1 --2- 172.21.15.94:0/1221363427 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f63c4068380 0x7f63c406a840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f63cc000f70 tx=0x7f63cc007e90 comp rx=0 tx=0).stop 2024-04-25T12:24:24.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f82a15a0640 1 -- 172.21.15.94:0/4252220397 shutdown_connections 2024-04-25T12:24:24.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f82a15a0640 1 -- 172.21.15.94:0/4252220397 >> 172.21.15.94:0/4252220397 conn(0x7f829c0c9330 msgr2=0x7f829c1548c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:24.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f63e6fdf640 1 -- 172.21.15.94:0/1221363427 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63e015c360 msgr2=0x7f63e014af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f63e6fdf640 1 --2- 172.21.15.94:0/1221363427 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63e015c360 0x7f63e014af20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f63d80b2040 tx=0x7f63d801bef0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f82a15a0640 1 -- 172.21.15.94:0/4252220397 shutdown_connections 2024-04-25T12:24:24.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f82a15a0640 1 -- 172.21.15.94:0/4252220397 wait complete. 2024-04-25T12:24:24.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7effd4c18640 1 -- 172.21.15.94:0/1048390002 reap_dead start 2024-04-25T12:24:24.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7effd5419640 1 -- 172.21.15.94:0/1048390002 shutdown_connections 2024-04-25T12:24:24.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7effd5419640 1 -- 172.21.15.94:0/1048390002 >> 172.21.15.94:0/1048390002 conn(0x7effd00c9f10 msgr2=0x7effd006c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:24.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f63e557c640 1 -- 172.21.15.94:0/1221363427 reap_dead start 2024-04-25T12:24:24.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f63e6fdf640 1 -- 172.21.15.94:0/1221363427 shutdown_connections 2024-04-25T12:24:24.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7f63e6fdf640 1 -- 172.21.15.94:0/1221363427 >> 172.21.15.94:0/1221363427 conn(0x7f63e006f0a0 msgr2=0x7f63e0152450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:24.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7effd5419640 1 -- 172.21.15.94:0/1048390002 shutdown_connections 2024-04-25T12:24:24.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.715+0000 7effd5419640 1 -- 172.21.15.94:0/1048390002 wait complete. 2024-04-25T12:24:24.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.719+0000 7f8ab759e640 1 -- 172.21.15.94:0/1822196911 --> [v2:172.21.15.94:6800/1485061290,v1:172.21.15.94:6801/1485061290] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8ab004c4a0 con 0x7f8a98071dd0 2024-04-25T12:24:24.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.723+0000 7f8aa6ffd640 1 -- 172.21.15.94:0/1822196911 <== osd.2 v2:172.21.15.94:6800/1485061290 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8ab004c4a0 con 0x7f8a98071dd0 2024-04-25T12:24:24.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.723+0000 7f8ab759e640 1 -- 172.21.15.94:0/1822196911 >> [v2:172.21.15.94:6800/1485061290,v1:172.21.15.94:6801/1485061290] conn(0x7f8a98071dd0 msgr2=0x7f8a98074270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.723+0000 7f8ab759e640 1 --2- 172.21.15.94:0/1822196911 >> [v2:172.21.15.94:6800/1485061290,v1:172.21.15.94:6801/1485061290] conn(0x7f8a98071dd0 0x7f8a98074270 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.723+0000 7f63e6fdf640 1 -- 172.21.15.94:0/1221363427 shutdown_connections 2024-04-25T12:24:24.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.723+0000 7f8ab759e640 1 -- 172.21.15.94:0/1822196911 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8a980683b0 msgr2=0x7f8a9806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.723+0000 7f8ab759e640 1 --2- 172.21.15.94:0/1822196911 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8a980683b0 0x7f8a9806a870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0b3000 tx=0x7f8aac008040 comp rx=0 tx=0).stop 2024-04-25T12:24:24.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.723+0000 7f8ab759e640 1 -- 172.21.15.94:0/1822196911 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8ab0047d70 msgr2=0x7f8ab0048ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.723+0000 7f8ab759e640 1 --2- 172.21.15.94:0/1822196911 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8ab0047d70 0x7f8ab0048ec0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80512e0 tx=0x7f8ab806db60 comp rx=0 tx=0).stop 2024-04-25T12:24:24.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.723+0000 7f8ab6d9d640 1 -- 172.21.15.94:0/1822196911 reap_dead start 2024-04-25T12:24:24.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.723+0000 7f63e6fdf640 1 -- 172.21.15.94:0/1221363427 wait complete. 2024-04-25T12:24:24.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.727+0000 7f8ab759e640 1 -- 172.21.15.94:0/1822196911 shutdown_connections 2024-04-25T12:24:24.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.727+0000 7f8ab759e640 1 -- 172.21.15.94:0/1822196911 >> 172.21.15.94:0/1822196911 conn(0x7f8ab00512b0 msgr2=0x7f8ab00d0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:24.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.727+0000 7f8ab759e640 1 -- 172.21.15.94:0/1822196911 shutdown_connections 2024-04-25T12:24:24.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.727+0000 7f8ab759e640 1 -- 172.21.15.94:0/1822196911 wait complete. 2024-04-25T12:24:24.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.731+0000 7fc75dd55640 1 -- 172.21.15.94:0/1031048227 --> [v2:172.21.15.111:6811/4070977083,v1:172.21.15.111:6814/4070977083] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc758076360 con 0x7fc73c071e60 2024-04-25T12:24:24.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.731+0000 7fc7557fa640 1 -- 172.21.15.94:0/1031048227 <== osd.4 v2:172.21.15.111:6811/4070977083 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc758076360 con 0x7fc73c071e60 2024-04-25T12:24:24.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.731+0000 7fc75dd55640 1 -- 172.21.15.94:0/1031048227 >> [v2:172.21.15.111:6811/4070977083,v1:172.21.15.111:6814/4070977083] conn(0x7fc73c071e60 msgr2=0x7fc73c074300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.731+0000 7fc75dd55640 1 --2- 172.21.15.94:0/1031048227 >> [v2:172.21.15.111:6811/4070977083,v1:172.21.15.111:6814/4070977083] conn(0x7fc73c071e60 0x7fc73c074300 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.731+0000 7fc75dd55640 1 -- 172.21.15.94:0/1031048227 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc73c068450 msgr2=0x7fc73c06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.731+0000 7fc75dd55640 1 --2- 172.21.15.94:0/1031048227 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc73c068450 0x7fc73c06a910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc74c007ab0 tx=0x7fc74c009040 comp rx=0 tx=0).stop 2024-04-25T12:24:24.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.731+0000 7fc75dd55640 1 -- 172.21.15.94:0/1031048227 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7580c5250 msgr2=0x7fc7581f87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.731+0000 7fc75dd55640 1 --2- 172.21.15.94:0/1031048227 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7580c5250 0x7fc7581f87c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc75000c730 tx=0x7fc75000cbf0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.731+0000 7fc75d554640 1 -- 172.21.15.94:0/1031048227 reap_dead start 2024-04-25T12:24:24.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.731+0000 7fc75dd55640 1 -- 172.21.15.94:0/1031048227 shutdown_connections 2024-04-25T12:24:24.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.731+0000 7fc75dd55640 1 -- 172.21.15.94:0/1031048227 >> 172.21.15.94:0/1031048227 conn(0x7fc75806f940 msgr2=0x7fc7581582f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:24.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.731+0000 7fc75dd55640 1 -- 172.21.15.94:0/1031048227 shutdown_connections 2024-04-25T12:24:24.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.731+0000 7fc75dd55640 1 -- 172.21.15.94:0/1031048227 wait complete. 2024-04-25T12:24:24.768 INFO:teuthology.orchestra.run.smithi094.stdout:60129542179 2024-04-25T12:24:24.769 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T12:24:24.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.739+0000 7fe04b331640 1 -- 172.21.15.94:0/2679989032 --> [v2:172.21.15.111:6800/558758517,v1:172.21.15.111:6801/558758517] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe03c0459c0 con 0x7fe028071d40 2024-04-25T12:24:24.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.739+0000 7fe039ffb640 1 -- 172.21.15.94:0/2679989032 <== osd.7 v2:172.21.15.111:6800/558758517 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe03c0459c0 con 0x7fe028071d40 2024-04-25T12:24:24.770 INFO:teuthology.orchestra.run.smithi094.stdout:60129542179 2024-04-25T12:24:24.771 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T12:24:24.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.743+0000 7fe04b331640 1 -- 172.21.15.94:0/2679989032 >> [v2:172.21.15.111:6800/558758517,v1:172.21.15.111:6801/558758517] conn(0x7fe028071d40 msgr2=0x7fe0280741e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.743+0000 7fe04b331640 1 --2- 172.21.15.94:0/2679989032 >> [v2:172.21.15.111:6800/558758517,v1:172.21.15.111:6801/558758517] conn(0x7fe028071d40 0x7fe0280741e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.743+0000 7fe04b331640 1 -- 172.21.15.94:0/2679989032 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe0280683b0 msgr2=0x7fe02806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.743+0000 7fe04b331640 1 --2- 172.21.15.94:0/2679989032 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe0280683b0 0x7fe02806a870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe040006fd0 tx=0x7fe040006bc0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.743+0000 7fe04b331640 1 -- 172.21.15.94:0/2679989032 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe03c00e2b0 msgr2=0x7fe03c0d7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.743+0000 7fe04b331640 1 --2- 172.21.15.94:0/2679989032 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe03c00e2b0 0x7fe03c0d7d30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe03400c500 tx=0x7fe03400c9c0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.743+0000 7fe0498ce640 1 -- 172.21.15.94:0/2679989032 reap_dead start 2024-04-25T12:24:24.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.743+0000 7fe04b331640 1 -- 172.21.15.94:0/2679989032 shutdown_connections 2024-04-25T12:24:24.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.743+0000 7fe04b331640 1 -- 172.21.15.94:0/2679989032 >> 172.21.15.94:0/2679989032 conn(0x7fe03c050190 msgr2=0x7fe03c0d9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:24.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.743+0000 7fe04b331640 1 -- 172.21.15.94:0/2679989032 shutdown_connections 2024-04-25T12:24:24.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.743+0000 7fe04b331640 1 -- 172.21.15.94:0/2679989032 wait complete. 2024-04-25T12:24:24.773 INFO:teuthology.orchestra.run.smithi094.stdout:68719476771 2024-04-25T12:24:24.773 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T12:24:24.774 INFO:teuthology.orchestra.run.smithi094.stdout:68719476772 2024-04-25T12:24:24.774 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T12:24:24.775 INFO:teuthology.orchestra.run.smithi094.stdout:60129542179 2024-04-25T12:24:24.775 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T12:24:24.776 INFO:teuthology.orchestra.run.smithi094.stdout:68719476770 2024-04-25T12:24:24.776 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T12:24:24.777 INFO:teuthology.orchestra.run.smithi094.stdout:60129542180 2024-04-25T12:24:24.777 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T12:24:24.778 INFO:teuthology.orchestra.run.smithi094.stdout:68719476771 2024-04-25T12:24:24.779 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T12:24:24.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.979+0000 7f3983e77640 1 Processor -- start 2024-04-25T12:24:24.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.979+0000 7f3983e77640 1 -- start start 2024-04-25T12:24:24.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.979+0000 7f3983e77640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f397c0c6ba0 0x7f397c074190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.979+0000 7f3983e77640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f397c071c60 0x7f397c072110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.979+0000 7f3983e77640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f397c1580e0 con 0x7f397c151a60 2024-04-25T12:24:24.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.979+0000 7f3983e77640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f397c0c0c40 con 0x7f397c071c60 2024-04-25T12:24:24.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.979+0000 7f3983e77640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f397c06e720 con 0x7f397c0c6ba0 2024-04-25T12:24:24.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.979+0000 7f3982414640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f397c071c60 0x7f397c072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.979+0000 7f3982414640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f397c071c60 0x7f397c072110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.94:53600/0 (socket says 172.21.15.94:53600) 2024-04-25T12:24:24.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.979+0000 7f3981c13640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f397c151a60 0x7f397c0c9130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.94:35952/0 (socket says 172.21.15.94:35952) 2024-04-25T12:24:24.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.979+0000 7f3982414640 1 -- 172.21.15.94:0/1568825700 learned_addr learned my addr 172.21.15.94:0/1568825700 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:24.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.979+0000 7f3981412640 1 --2- 172.21.15.94:0/1568825700 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f397c0c6ba0 0x7f397c074190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.979+0000 7f3982414640 1 -- 172.21.15.94:0/1568825700 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f397c0c6ba0 msgr2=0x7f397c074190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:24.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.979+0000 7f3982414640 1 --2- 172.21.15.94:0/1568825700 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f397c0c6ba0 0x7f397c074190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.979+0000 7f3982414640 1 -- 172.21.15.94:0/1568825700 >> v1:172.21.15.111:6789/0 conn(0x7f397c151a60 legacy=0x7f397c0c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.979+0000 7ff49c355640 1 Processor -- start 2024-04-25T12:24:24.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.979+0000 7ff49c355640 1 -- start start 2024-04-25T12:24:24.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7ff49c355640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff494067900 0x7ff49415f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7ff49c355640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff4940ccc20 0x7ff49415f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7ff49c355640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4940b5060 con 0x7ff494067ce0 2024-04-25T12:24:24.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7ff49c355640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7ff4940b30e0 con 0x7ff4940ccc20 2024-04-25T12:24:24.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7ff49c355640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7ff4940b3380 con 0x7ff494067900 2024-04-25T12:24:24.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7ff49a8f2640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7ff494067ce0 0x7ff494159170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39282/0 (socket says 172.21.15.94:39282) 2024-04-25T12:24:24.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7ff49a8f2640 1 -- 172.21.15.94:0/2837234719 learned_addr learned my addr 172.21.15.94:0/2837234719 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:24.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7ff4998f0640 1 --2- 172.21.15.94:0/2837234719 >> v2:172.21.15.94:3300/0 conn(0x7ff4940ccc20 0x7ff49415f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7ff49a0f1640 1 --2- 172.21.15.94:0/2837234719 >> v2:172.21.15.111:3300/0 conn(0x7ff494067900 0x7ff49415f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.979+0000 7f3980c11640 1 -- 172.21.15.94:0/1568825700 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2896059551 0 0) 0x7f397c1580e0 con 0x7f397c151a60 2024-04-25T12:24:24.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.979+0000 7f3982414640 1 -- 172.21.15.94:0/1568825700 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397c071980 con 0x7f397c071c60 2024-04-25T12:24:24.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7f3981412640 1 --2- 172.21.15.94:0/1568825700 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f397c0c6ba0 0x7f397c074190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:24.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7ff4990ef640 1 -- 172.21.15.94:0/2837234719 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 668905718 0 0) 0x7ff4940b5060 con 0x7ff494067ce0 2024-04-25T12:24:24.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7ff4990ef640 1 -- 172.21.15.94:0/2837234719 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff480003530 con 0x7ff494067ce0 2024-04-25T12:24:24.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7efde878d640 1 Processor -- start 2024-04-25T12:24:24.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7fd21cbd9640 1 Processor -- start 2024-04-25T12:24:24.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7fd21cbd9640 1 -- start start 2024-04-25T12:24:24.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7fd21cbd9640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2180c92b0 0x7fd2180c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7fd21cbd9640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2180c45e0 con 0x7fd2180c9690 2024-04-25T12:24:24.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7fd21cbd9640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd21816b270 con 0x7fd2180c89c0 2024-04-25T12:24:24.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7fd21cbd9640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd21816b550 con 0x7fd2180c92b0 2024-04-25T12:24:24.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7fd2177fe640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2180c92b0 0x7fd2180c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7fd2177fe640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2180c92b0 0x7fd2180c3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.94:50102/0 (socket says 172.21.15.94:50102) 2024-04-25T12:24:24.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7fd2177fe640 1 -- 172.21.15.94:0/1152225882 learned_addr learned my addr 172.21.15.94:0/1152225882 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:24.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7ff49a0f1640 1 -- 172.21.15.94:0/2837234719 >> v2:172.21.15.94:3300/0 conn(0x7ff4940ccc20 msgr2=0x7ff49415f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:24.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7ff49a0f1640 1 --2- 172.21.15.94:0/2837234719 >> v2:172.21.15.94:3300/0 conn(0x7ff4940ccc20 0x7ff49415f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7ff49a0f1640 1 -- 172.21.15.94:0/2837234719 >> v1:172.21.15.94:6789/0 conn(0x7ff494067ce0 legacy=0x7ff494159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7ff49a0f1640 1 -- 172.21.15.94:0/2837234719 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4940b52d0 con 0x7ff494067900 2024-04-25T12:24:24.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7fd2177fe640 1 -- 172.21.15.94:0/1152225882 >> v1:172.21.15.111:6789/0 conn(0x7fd2180c89c0 legacy=0x7fd218167d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7fd2177fe640 1 -- 172.21.15.94:0/1152225882 >> v1:172.21.15.94:6789/0 conn(0x7fd2180c9690 legacy=0x7fd218164e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7fd2177fe640 1 -- 172.21.15.94:0/1152225882 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21816b830 con 0x7fd2180c92b0 2024-04-25T12:24:24.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7f3982414640 1 --2- 172.21.15.94:0/1568825700 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f397c071c60 0x7f397c072110 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3974009e50 tx=0x7f397401d440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=151aa466bbd49213 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7efde878d640 1 -- start start 2024-04-25T12:24:24.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7efde878d640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efde0157100 0x7efde0072510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7efde878d640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efde0071a50 con 0x7efde01512d0 2024-04-25T12:24:24.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7efde878d640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efde00c77e0 con 0x7efde0072a50 2024-04-25T12:24:24.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7efde878d640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7efde00c7ac0 con 0x7efde0157100 2024-04-25T12:24:24.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7f3980c11640 1 -- 172.21.15.94:0/1568825700 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39740a5780 con 0x7f397c071c60 2024-04-25T12:24:24.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7efde6529640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7efde01512d0 0x7efde00c6f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39302/0 (socket says 172.21.15.94:39302) 2024-04-25T12:24:24.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7efde6529640 1 -- 172.21.15.94:0/2673798291 learned_addr learned my addr 172.21.15.94:0/2673798291 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:24.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7f3980c11640 1 -- 172.21.15.94:0/1568825700 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39740a5920 con 0x7f397c071c60 2024-04-25T12:24:24.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7f3980c11640 1 -- 172.21.15.94:0/1568825700 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39740a5cf0 con 0x7f397c071c60 2024-04-25T12:24:24.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7efde5527640 1 -- 172.21.15.94:0/2673798291 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2058951724 0 0) 0x7efde0071a50 con 0x7efde01512d0 2024-04-25T12:24:24.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7efde5527640 1 -- 172.21.15.94:0/2673798291 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdcc004640 con 0x7efde01512d0 2024-04-25T12:24:24.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7efde5527640 1 -- 172.21.15.94:0/2673798291 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 535312100 0 0) 0x7efdcc004640 con 0x7efde01512d0 2024-04-25T12:24:24.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7efde5527640 1 -- 172.21.15.94:0/2673798291 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efde0157100 msgr2=0x7efde0072510 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T12:24:24.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7efde5527640 1 --2- 172.21.15.94:0/2673798291 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efde0157100 0x7efde0072510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7efde5527640 1 -- 172.21.15.94:0/2673798291 >> v1:172.21.15.111:6789/0 conn(0x7efde0072a50 legacy=0x7efde0070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3983e77640 1 -- 172.21.15.94:0/1568825700 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f397c071c60 msgr2=0x7f397c072110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:24.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3983e77640 1 --2- 172.21.15.94:0/1568825700 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f397c071c60 0x7f397c072110 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3974009e50 tx=0x7f397401d440 comp rx=0 tx=0).stop 2024-04-25T12:24:24.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3983e77640 1 -- 172.21.15.94:0/1568825700 shutdown_connections 2024-04-25T12:24:24.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3983e77640 1 --2- 172.21.15.94:0/1568825700 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f397c071c60 0x7f397c072110 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3983e77640 1 --2- 172.21.15.94:0/1568825700 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f397c0c6ba0 0x7f397c074190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:24.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3983e77640 1 -- 172.21.15.94:0/1568825700 >> 172.21.15.94:0/1568825700 conn(0x7f397c06f280 msgr2=0x7f397c06f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:24.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3983e77640 1 -- 172.21.15.94:0/1568825700 shutdown_connections 2024-04-25T12:24:24.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3983e77640 1 -- 172.21.15.94:0/1568825700 wait complete. 2024-04-25T12:24:24.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7ff49a0f1640 1 --2- 172.21.15.94:0/2837234719 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff494067900 0x7ff49415f390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009d90 tx=0x7ff48c01c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efb4fc29675de883 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:24.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7feeadfed640 1 Processor -- start 2024-04-25T12:24:24.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7feeadfed640 1 -- start start 2024-04-25T12:24:24.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7feeadfed640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7feea816b580 0x7feea816b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7feeadfed640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7feea80c3250 0x7feea8164f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:24.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3920862640 1 Processor -- start 2024-04-25T12:24:24.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7feea77fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7feea816b580 0x7feea816b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:24.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7feea77fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7feea816b580 0x7feea816b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51936/0 (socket says 172.21.15.94:51936) 2024-04-25T12:24:25.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7feea77fe640 1 -- 172.21.15.94:0/3309138614 learned_addr learned my addr 172.21.15.94:0/3309138614 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:25.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7feeadfed640 1 -- 172.21.15.94:0/3309138614 --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feea816c1d0 con 0x7feea80c9b70 2024-04-25T12:24:25.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7feeadfed640 1 -- 172.21.15.94:0/3309138614 --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7feea80c7180 con 0x7feea816b580 2024-04-25T12:24:25.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7feeadfed640 1 -- 172.21.15.94:0/3309138614 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7feea806f040 con 0x7feea80c3250 2024-04-25T12:24:25.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7fee9effd640 1 --2- 172.21.15.94:0/3309138614 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7feea80c3250 0x7feea8164f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7ff4990ef640 1 -- 172.21.15.94:0/2837234719 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c0b2070 con 0x7ff494067900 2024-04-25T12:24:25.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7ff4990ef640 1 -- 172.21.15.94:0/2837234719 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff48c0a5810 con 0x7ff494067900 2024-04-25T12:24:25.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7ff4990ef640 1 -- 172.21.15.94:0/2837234719 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c0a5be0 con 0x7ff494067900 2024-04-25T12:24:25.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7feea6ffd640 1 -- 172.21.15.94:0/3309138614 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1657590025 0 0) 0x7feea816c1d0 con 0x7feea80c9b70 2024-04-25T12:24:25.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7feea6ffd640 1 -- 172.21.15.94:0/3309138614 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee94003430 con 0x7feea80c9b70 2024-04-25T12:24:25.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7feea77fe640 1 -- 172.21.15.94:0/3309138614 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7feea80c3250 msgr2=0x7feea8164f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:25.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.983+0000 7feea77fe640 1 --2- 172.21.15.94:0/3309138614 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7feea80c3250 0x7feea8164f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7feea77fe640 1 -- 172.21.15.94:0/3309138614 >> v1:172.21.15.94:6789/0 conn(0x7feea80c9b70 legacy=0x7feea80c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7feea6ffd640 1 -- 172.21.15.94:0/3309138614 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2897466741 0 0) 0x7fee94003430 con 0x7feea80c9b70 2024-04-25T12:24:25.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7feea77fe640 1 -- 172.21.15.94:0/3309138614 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea806f320 con 0x7feea816b580 2024-04-25T12:24:25.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3209aef640 1 Processor -- start 2024-04-25T12:24:25.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3209aef640 1 -- start start 2024-04-25T12:24:25.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7ff49c355640 1 -- 172.21.15.94:0/2837234719 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff494067900 msgr2=0x7ff49415f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7ff49c355640 1 --2- 172.21.15.94:0/2837234719 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff494067900 0x7ff49415f390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009d90 tx=0x7ff48c01c880 comp rx=0 tx=0).stop 2024-04-25T12:24:25.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7efde5527640 1 -- 172.21.15.94:0/2673798291 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde00c7da0 con 0x7efde01512d0 2024-04-25T12:24:25.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7efde5527640 1 -- 172.21.15.94:0/2673798291 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7efdd8005060 con 0x7efde01512d0 2024-04-25T12:24:25.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7efde5527640 1 -- 172.21.15.94:0/2673798291 >> v1:172.21.15.94:6789/0 conn(0x7efde01512d0 legacy=0x7efde00c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7efde5527640 1 --2- 172.21.15.94:0/2673798291 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efdcc004b00 0x7efdcc004f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7efde5527640 1 --2- 172.21.15.94:0/2673798291 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efdcc005920 0x7efdcc005da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7efde5527640 1 --2- 172.21.15.94:0/2673798291 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efde0157100 0x7efdcc0062e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7efde5527640 1 -- 172.21.15.94:0/2673798291 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7efde00c7ac0 con 0x7efdcc005920 2024-04-25T12:24:25.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7efde5527640 1 -- 172.21.15.94:0/2673798291 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc003520 con 0x7efdcc004b00 2024-04-25T12:24:25.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7efde5527640 1 -- 172.21.15.94:0/2673798291 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7efdcc003720 con 0x7efde0157100 2024-04-25T12:24:25.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3983e77640 1 Processor -- start 2024-04-25T12:24:25.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f6b124dd640 1 Processor -- start 2024-04-25T12:24:25.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7efde5d28640 1 --2- 172.21.15.94:0/2673798291 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efdcc005920 0x7efdcc005da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3920862640 1 -- start start 2024-04-25T12:24:25.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3920862640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f391c0c89c0 0x7f391c0c9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3920862640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f391c0c9590 0x7f391c162c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3920862640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f391c15f3e0 con 0x7f391c159570 2024-04-25T12:24:25.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3920862640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f391c160240 con 0x7f391c0c89c0 2024-04-25T12:24:25.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3920862640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f391c15f6c0 con 0x7f391c0c9590 2024-04-25T12:24:25.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f391a59c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f391c0c89c0 0x7f391c0c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f391a59c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f391c0c89c0 0x7f391c0c9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51940/0 (socket says 172.21.15.94:51940) 2024-04-25T12:24:25.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f391a59c640 1 -- 172.21.15.94:0/3880253222 learned_addr learned my addr 172.21.15.94:0/3880253222 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:25.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7efde6d2a640 1 --2- 172.21.15.94:0/2673798291 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efde0157100 0x7efdcc0062e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7efde6529640 1 --2- 172.21.15.94:0/2673798291 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efdcc004b00 0x7efdcc004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7ff49c355640 1 -- 172.21.15.94:0/2837234719 shutdown_connections 2024-04-25T12:24:25.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7ff49c355640 1 --2- 172.21.15.94:0/2837234719 >> v2:172.21.15.94:3300/0 conn(0x7ff4940ccc20 0x7ff49415f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7ff49c355640 1 --2- 172.21.15.94:0/2837234719 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff494067900 0x7ff49415f390 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7ff49c355640 1 -- 172.21.15.94:0/2837234719 >> 172.21.15.94:0/2837234719 conn(0x7ff49406d9c0 msgr2=0x7ff4940d07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:25.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7fd2177fe640 1 --2- 172.21.15.94:0/1152225882 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2180c92b0 0x7fd2180c3ac0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd20800aac0 tx=0x7fd208023450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e2d03c5a1f27e60 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:25.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f391a59c640 1 -- 172.21.15.94:0/3880253222 >> v2:172.21.15.111:3300/0 conn(0x7f391c0c9590 msgr2=0x7f391c162c40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T12:24:25.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f391a59c640 1 --2- 172.21.15.94:0/3880253222 >> v2:172.21.15.111:3300/0 conn(0x7f391c0c9590 0x7f391c162c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f391a59c640 1 -- 172.21.15.94:0/3880253222 >> v1:172.21.15.111:6789/0 conn(0x7f391c159570 legacy=0x7f391c0c75c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T12:24:25.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f391a59c640 1 -- 172.21.15.94:0/3880253222 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f391c15f9a0 con 0x7f391c0c89c0 2024-04-25T12:24:25.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7efde6d2a640 1 -- 172.21.15.94:0/2673798291 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efdcc004b00 msgr2=0x7efdcc004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:25.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7efde6d2a640 1 --2- 172.21.15.94:0/2673798291 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efdcc004b00 0x7efdcc004f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7efde6d2a640 1 -- 172.21.15.94:0/2673798291 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efdcc005920 msgr2=0x7efdcc005da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:25.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7efde6d2a640 1 --2- 172.21.15.94:0/2673798291 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efdcc005920 0x7efdcc005da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7efde6d2a640 1 -- 172.21.15.94:0/2673798291 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdcc004640 con 0x7efde0157100 2024-04-25T12:24:25.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3983e77640 1 -- start start 2024-04-25T12:24:25.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3983e77640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f397c071c60 0x7f397c0c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3983e77640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f397c0c6ba0 0x7f397c0cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3981c13640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f397c071c60 0x7f397c0c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3983e77640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f397c151a60 0x7f397c1499c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3983e77640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f397c0727d0 con 0x7f397c151a60 2024-04-25T12:24:25.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3983e77640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f397c072650 con 0x7f397c071c60 2024-04-25T12:24:25.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3981c13640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f397c071c60 0x7f397c0c5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.94:53646/0 (socket says 172.21.15.94:53646) 2024-04-25T12:24:25.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3983e77640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f397c0c0820 con 0x7f397c0c6ba0 2024-04-25T12:24:25.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3981c13640 1 -- 172.21.15.94:0/805966569 learned_addr learned my addr 172.21.15.94:0/805966569 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:25.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3982414640 1 --2- 172.21.15.94:0/805966569 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f397c151a60 0x7f397c1499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3981412640 1 --2- 172.21.15.94:0/805966569 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f397c0c6ba0 0x7f397c0cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3982414640 1 -- 172.21.15.94:0/805966569 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f397c0c6ba0 msgr2=0x7f397c0cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3982414640 1 --2- 172.21.15.94:0/805966569 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f397c0c6ba0 0x7f397c0cc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3982414640 1 -- 172.21.15.94:0/805966569 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f397c071c60 msgr2=0x7f397c0c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3982414640 1 --2- 172.21.15.94:0/805966569 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f397c071c60 0x7f397c0c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3982414640 1 -- 172.21.15.94:0/805966569 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397c0c6370 con 0x7f397c151a60 2024-04-25T12:24:25.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3982414640 1 --2- 172.21.15.94:0/805966569 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f397c151a60 0x7f397c1499c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f397c0caa80 tx=0x7f3974019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:25.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f39727fc640 1 -- 172.21.15.94:0/805966569 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39740bb070 con 0x7f397c151a60 2024-04-25T12:24:25.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f6b124dd640 1 -- start start 2024-04-25T12:24:25.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f6b124dd640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b0c162c40 0x7f6b0c163070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f6b124dd640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b0c1635b0 con 0x7f6b0c0c89c0 2024-04-25T12:24:25.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f6b124dd640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b0c15f3e0 con 0x7f6b0c159570 2024-04-25T12:24:25.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f6b124dd640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6b0c160240 con 0x7f6b0c162c40 2024-04-25T12:24:25.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f6b114db640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f6b0c159570 0x7f6b0c0c75c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.94:35998/0 (socket says 172.21.15.94:35998) 2024-04-25T12:24:25.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f6b114db640 1 -- 172.21.15.94:0/4054764799 learned_addr learned my addr 172.21.15.94:0/4054764799 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:25.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f6b11cdc640 1 --2- 172.21.15.94:0/4054764799 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b0c162c40 0x7f6b0c163070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f6b03fff640 1 -- 172.21.15.94:0/4054764799 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2153799092 0 0) 0x7f6b0c15f3e0 con 0x7f6b0c159570 2024-04-25T12:24:25.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f6b03fff640 1 -- 172.21.15.94:0/4054764799 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6af8003530 con 0x7f6b0c159570 2024-04-25T12:24:25.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3209aef640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f32040cb7d0 0x7f3204154de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3209aef640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f32040cbbb0 0x7f3204155320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3209aef640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32040c7f60 con 0x7f32040ca9a0 2024-04-25T12:24:25.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3209aef640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f320415b060 con 0x7f32040cb7d0 2024-04-25T12:24:25.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3209aef640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f32040c8200 con 0x7f32040cbbb0 2024-04-25T12:24:25.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3202ffd640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f32040cbbb0 0x7f3204155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3202ffd640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f32040cbbb0 0x7f3204155320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.94:53640/0 (socket says 172.21.15.94:53640) 2024-04-25T12:24:25.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f3202ffd640 1 -- 172.21.15.94:0/4175577136 learned_addr learned my addr 172.21.15.94:0/4175577136 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:25.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7f32037fe640 1 --2- 172.21.15.94:0/4175577136 >> v2:172.21.15.94:3300/0 conn(0x7f32040cb7d0 0x7f3204154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7fd2167fc640 1 -- 172.21.15.94:0/1152225882 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2080ba070 con 0x7fd2180c92b0 2024-04-25T12:24:25.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7fd2167fc640 1 -- 172.21.15.94:0/1152225882 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2080b5410 con 0x7fd2180c92b0 2024-04-25T12:24:25.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7fd2167fc640 1 -- 172.21.15.94:0/1152225882 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2080b5800 con 0x7fd2180c92b0 2024-04-25T12:24:25.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7fd21cbd9640 1 -- 172.21.15.94:0/1152225882 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2180c92b0 msgr2=0x7fd2180c3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7fd21cbd9640 1 --2- 172.21.15.94:0/1152225882 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2180c92b0 0x7fd2180c3ac0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd20800aac0 tx=0x7fd208023450 comp rx=0 tx=0).stop 2024-04-25T12:24:25.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3983e77640 1 -- 172.21.15.94:0/805966569 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f397c14ebf0 con 0x7f397c151a60 2024-04-25T12:24:25.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3983e77640 1 -- 172.21.15.94:0/805966569 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f397c14b110 con 0x7f397c151a60 2024-04-25T12:24:25.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f39727fc640 1 -- 172.21.15.94:0/805966569 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3974003ba0 con 0x7f397c151a60 2024-04-25T12:24:25.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f39727fc640 1 -- 172.21.15.94:0/805966569 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3974004030 con 0x7f397c151a60 2024-04-25T12:24:25.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7fd21cbd9640 1 -- 172.21.15.94:0/1152225882 shutdown_connections 2024-04-25T12:24:25.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7fd21cbd9640 1 --2- 172.21.15.94:0/1152225882 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2180c92b0 0x7fd2180c3ac0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7fd21cbd9640 1 -- 172.21.15.94:0/1152225882 >> 172.21.15.94:0/1152225882 conn(0x7fd21806eb20 msgr2=0x7fd21806ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:25.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7ff49c355640 1 -- 172.21.15.94:0/2837234719 shutdown_connections 2024-04-25T12:24:25.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7ff49c355640 1 -- 172.21.15.94:0/2837234719 wait complete. 2024-04-25T12:24:25.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f39727fc640 1 -- 172.21.15.94:0/805966569 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f39740041d0 con 0x7f397c151a60 2024-04-25T12:24:25.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.987+0000 7feea77fe640 1 --2- 172.21.15.94:0/3309138614 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feea816b580 0x7feea816b960 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fee98013d10 tx=0x7fee98024d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a6ba65df941f6fd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:25.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7feea6ffd640 1 -- 172.21.15.94:0/3309138614 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea0001a00 con 0x7feea816b580 2024-04-25T12:24:25.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7feea6ffd640 1 -- 172.21.15.94:0/3309138614 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee9800ae50 con 0x7feea816b580 2024-04-25T12:24:25.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7feea6ffd640 1 -- 172.21.15.94:0/3309138614 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee980adbf0 con 0x7feea816b580 2024-04-25T12:24:25.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3202ffd640 1 -- 172.21.15.94:0/4175577136 >> v2:172.21.15.94:3300/0 conn(0x7f32040cb7d0 msgr2=0x7f3204154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:25.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3202ffd640 1 --2- 172.21.15.94:0/4175577136 >> v2:172.21.15.94:3300/0 conn(0x7f32040cb7d0 0x7f3204154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3202ffd640 1 -- 172.21.15.94:0/4175577136 >> v1:172.21.15.111:6789/0 conn(0x7f32040ca9a0 legacy=0x7f32040c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3202ffd640 1 -- 172.21.15.94:0/4175577136 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32040c84e0 con 0x7f32040cbbb0 2024-04-25T12:24:25.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3202ffd640 1 --2- 172.21.15.94:0/4175577136 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f32040cbbb0 0x7f3204155320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3204074710 tx=0x7f31f001c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8f01ef3554257c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:25.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f39727fc640 1 --2- 172.21.15.94:0/805966569 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f39600683b0 0x7f396006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f6b11cdc640 1 -- 172.21.15.94:0/4054764799 >> v1:172.21.15.111:6789/0 conn(0x7f6b0c159570 legacy=0x7f6b0c0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f6b11cdc640 1 -- 172.21.15.94:0/4054764799 >> v1:172.21.15.94:6789/0 conn(0x7f6b0c0c89c0 legacy=0x7f6b0c0c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:25.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f6b11cdc640 1 -- 172.21.15.94:0/4054764799 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0c15f6c0 con 0x7f6b0c162c40 2024-04-25T12:24:25.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7fd21cbd9640 1 -- 172.21.15.94:0/1152225882 shutdown_connections 2024-04-25T12:24:25.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f39727fc640 1 -- 172.21.15.94:0/805966569 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f3974121770 con 0x7f397c151a60 2024-04-25T12:24:25.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7efde6d2a640 1 --2- 172.21.15.94:0/2673798291 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efde0157100 0x7efdcc0062e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efddc001750 tx=0x7efddc01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c89c3f0ef172459a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:25.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7efde5527640 1 -- 172.21.15.94:0/2673798291 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc0013a0 con 0x7efde0157100 2024-04-25T12:24:25.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7efde5527640 1 -- 172.21.15.94:0/2673798291 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efddc0052f0 con 0x7efde0157100 2024-04-25T12:24:25.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7efde5527640 1 -- 172.21.15.94:0/2673798291 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc003840 con 0x7efde0157100 2024-04-25T12:24:25.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f32027fc640 1 -- 172.21.15.94:0/4175577136 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f00b1070 con 0x7f32040cbbb0 2024-04-25T12:24:25.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f391a59c640 1 --2- 172.21.15.94:0/3880253222 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f391c0c89c0 0x7f391c0c9050 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f391c0c3690 tx=0x7f390c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=849d4a9152a2147c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:25.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3919d9b640 1 -- 172.21.15.94:0/3880253222 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c0b0070 con 0x7f391c0c89c0 2024-04-25T12:24:25.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3919d9b640 1 -- 172.21.15.94:0/3880253222 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f390c0ab600 con 0x7f391c0c89c0 2024-04-25T12:24:25.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3919d9b640 1 -- 172.21.15.94:0/3880253222 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c0ab9d0 con 0x7f391c0c89c0 2024-04-25T12:24:25.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3920862640 1 -- 172.21.15.94:0/3880253222 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f391c0c89c0 msgr2=0x7f391c0c9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3920862640 1 --2- 172.21.15.94:0/3880253222 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f391c0c89c0 0x7f391c0c9050 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f391c0c3690 tx=0x7f390c01c500 comp rx=0 tx=0).stop 2024-04-25T12:24:25.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3920862640 1 -- 172.21.15.94:0/3880253222 shutdown_connections 2024-04-25T12:24:25.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3920862640 1 --2- 172.21.15.94:0/3880253222 >> v2:172.21.15.111:3300/0 conn(0x7f391c0c9590 0x7f391c162c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3920862640 1 --2- 172.21.15.94:0/3880253222 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f391c0c89c0 0x7f391c0c9050 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.991+0000 7f3920862640 1 -- 172.21.15.94:0/3880253222 >> 172.21.15.94:0/3880253222 conn(0x7f391c06eb20 msgr2=0x7f391c06ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:25.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7f32027fc640 1 -- 172.21.15.94:0/4175577136 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31f00a8050 con 0x7f32040cbbb0 2024-04-25T12:24:25.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7f3981c13640 1 --2- 172.21.15.94:0/805966569 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f39600683b0 0x7f396006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7efde878d640 1 -- 172.21.15.94:0/2673798291 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efde0157100 msgr2=0x7efdcc0062e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7efde878d640 1 --2- 172.21.15.94:0/2673798291 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efde0157100 0x7efdcc0062e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efddc001750 tx=0x7efddc01c400 comp rx=0 tx=0).stop 2024-04-25T12:24:25.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7efde6d2a640 1 -- 172.21.15.94:0/2673798291 reap_dead start 2024-04-25T12:24:25.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7ff49c355640 1 Processor -- start 2024-04-25T12:24:25.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7efde878d640 1 -- 172.21.15.94:0/2673798291 shutdown_connections 2024-04-25T12:24:25.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7efde878d640 1 -- 172.21.15.94:0/2673798291 >> 172.21.15.94:0/2673798291 conn(0x7efde00c9050 msgr2=0x7efde00c9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:25.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7f3983e77640 1 -- 172.21.15.94:0/805966569 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39640052a0 con 0x7f397c151a60 2024-04-25T12:24:25.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7efde878d640 1 -- 172.21.15.94:0/2673798291 shutdown_connections 2024-04-25T12:24:25.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7efde878d640 1 -- 172.21.15.94:0/2673798291 wait complete. 2024-04-25T12:24:25.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7efde878d640 1 Processor -- start 2024-04-25T12:24:25.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7ff49c355640 1 -- start start 2024-04-25T12:24:25.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7ff49c355640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff494067900 0x7ff49415b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7ff49c355640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff494067ce0 0x7ff494145c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7ff49c355640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff4940ccc20 0x7ff49415c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7ff49c355640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff4940b38f0 con 0x7ff494067ce0 2024-04-25T12:24:25.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7ff49c355640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff4940b3770 con 0x7ff4940ccc20 2024-04-25T12:24:25.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7ff49c355640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff4940b3a70 con 0x7ff494067900 2024-04-25T12:24:25.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7ff49a0f1640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff494067900 0x7ff49415b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7ff49a8f2640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff4940ccc20 0x7ff49415c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7ff49a0f1640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff494067900 0x7ff49415b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.94:50168/0 (socket says 172.21.15.94:50168) 2024-04-25T12:24:25.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7ff49a0f1640 1 -- 172.21.15.94:0/1511167725 learned_addr learned my addr 172.21.15.94:0/1511167725 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:25.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7ff49a8f2640 1 -- 172.21.15.94:0/1511167725 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff494067900 msgr2=0x7ff49415b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7ff49a8f2640 1 --2- 172.21.15.94:0/1511167725 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff494067900 0x7ff49415b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7ff49a8f2640 1 -- 172.21.15.94:0/1511167725 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff494067ce0 msgr2=0x7ff494145c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7ff49a8f2640 1 --2- 172.21.15.94:0/1511167725 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff494067ce0 0x7ff494145c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7ff49a8f2640 1 -- 172.21.15.94:0/1511167725 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff494159e70 con 0x7ff4940ccc20 2024-04-25T12:24:25.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7ff49a8f2640 1 --2- 172.21.15.94:0/1511167725 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff4940ccc20 0x7ff49415c210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff48400c3e0 tx=0x7ff48400c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:25.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7ff48affd640 1 -- 172.21.15.94:0/1511167725 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4840074e0 con 0x7ff4940ccc20 2024-04-25T12:24:25.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7f3981c13640 1 --2- 172.21.15.94:0/805966569 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f39600683b0 0x7f396006a870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f396c000f70 tx=0x7f396c007e20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:25.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7feeadfed640 1 -- 172.21.15.94:0/3309138614 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feea816b580 msgr2=0x7feea816b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7feeadfed640 1 --2- 172.21.15.94:0/3309138614 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feea816b580 0x7feea816b960 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fee98013d10 tx=0x7fee98024d30 comp rx=0 tx=0).stop 2024-04-25T12:24:25.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7feeadfed640 1 -- 172.21.15.94:0/3309138614 shutdown_connections 2024-04-25T12:24:25.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7feeadfed640 1 --2- 172.21.15.94:0/3309138614 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7feea80c3250 0x7feea8164f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7feeadfed640 1 --2- 172.21.15.94:0/3309138614 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feea816b580 0x7feea816b960 secure :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fee98013d10 tx=0x7fee98024d30 comp rx=0 tx=0).stop 2024-04-25T12:24:25.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7feeadfed640 1 -- 172.21.15.94:0/3309138614 >> 172.21.15.94:0/3309138614 conn(0x7feea80c9050 msgr2=0x7feea80c9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:25.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7f6b11cdc640 1 --2- 172.21.15.94:0/4054764799 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b0c162c40 0x7f6b0c163070 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6b080097f0 tx=0x7f6b0801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6c3965baa7df761 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:25.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7f6b03fff640 1 -- 172.21.15.94:0/4054764799 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b080b2070 con 0x7f6b0c162c40 2024-04-25T12:24:25.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7f6b03fff640 1 -- 172.21.15.94:0/4054764799 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b080ad640 con 0x7f6b0c162c40 2024-04-25T12:24:25.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7f6b03fff640 1 -- 172.21.15.94:0/4054764799 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b080ada10 con 0x7f6b0c162c40 2024-04-25T12:24:25.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7f6b124dd640 1 -- 172.21.15.94:0/4054764799 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b0c162c40 msgr2=0x7f6b0c163070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7f6b124dd640 1 --2- 172.21.15.94:0/4054764799 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b0c162c40 0x7f6b0c163070 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6b080097f0 tx=0x7f6b0801c4a0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7f3209aef640 1 -- 172.21.15.94:0/4175577136 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f32040cbbb0 msgr2=0x7f3204155320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7f3209aef640 1 --2- 172.21.15.94:0/4175577136 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f32040cbbb0 0x7f3204155320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3204074710 tx=0x7f31f001c460 comp rx=0 tx=0).stop 2024-04-25T12:24:25.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7f3209aef640 1 -- 172.21.15.94:0/4175577136 shutdown_connections 2024-04-25T12:24:25.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7f3209aef640 1 --2- 172.21.15.94:0/4175577136 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f32040cbbb0 0x7f3204155320 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7f3209aef640 1 --2- 172.21.15.94:0/4175577136 >> v2:172.21.15.94:3300/0 conn(0x7f32040cb7d0 0x7f3204154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7f3209aef640 1 -- 172.21.15.94:0/4175577136 >> 172.21.15.94:0/4175577136 conn(0x7f320406f400 msgr2=0x7f320406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:25.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7f3209aef640 1 -- 172.21.15.94:0/4175577136 shutdown_connections 2024-04-25T12:24:25.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7f3209aef640 1 -- 172.21.15.94:0/4175577136 wait complete. 2024-04-25T12:24:25.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7f3209aef640 1 Processor -- start 2024-04-25T12:24:25.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7fd21cbd9640 1 -- 172.21.15.94:0/1152225882 wait complete. 2024-04-25T12:24:25.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7fd21cbd9640 1 Processor -- start 2024-04-25T12:24:25.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7fd21cbd9640 1 -- start start 2024-04-25T12:24:25.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7f3920862640 1 -- 172.21.15.94:0/3880253222 shutdown_connections 2024-04-25T12:24:25.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7f3920862640 1 -- 172.21.15.94:0/3880253222 wait complete. 2024-04-25T12:24:25.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7f3920862640 1 Processor -- start 2024-04-25T12:24:25.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7f3209aef640 1 -- start start 2024-04-25T12:24:25.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f3209aef640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f32040ca9a0 0x7f3204158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f3209aef640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f32040cb7d0 0x7f320415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f3209aef640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f32040cbbb0 0x7f3204156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f3209aef640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f32040c8c20 con 0x7f32040cb7d0 2024-04-25T12:24:25.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f3209aef640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f32040c8aa0 con 0x7f32040ca9a0 2024-04-25T12:24:25.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f3209aef640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f32040c9f50 con 0x7f32040cbbb0 2024-04-25T12:24:25.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7f3920862640 1 -- start start 2024-04-25T12:24:25.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7fd21cbd9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2180c89c0 0x7fd218206bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7fd21cbd9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2180c92b0 0x7fd218072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7fd21cbd9640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2180c9690 0x7fd218162310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7fd21cbd9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd218165580 con 0x7fd2180c89c0 2024-04-25T12:24:25.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7fd21cbd9640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd21816bdf0 con 0x7fd2180c92b0 2024-04-25T12:24:25.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7fd21cbd9640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd218165700 con 0x7fd2180c9690 2024-04-25T12:24:25.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f6b124dd640 1 -- 172.21.15.94:0/4054764799 shutdown_connections 2024-04-25T12:24:25.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f6b124dd640 1 --2- 172.21.15.94:0/4054764799 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b0c162c40 0x7f6b0c163070 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f6b124dd640 1 -- 172.21.15.94:0/4054764799 >> 172.21.15.94:0/4054764799 conn(0x7f6b0c06eb20 msgr2=0x7f6b0c06ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:25.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f3920862640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f391c0c89c0 0x7f391c15a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f3920862640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f391c0c9590 0x7f391c073870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f3920862640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f391c159570 0x7f391c160470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f3920862640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f391c0c7e40 con 0x7f391c159570 2024-04-25T12:24:25.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f3920862640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f391c159950 con 0x7f391c0c9590 2024-04-25T12:24:25.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f3920862640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f391c0c7fc0 con 0x7f391c0c89c0 2024-04-25T12:24:25.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f3203fff640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f32040cbbb0 0x7f3204156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f3203fff640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f32040cbbb0 0x7f3204156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.94:50190/0 (socket says 172.21.15.94:50190) 2024-04-25T12:24:25.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f3203fff640 1 -- 172.21.15.94:0/1854167971 learned_addr learned my addr 172.21.15.94:0/1854167971 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:25.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7ff48affd640 1 -- 172.21.15.94:0/1511167725 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4840047f0 con 0x7ff4940ccc20 2024-04-25T12:24:25.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7ff49c355640 1 -- 172.21.15.94:0/1511167725 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4940da120 con 0x7ff4940ccc20 2024-04-25T12:24:25.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7ff48affd640 1 -- 172.21.15.94:0/1511167725 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff484004be0 con 0x7ff4940ccc20 2024-04-25T12:24:25.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.995+0000 7ff49c355640 1 -- 172.21.15.94:0/1511167725 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4940d9e40 con 0x7ff4940ccc20 2024-04-25T12:24:25.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f6b124dd640 1 -- 172.21.15.94:0/4054764799 shutdown_connections 2024-04-25T12:24:25.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7ff49c355640 1 -- 172.21.15.94:0/1511167725 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff494076440 con 0x7ff4940ccc20 2024-04-25T12:24:25.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7fd217fff640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2180c9690 0x7fd218162310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7fd217fff640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2180c9690 0x7fd218162310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.94:50182/0 (socket says 172.21.15.94:50182) 2024-04-25T12:24:25.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7fd217fff640 1 -- 172.21.15.94:0/497339671 learned_addr learned my addr 172.21.15.94:0/497339671 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:25.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7fd216ffd640 1 --2- 172.21.15.94:0/497339671 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2180c92b0 0x7fd218072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f6b124dd640 1 -- 172.21.15.94:0/4054764799 wait complete. 2024-04-25T12:24:25.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f3203fff640 1 -- 172.21.15.94:0/1854167971 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f32040ca9a0 msgr2=0x7f3204158510 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T12:24:25.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f3203fff640 1 --2- 172.21.15.94:0/1854167971 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f32040ca9a0 0x7f3204158510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f3203fff640 1 -- 172.21.15.94:0/1854167971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f32040cb7d0 msgr2=0x7f320415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f3203fff640 1 --2- 172.21.15.94:0/1854167971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f32040cb7d0 0x7f320415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f3203fff640 1 -- 172.21.15.94:0/1854167971 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3204155a60 con 0x7f32040cbbb0 2024-04-25T12:24:25.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f3203fff640 1 --2- 172.21.15.94:0/1854167971 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f32040cbbb0 0x7f3204156500 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00c390 tx=0x7f31fc00c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:25.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f391a59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f391c0c9590 0x7f391c073870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f391a59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f391c0c9590 0x7f391c073870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.94:53678/0 (socket says 172.21.15.94:53678) 2024-04-25T12:24:25.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f391a59c640 1 -- 172.21.15.94:0/4118746162 learned_addr learned my addr 172.21.15.94:0/4118746162 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:25.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f391ad9d640 1 --2- 172.21.15.94:0/4118746162 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f391c0c89c0 0x7f391c15a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7efde878d640 1 -- start start 2024-04-25T12:24:25.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7efde878d640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efde0157100 0x7efde01533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7efde878d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efde01efac0 0x7efde00cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7efde878d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efde0158c00 0x7efde0151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7efde878d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7efde006e590 con 0x7efde0158c00 2024-04-25T12:24:25.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7efde878d640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7efde0071ff0 con 0x7efde01efac0 2024-04-25T12:24:25.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7efde878d640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7efde006e710 con 0x7efde0157100 2024-04-25T12:24:25.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7efde6529640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efde0157100 0x7efde01533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7efde6529640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efde0157100 0x7efde01533f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.94:50202/0 (socket says 172.21.15.94:50202) 2024-04-25T12:24:25.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7efde6529640 1 -- 172.21.15.94:0/3531265357 learned_addr learned my addr 172.21.15.94:0/3531265357 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:25.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7efde6529640 1 -- 172.21.15.94:0/3531265357 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efde01efac0 msgr2=0x7efde00cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7efde6529640 1 --2- 172.21.15.94:0/3531265357 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efde01efac0 0x7efde00cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7efde6529640 1 -- 172.21.15.94:0/3531265357 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efde0158c00 msgr2=0x7efde0151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7efde6529640 1 --2- 172.21.15.94:0/3531265357 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efde0158c00 0x7efde0151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7efde6529640 1 -- 172.21.15.94:0/3531265357 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde0153cb0 con 0x7efde0157100 2024-04-25T12:24:25.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7ff48affd640 1 -- 172.21.15.94:0/1511167725 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff484011070 con 0x7ff4940ccc20 2024-04-25T12:24:25.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f6b124dd640 1 Processor -- start 2024-04-25T12:24:25.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f6b124dd640 1 -- start start 2024-04-25T12:24:25.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7fd217fff640 1 -- 172.21.15.94:0/497339671 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2180c92b0 msgr2=0x7fd218072aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7fd217fff640 1 --2- 172.21.15.94:0/497339671 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2180c92b0 0x7fd218072aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7fd217fff640 1 -- 172.21.15.94:0/497339671 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2180c89c0 msgr2=0x7fd218206bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7fd217fff640 1 --2- 172.21.15.94:0/497339671 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2180c89c0 0x7fd218206bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7fd217fff640 1 -- 172.21.15.94:0/497339671 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2180c85b0 con 0x7fd2180c9690 2024-04-25T12:24:25.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7fd217fff640 1 --2- 172.21.15.94:0/497339671 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2180c9690 0x7fd218162310 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd21000c710 tx=0x7fd21000cbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:25.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f391b59e640 1 --2- 172.21.15.94:0/4118746162 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f391c159570 0x7f391c160470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f391a59c640 1 -- 172.21.15.94:0/4118746162 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f391c0c89c0 msgr2=0x7f391c15a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f391a59c640 1 --2- 172.21.15.94:0/4118746162 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f391c0c89c0 0x7f391c15a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f391a59c640 1 -- 172.21.15.94:0/4118746162 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f391c159570 msgr2=0x7f391c160470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f391a59c640 1 --2- 172.21.15.94:0/4118746162 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f391c159570 0x7f391c160470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f391a59c640 1 -- 172.21.15.94:0/4118746162 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f391c161830 con 0x7f391c0c9590 2024-04-25T12:24:25.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f31effff640 1 -- 172.21.15.94:0/1854167971 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc019070 con 0x7f32040cbbb0 2024-04-25T12:24:25.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f3209aef640 1 -- 172.21.15.94:0/1854167971 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3204073d40 con 0x7f32040cbbb0 2024-04-25T12:24:25.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f3209aef640 1 -- 172.21.15.94:0/1854167971 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3204154490 con 0x7f32040cbbb0 2024-04-25T12:24:25.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f31effff640 1 -- 172.21.15.94:0/1854167971 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31fc014400 con 0x7f32040cbbb0 2024-04-25T12:24:25.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f31effff640 1 -- 172.21.15.94:0/1854167971 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc023060 con 0x7f32040cbbb0 2024-04-25T12:24:25.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f3209aef640 1 -- 172.21.15.94:0/1854167971 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31e40052a0 con 0x7f32040cbbb0 2024-04-25T12:24:25.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f391a59c640 1 --2- 172.21.15.94:0/4118746162 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f391c0c9590 0x7f391c073870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f390c0ae040 tx=0x7f390c01ad40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:25.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7feeadfed640 1 -- 172.21.15.94:0/3309138614 shutdown_connections 2024-04-25T12:24:25.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7feeadfed640 1 -- 172.21.15.94:0/3309138614 wait complete. 2024-04-25T12:24:25.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7ff48affd640 1 --2- 172.21.15.94:0/1511167725 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff4780683b0 0x7ff47806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7ff48affd640 1 -- 172.21.15.94:0/1511167725 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7ff484086e50 con 0x7ff4940ccc20 2024-04-25T12:24:25.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7ff49a0f1640 1 --2- 172.21.15.94:0/1511167725 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff4780683b0 0x7ff47806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7ff49a0f1640 1 --2- 172.21.15.94:0/1511167725 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff4780683b0 0x7ff47806a870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009d90 tx=0x7ff48c0a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:25.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f6b124dd640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b0c0c89c0 0x7f6b0c0cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f6b124dd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b0c159570 0x7f6b0c15d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f6b124dd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b0c162c40 0x7f6b0c1481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f6b124dd640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0c0c7e40 con 0x7f6b0c159570 2024-04-25T12:24:25.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f6b124dd640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0c159950 con 0x7f6b0c162c40 2024-04-25T12:24:25.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7f6b124dd640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6b0c0c7fc0 con 0x7f6b0c0c89c0 2024-04-25T12:24:25.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7fd1fffff640 1 -- 172.21.15.94:0/497339671 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd210016020 con 0x7fd2180c9690 2024-04-25T12:24:25.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7fd1fffff640 1 -- 172.21.15.94:0/497339671 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd210006d60 con 0x7fd2180c9690 2024-04-25T12:24:25.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7fd1fffff640 1 -- 172.21.15.94:0/497339671 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd210003ba0 con 0x7fd2180c9690 2024-04-25T12:24:25.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7fd21cbd9640 1 -- 172.21.15.94:0/497339671 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd21820a070 con 0x7fd2180c9690 2024-04-25T12:24:25.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:24.999+0000 7fd21cbd9640 1 -- 172.21.15.94:0/497339671 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2182063b0 con 0x7fd2180c9690 2024-04-25T12:24:25.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7f6b114db640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b0c0c89c0 0x7f6b0c0cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7f6b114db640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b0c0c89c0 0x7f6b0c0cb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.94:50212/0 (socket says 172.21.15.94:50212) 2024-04-25T12:24:25.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7f6b10cda640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b0c159570 0x7f6b0c15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7f6b114db640 1 -- 172.21.15.94:0/2756915868 learned_addr learned my addr 172.21.15.94:0/2756915868 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:25.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7f6b11cdc640 1 --2- 172.21.15.94:0/2756915868 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b0c162c40 0x7f6b0c1481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7efde6529640 1 --2- 172.21.15.94:0/3531265357 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efde0157100 0x7efde01533f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efdd80056c0 tx=0x7efdd8005b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:25.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7fd21cbd9640 1 -- 172.21.15.94:0/497339671 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1f80052a0 con 0x7fd2180c9690 2024-04-25T12:24:25.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7f6b10cda640 1 -- 172.21.15.94:0/2756915868 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b0c0c89c0 msgr2=0x7f6b0c0cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7f6b10cda640 1 --2- 172.21.15.94:0/2756915868 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b0c0c89c0 0x7f6b0c0cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7f6b10cda640 1 -- 172.21.15.94:0/2756915868 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b0c162c40 msgr2=0x7f6b0c1481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7f6b10cda640 1 --2- 172.21.15.94:0/2756915868 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b0c162c40 0x7f6b0c1481f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7f6b10cda640 1 -- 172.21.15.94:0/2756915868 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0c1fc370 con 0x7f6b0c159570 2024-04-25T12:24:25.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7feeadfed640 1 Processor -- start 2024-04-25T12:24:25.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7feeadfed640 1 -- start start 2024-04-25T12:24:25.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7feeadfed640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7feea80c3250 0x7feea81699d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7feeadfed640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feea80c9b70 0x7feea8158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7feeadfed640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feea8159240 0x7feea81585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7feeadfed640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7feea8174e70 con 0x7feea8159240 2024-04-25T12:24:25.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7feeadfed640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7feea8174ff0 con 0x7feea80c9b70 2024-04-25T12:24:25.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7feeadfed640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7feea8175170 con 0x7feea80c3250 2024-04-25T12:24:25.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7f6b10cda640 1 --2- 172.21.15.94:0/2756915868 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b0c159570 0x7f6b0c15d620 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6afc00c390 tx=0x7f6afc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:25.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7feea7fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feea8159240 0x7feea81585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7feea7fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feea8159240 0x7feea81585d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52022/0 (socket says 172.21.15.94:52022) 2024-04-25T12:24:25.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7feea7fff640 1 -- 172.21.15.94:0/2856708239 learned_addr learned my addr 172.21.15.94:0/2856708239 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:25.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7fee9effd640 1 --2- 172.21.15.94:0/2856708239 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feea80c9b70 0x7feea8158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7feea77fe640 1 --2- 172.21.15.94:0/2856708239 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7feea80c3250 0x7feea81699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7f31effff640 1 -- 172.21.15.94:0/1854167971 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f31fc01c070 con 0x7f32040cbbb0 2024-04-25T12:24:25.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7f31effff640 1 --2- 172.21.15.94:0/1854167971 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f31e8068380 0x7f31e806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7f31effff640 1 -- 172.21.15.94:0/1854167971 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f31fc089660 con 0x7f32040cbbb0 2024-04-25T12:24:25.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7f32037fe640 1 --2- 172.21.15.94:0/1854167971 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f31e8068380 0x7f31e806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7feea7fff640 1 -- 172.21.15.94:0/2856708239 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7feea80c3250 msgr2=0x7feea81699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7feea7fff640 1 --2- 172.21.15.94:0/2856708239 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7feea80c3250 0x7feea81699d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7feea7fff640 1 -- 172.21.15.94:0/2856708239 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feea80c9b70 msgr2=0x7feea8158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7feea7fff640 1 --2- 172.21.15.94:0/2856708239 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feea80c9b70 0x7feea8158090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7feea7fff640 1 -- 172.21.15.94:0/2856708239 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea815ea70 con 0x7feea8159240 2024-04-25T12:24:25.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7f32037fe640 1 --2- 172.21.15.94:0/1854167971 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f31e8068380 0x7f31e806a840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009970 tx=0x7f31f8009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:25.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7feea7fff640 1 --2- 172.21.15.94:0/2856708239 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feea8159240 0x7feea81585d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feea000ca70 tx=0x7feea000ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:25.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.003+0000 7f39727fc640 1 -- 172.21.15.94:0/805966569 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f39740c5020 con 0x7f397c151a60 2024-04-25T12:24:25.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.007+0000 7f6b01ffb640 1 -- 172.21.15.94:0/2756915868 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6afc017070 con 0x7f6b0c159570 2024-04-25T12:24:25.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.007+0000 7f6b124dd640 1 -- 172.21.15.94:0/2756915868 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b0c162410 con 0x7f6b0c159570 2024-04-25T12:24:25.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.007+0000 7f6b124dd640 1 -- 172.21.15.94:0/2756915868 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b0c1fb890 con 0x7f6b0c159570 2024-04-25T12:24:25.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.007+0000 7feea4ff9640 1 -- 172.21.15.94:0/2856708239 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea0016020 con 0x7feea8159240 2024-04-25T12:24:25.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.007+0000 7feeadfed640 1 -- 172.21.15.94:0/2856708239 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feea815ed50 con 0x7feea8159240 2024-04-25T12:24:25.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.007+0000 7feeadfed640 1 -- 172.21.15.94:0/2856708239 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea815f310 con 0x7feea8159240 2024-04-25T12:24:25.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.007+0000 7f6b124dd640 1 -- 172.21.15.94:0/2756915868 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b0c076360 con 0x7f6b0c159570 2024-04-25T12:24:25.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.007+0000 7feeadfed640 1 -- 172.21.15.94:0/2856708239 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feea8076440 con 0x7feea8159240 2024-04-25T12:24:25.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.007+0000 7f6b01ffb640 1 -- 172.21.15.94:0/2756915868 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6afc007030 con 0x7f6b0c159570 2024-04-25T12:24:25.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.007+0000 7f6b01ffb640 1 -- 172.21.15.94:0/2756915868 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6afc021060 con 0x7f6b0c159570 2024-04-25T12:24:25.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.007+0000 7feea4ff9640 1 -- 172.21.15.94:0/2856708239 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea000aab0 con 0x7feea8159240 2024-04-25T12:24:25.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.007+0000 7feea4ff9640 1 -- 172.21.15.94:0/2856708239 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea000ae60 con 0x7feea8159240 2024-04-25T12:24:25.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.011+0000 7f6b01ffb640 1 -- 172.21.15.94:0/2756915868 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6afc01a070 con 0x7f6b0c159570 2024-04-25T12:24:25.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.011+0000 7feea4ff9640 1 -- 172.21.15.94:0/2856708239 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feea0019020 con 0x7feea8159240 2024-04-25T12:24:25.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.011+0000 7f6b01ffb640 1 --2- 172.21.15.94:0/2756915868 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6af00683b0 0x7f6af006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.011+0000 7f6b01ffb640 1 -- 172.21.15.94:0/2756915868 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f6afc086220 con 0x7f6b0c159570 2024-04-25T12:24:25.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.011+0000 7f6b114db640 1 --2- 172.21.15.94:0/2756915868 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6af00683b0 0x7f6af006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.011+0000 7feea4ff9640 1 --2- 172.21.15.94:0/2856708239 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fee88068380 0x7fee8806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.011+0000 7feea4ff9640 1 -- 172.21.15.94:0/2856708239 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7feea00876c0 con 0x7feea8159240 2024-04-25T12:24:25.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.011+0000 7f6b114db640 1 --2- 172.21.15.94:0/2756915868 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6af00683b0 0x7f6af006a870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6b04001570 tx=0x7f6b04009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:25.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.015+0000 7feea77fe640 1 --2- 172.21.15.94:0/2856708239 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fee88068380 0x7fee8806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.015+0000 7f39037fe640 1 -- 172.21.15.94:0/4118746162 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c0ba020 con 0x7f391c0c9590 2024-04-25T12:24:25.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.015+0000 7f39037fe640 1 -- 172.21.15.94:0/4118746162 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f390c0b6640 con 0x7f391c0c9590 2024-04-25T12:24:25.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.015+0000 7feea77fe640 1 --2- 172.21.15.94:0/2856708239 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fee88068380 0x7fee8806a840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fee980b6000 tx=0x7fee980af070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:25.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.015+0000 7f3920862640 1 -- 172.21.15.94:0/4118746162 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f391c152fc0 con 0x7f391c0c9590 2024-04-25T12:24:25.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.015+0000 7f3920862640 1 -- 172.21.15.94:0/4118746162 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f391c072ab0 con 0x7f391c0c9590 2024-04-25T12:24:25.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.015+0000 7ff48affd640 1 -- 172.21.15.94:0/1511167725 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff4840570d0 con 0x7ff4940ccc20 2024-04-25T12:24:25.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.015+0000 7f6b01ffb640 1 -- 172.21.15.94:0/2756915868 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6afc055e30 con 0x7f6b0c159570 2024-04-25T12:24:25.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.015+0000 7f3920862640 1 -- 172.21.15.94:0/4118746162 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f391c076360 con 0x7f391c0c9590 2024-04-25T12:24:25.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.015+0000 7f39037fe640 1 -- 172.21.15.94:0/4118746162 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c0b0040 con 0x7f391c0c9590 2024-04-25T12:24:25.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.015+0000 7efdd6ffd640 1 -- 172.21.15.94:0/3531265357 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd801d070 con 0x7efde0157100 2024-04-25T12:24:25.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.015+0000 7efde878d640 1 -- 172.21.15.94:0/3531265357 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde01effb0 con 0x7efde0157100 2024-04-25T12:24:25.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.015+0000 7efde878d640 1 -- 172.21.15.94:0/3531265357 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efde01f0570 con 0x7efde0157100 2024-04-25T12:24:25.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.015+0000 7efdd6ffd640 1 -- 172.21.15.94:0/3531265357 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdd8012b50 con 0x7efde0157100 2024-04-25T12:24:25.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.015+0000 7f31effff640 1 -- 172.21.15.94:0/1854167971 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f31fc059130 con 0x7f32040cbbb0 2024-04-25T12:24:25.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.019+0000 7efde878d640 1 -- 172.21.15.94:0/3531265357 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdc80052a0 con 0x7efde0157100 2024-04-25T12:24:25.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.019+0000 7efdd6ffd640 1 -- 172.21.15.94:0/3531265357 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd8027060 con 0x7efde0157100 2024-04-25T12:24:25.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.019+0000 7efdd6ffd640 1 -- 172.21.15.94:0/3531265357 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efdd8020070 con 0x7efde0157100 2024-04-25T12:24:25.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.019+0000 7efdd6ffd640 1 --2- 172.21.15.94:0/3531265357 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7efdc40683b0 0x7efdc406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.019+0000 7efde5d28640 1 --2- 172.21.15.94:0/3531265357 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7efdc40683b0 0x7efdc406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.019+0000 7efde5d28640 1 --2- 172.21.15.94:0/3531265357 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7efdc40683b0 0x7efdc406a870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efde0154e50 tx=0x7efdd0009450 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:25.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.023+0000 7f39037fe640 1 -- 172.21.15.94:0/4118746162 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f390c0bd020 con 0x7f391c0c9590 2024-04-25T12:24:25.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.023+0000 7fd1fffff640 1 -- 172.21.15.94:0/497339671 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd21000a7f0 con 0x7fd2180c9690 2024-04-25T12:24:25.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.023+0000 7f39037fe640 1 --2- 172.21.15.94:0/4118746162 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f39080683d0 0x7f390806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.023+0000 7f39037fe640 1 -- 172.21.15.94:0/4118746162 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f390c1212e0 con 0x7f391c0c9590 2024-04-25T12:24:25.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.023+0000 7f391ad9d640 1 --2- 172.21.15.94:0/4118746162 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f39080683d0 0x7f390806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.023+0000 7fd1fffff640 1 --2- 172.21.15.94:0/497339671 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd204068450 0x7fd20406a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:25.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.023+0000 7fd1fffff640 1 -- 172.21.15.94:0/497339671 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fd210087780 con 0x7fd2180c9690 2024-04-25T12:24:25.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.023+0000 7f391ad9d640 1 --2- 172.21.15.94:0/4118746162 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f39080683d0 0x7f390806a890 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3914009fd0 tx=0x7f391400d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:25.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.023+0000 7fd2177fe640 1 --2- 172.21.15.94:0/497339671 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd204068450 0x7fd20406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:25.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.023+0000 7feea4ff9640 1 -- 172.21.15.94:0/2856708239 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feea0020020 con 0x7feea8159240 2024-04-25T12:24:25.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.023+0000 7fd2177fe640 1 --2- 172.21.15.94:0/497339671 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd204068450 0x7fd20406a910 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd2080b7000 tx=0x7fd208004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:25.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.031+0000 7f39037fe640 1 -- 172.21.15.94:0/4118746162 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f390c0c4030 con 0x7f391c0c9590 2024-04-25T12:24:25.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.031+0000 7efdd6ffd640 1 -- 172.21.15.94:0/3531265357 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7efdd8057a60 con 0x7efde0157100 2024-04-25T12:24:25.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.031+0000 7fd1fffff640 1 -- 172.21.15.94:0/497339671 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd210020020 con 0x7fd2180c9690 2024-04-25T12:24:25.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.043+0000 7efdd6ffd640 1 -- 172.21.15.94:0/3531265357 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efdd80599c0 con 0x7efde0157100 2024-04-25T12:24:25.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.327+0000 7f3983e77640 1 -- 172.21.15.94:0/805966569 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f3964005860 con 0x7f397c151a60 2024-04-25T12:24:25.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.327+0000 7f39727fc640 1 -- 172.21.15.94:0/805966569 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3974016660 con 0x7f397c151a60 2024-04-25T12:24:25.334 INFO:teuthology.orchestra.run.smithi094.stdout:68719476770 2024-04-25T12:24:25.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.331+0000 7f395ffff640 1 -- 172.21.15.94:0/805966569 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f39600683b0 msgr2=0x7f396006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.331+0000 7f395ffff640 1 --2- 172.21.15.94:0/805966569 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f39600683b0 0x7f396006a870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f396c000f70 tx=0x7f396c007e20 comp rx=0 tx=0).stop 2024-04-25T12:24:25.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.331+0000 7f395ffff640 1 -- 172.21.15.94:0/805966569 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f397c151a60 msgr2=0x7f397c1499c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.331+0000 7f395ffff640 1 --2- 172.21.15.94:0/805966569 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f397c151a60 0x7f397c1499c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f397c0caa80 tx=0x7f3974019780 comp rx=0 tx=0).stop 2024-04-25T12:24:25.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.331+0000 7f395ffff640 1 -- 172.21.15.94:0/805966569 shutdown_connections 2024-04-25T12:24:25.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.331+0000 7f395ffff640 1 --2- 172.21.15.94:0/805966569 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f39600683b0 0x7f396006a870 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.331+0000 7f395ffff640 1 --2- 172.21.15.94:0/805966569 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f397c0c6ba0 0x7f397c0cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.331+0000 7f395ffff640 1 --2- 172.21.15.94:0/805966569 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f397c151a60 0x7f397c1499c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.331+0000 7f395ffff640 1 --2- 172.21.15.94:0/805966569 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f397c071c60 0x7f397c0c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.331+0000 7f395ffff640 1 -- 172.21.15.94:0/805966569 >> 172.21.15.94:0/805966569 conn(0x7f397c06f280 msgr2=0x7f397c14fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:25.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.331+0000 7f395ffff640 1 -- 172.21.15.94:0/805966569 shutdown_connections 2024-04-25T12:24:25.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.331+0000 7f395ffff640 1 -- 172.21.15.94:0/805966569 wait complete. 2024-04-25T12:24:25.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.343+0000 7feeadfed640 1 -- 172.21.15.94:0/2856708239 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7feea8157df0 con 0x7feea8159240 2024-04-25T12:24:25.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.343+0000 7feea4ff9640 1 -- 172.21.15.94:0/2856708239 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feea0057230 con 0x7feea8159240 2024-04-25T12:24:25.349 INFO:teuthology.orchestra.run.smithi094.stdout:68719476771 2024-04-25T12:24:25.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.343+0000 7fee9dffb640 1 -- 172.21.15.94:0/2856708239 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fee88068380 msgr2=0x7fee8806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.343+0000 7fee9dffb640 1 --2- 172.21.15.94:0/2856708239 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fee88068380 0x7fee8806a840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fee980b6000 tx=0x7fee980af070 comp rx=0 tx=0).stop 2024-04-25T12:24:25.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.343+0000 7fee9dffb640 1 -- 172.21.15.94:0/2856708239 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feea8159240 msgr2=0x7feea81585d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.343+0000 7fee9dffb640 1 --2- 172.21.15.94:0/2856708239 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feea8159240 0x7feea81585d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feea000ca70 tx=0x7feea000ce70 comp rx=0 tx=0).stop 2024-04-25T12:24:25.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.343+0000 7fee9dffb640 1 -- 172.21.15.94:0/2856708239 shutdown_connections 2024-04-25T12:24:25.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.347+0000 7fee9dffb640 1 --2- 172.21.15.94:0/2856708239 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fee88068380 0x7fee8806a840 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.347+0000 7fee9dffb640 1 --2- 172.21.15.94:0/2856708239 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feea8159240 0x7feea81585d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.347+0000 7fee9dffb640 1 --2- 172.21.15.94:0/2856708239 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feea80c9b70 0x7feea8158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.347+0000 7fee9dffb640 1 --2- 172.21.15.94:0/2856708239 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7feea80c3250 0x7feea81699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.347+0000 7fee9dffb640 1 -- 172.21.15.94:0/2856708239 >> 172.21.15.94:0/2856708239 conn(0x7feea80c9050 msgr2=0x7feea816a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:25.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.347+0000 7fee9dffb640 1 -- 172.21.15.94:0/2856708239 shutdown_connections 2024-04-25T12:24:25.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.347+0000 7fee9dffb640 1 -- 172.21.15.94:0/2856708239 wait complete. 2024-04-25T12:24:25.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.347+0000 7f3209aef640 1 -- 172.21.15.94:0/1854167971 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f31e4005860 con 0x7f32040cbbb0 2024-04-25T12:24:25.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.347+0000 7f31effff640 1 -- 172.21.15.94:0/1854167971 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f31fc05d430 con 0x7f32040cbbb0 2024-04-25T12:24:25.352 INFO:teuthology.orchestra.run.smithi094.stdout:68719476769 2024-04-25T12:24:25.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.347+0000 7ff49c355640 1 -- 172.21.15.94:0/1511167725 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff49415fbf0 con 0x7ff4940ccc20 2024-04-25T12:24:25.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.347+0000 7f6b124dd640 1 -- 172.21.15.94:0/2756915868 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6b0c157140 con 0x7f6b0c159570 2024-04-25T12:24:25.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.347+0000 7f6b01ffb640 1 -- 172.21.15.94:0/2756915868 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6afc05a130 con 0x7f6b0c159570 2024-04-25T12:24:25.356 INFO:teuthology.orchestra.run.smithi094.stdout:60129542178 2024-04-25T12:24:25.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.347+0000 7ff48affd640 1 -- 172.21.15.94:0/1511167725 <== mon.1 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff4840569d0 con 0x7ff4940ccc20 2024-04-25T12:24:25.357 INFO:teuthology.orchestra.run.smithi094.stdout:60129542178 2024-04-25T12:24:25.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.351+0000 7f6af77fe640 1 -- 172.21.15.94:0/2756915868 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6af00683b0 msgr2=0x7f6af006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.351+0000 7f6af77fe640 1 --2- 172.21.15.94:0/2756915868 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6af00683b0 0x7f6af006a870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6b04001570 tx=0x7f6b04009040 comp rx=0 tx=0).stop 2024-04-25T12:24:25.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.351+0000 7f6af77fe640 1 -- 172.21.15.94:0/2756915868 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b0c159570 msgr2=0x7f6b0c15d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.351+0000 7f6af77fe640 1 --2- 172.21.15.94:0/2756915868 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b0c159570 0x7f6b0c15d620 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6afc00c390 tx=0x7f6afc00c850 comp rx=0 tx=0).stop 2024-04-25T12:24:25.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.351+0000 7f6af77fe640 1 -- 172.21.15.94:0/2756915868 shutdown_connections 2024-04-25T12:24:25.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.351+0000 7f6af77fe640 1 --2- 172.21.15.94:0/2756915868 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6af00683b0 0x7f6af006a870 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.351+0000 7f6af77fe640 1 --2- 172.21.15.94:0/2756915868 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b0c162c40 0x7f6b0c1481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.351+0000 7f6af77fe640 1 --2- 172.21.15.94:0/2756915868 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b0c159570 0x7f6b0c15d620 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.351+0000 7f6af77fe640 1 --2- 172.21.15.94:0/2756915868 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b0c0c89c0 0x7f6b0c0cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.351+0000 7f6af77fe640 1 -- 172.21.15.94:0/2756915868 >> 172.21.15.94:0/2756915868 conn(0x7f6b0c06eb20 msgr2=0x7f6b0c1563c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:25.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.351+0000 7f6af77fe640 1 -- 172.21.15.94:0/2756915868 shutdown_connections 2024-04-25T12:24:25.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.351+0000 7f6af77fe640 1 -- 172.21.15.94:0/2756915868 wait complete. 2024-04-25T12:24:25.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.355+0000 7ff488ef9640 1 -- 172.21.15.94:0/1511167725 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff4780683b0 msgr2=0x7ff47806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.355+0000 7ff488ef9640 1 --2- 172.21.15.94:0/1511167725 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff4780683b0 0x7ff47806a870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009d90 tx=0x7ff48c0a7070 comp rx=0 tx=0).stop 2024-04-25T12:24:25.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.355+0000 7ff488ef9640 1 -- 172.21.15.94:0/1511167725 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff4940ccc20 msgr2=0x7ff49415c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.355+0000 7ff488ef9640 1 --2- 172.21.15.94:0/1511167725 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff4940ccc20 0x7ff49415c210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff48400c3e0 tx=0x7ff48400c8a0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.355+0000 7ff488ef9640 1 -- 172.21.15.94:0/1511167725 shutdown_connections 2024-04-25T12:24:25.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.355+0000 7ff488ef9640 1 --2- 172.21.15.94:0/1511167725 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff4780683b0 0x7ff47806a870 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.355+0000 7ff488ef9640 1 --2- 172.21.15.94:0/1511167725 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff4940ccc20 0x7ff49415c210 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.355+0000 7f3209aef640 1 -- 172.21.15.94:0/1854167971 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f31e8068380 msgr2=0x7f31e806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.355+0000 7f3209aef640 1 --2- 172.21.15.94:0/1854167971 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f31e8068380 0x7f31e806a840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009970 tx=0x7f31f8009190 comp rx=0 tx=0).stop 2024-04-25T12:24:25.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.355+0000 7f3209aef640 1 -- 172.21.15.94:0/1854167971 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f32040cbbb0 msgr2=0x7f3204156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.355+0000 7f3209aef640 1 --2- 172.21.15.94:0/1854167971 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f32040cbbb0 0x7f3204156500 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00c390 tx=0x7f31fc00c850 comp rx=0 tx=0).stop 2024-04-25T12:24:25.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.355+0000 7ff488ef9640 1 --2- 172.21.15.94:0/1511167725 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff494067ce0 0x7ff494145c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.355+0000 7f3209aef640 1 -- 172.21.15.94:0/1854167971 shutdown_connections 2024-04-25T12:24:25.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.355+0000 7f3209aef640 1 --2- 172.21.15.94:0/1854167971 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f31e8068380 0x7f31e806a840 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.355+0000 7f3209aef640 1 --2- 172.21.15.94:0/1854167971 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f32040cbbb0 0x7f3204156500 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.355+0000 7f3209aef640 1 --2- 172.21.15.94:0/1854167971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f32040cb7d0 0x7f320415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.355+0000 7f3209aef640 1 --2- 172.21.15.94:0/1854167971 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f32040ca9a0 0x7f3204158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.355+0000 7f3209aef640 1 -- 172.21.15.94:0/1854167971 >> 172.21.15.94:0/1854167971 conn(0x7f320406f400 msgr2=0x7f320414f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:25.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.355+0000 7ff488ef9640 1 --2- 172.21.15.94:0/1511167725 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff494067900 0x7ff49415b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.355+0000 7f3209aef640 1 -- 172.21.15.94:0/1854167971 shutdown_connections 2024-04-25T12:24:25.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.355+0000 7f3209aef640 1 -- 172.21.15.94:0/1854167971 wait complete. 2024-04-25T12:24:25.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.355+0000 7ff488ef9640 1 -- 172.21.15.94:0/1511167725 >> 172.21.15.94:0/1511167725 conn(0x7ff49406d9c0 msgr2=0x7ff4940cb680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:25.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.355+0000 7ff488ef9640 1 -- 172.21.15.94:0/1511167725 shutdown_connections 2024-04-25T12:24:25.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.355+0000 7ff488ef9640 1 -- 172.21.15.94:0/1511167725 wait complete. 2024-04-25T12:24:25.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476771 got 68719476770 for osd.5 2024-04-25T12:24:25.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.355+0000 7f3920862640 1 -- 172.21.15.94:0/4118746162 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f391c0c8190 con 0x7f391c0c9590 2024-04-25T12:24:25.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.359+0000 7f39037fe640 1 -- 172.21.15.94:0/4118746162 <== mon.1 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f390c0160f0 con 0x7f391c0c9590 2024-04-25T12:24:25.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.359+0000 7fd21cbd9640 1 -- 172.21.15.94:0/497339671 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd1f8005860 con 0x7fd2180c9690 2024-04-25T12:24:25.366 INFO:teuthology.orchestra.run.smithi094.stdout:68719476770 2024-04-25T12:24:25.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.363+0000 7fd1fffff640 1 -- 172.21.15.94:0/497339671 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd2180c85b0 con 0x7fd2180c9690 2024-04-25T12:24:25.366 INFO:teuthology.orchestra.run.smithi094.stdout:60129542179 2024-04-25T12:24:25.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.363+0000 7f3920862640 1 -- 172.21.15.94:0/4118746162 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f39080683d0 msgr2=0x7f390806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.363+0000 7f3920862640 1 --2- 172.21.15.94:0/4118746162 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f39080683d0 0x7f390806a890 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3914009fd0 tx=0x7f391400d040 comp rx=0 tx=0).stop 2024-04-25T12:24:25.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.363+0000 7f3920862640 1 -- 172.21.15.94:0/4118746162 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f391c0c9590 msgr2=0x7f391c073870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.363+0000 7f3920862640 1 --2- 172.21.15.94:0/4118746162 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f391c0c9590 0x7f391c073870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f390c0ae040 tx=0x7f390c01ad40 comp rx=0 tx=0).stop 2024-04-25T12:24:25.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.363+0000 7f3920862640 1 -- 172.21.15.94:0/4118746162 shutdown_connections 2024-04-25T12:24:25.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.363+0000 7f3920862640 1 --2- 172.21.15.94:0/4118746162 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f39080683d0 0x7f390806a890 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.363+0000 7f3920862640 1 --2- 172.21.15.94:0/4118746162 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f391c159570 0x7f391c160470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.363+0000 7f3920862640 1 --2- 172.21.15.94:0/4118746162 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f391c0c9590 0x7f391c073870 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.363+0000 7f3920862640 1 --2- 172.21.15.94:0/4118746162 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f391c0c89c0 0x7f391c15a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.363+0000 7f3920862640 1 -- 172.21.15.94:0/4118746162 >> 172.21.15.94:0/4118746162 conn(0x7f391c06eb20 msgr2=0x7f391c158590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:25.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.363+0000 7f3920862640 1 -- 172.21.15.94:0/4118746162 shutdown_connections 2024-04-25T12:24:25.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.363+0000 7f3920862640 1 -- 172.21.15.94:0/4118746162 wait complete. 2024-04-25T12:24:25.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.367+0000 7fd21cbd9640 1 -- 172.21.15.94:0/497339671 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd204068450 msgr2=0x7fd20406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.367+0000 7fd21cbd9640 1 --2- 172.21.15.94:0/497339671 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd204068450 0x7fd20406a910 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd2080b7000 tx=0x7fd208004740 comp rx=0 tx=0).stop 2024-04-25T12:24:25.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.367+0000 7fd21cbd9640 1 -- 172.21.15.94:0/497339671 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2180c9690 msgr2=0x7fd218162310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.367+0000 7fd21cbd9640 1 --2- 172.21.15.94:0/497339671 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2180c9690 0x7fd218162310 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd21000c710 tx=0x7fd21000cbd0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.367+0000 7fd21cbd9640 1 -- 172.21.15.94:0/497339671 shutdown_connections 2024-04-25T12:24:25.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.367+0000 7fd21cbd9640 1 --2- 172.21.15.94:0/497339671 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd204068450 0x7fd20406a910 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.367+0000 7fd21cbd9640 1 --2- 172.21.15.94:0/497339671 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2180c9690 0x7fd218162310 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.367+0000 7fd21cbd9640 1 --2- 172.21.15.94:0/497339671 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2180c92b0 0x7fd218072aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.367+0000 7fd21cbd9640 1 --2- 172.21.15.94:0/497339671 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2180c89c0 0x7fd218206bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.367+0000 7fd21cbd9640 1 -- 172.21.15.94:0/497339671 >> 172.21.15.94:0/497339671 conn(0x7fd21806eb20 msgr2=0x7fd218163ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:25.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.367+0000 7fd21cbd9640 1 -- 172.21.15.94:0/497339671 shutdown_connections 2024-04-25T12:24:25.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.367+0000 7fd21cbd9640 1 -- 172.21.15.94:0/497339671 wait complete. 2024-04-25T12:24:25.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.371+0000 7efde878d640 1 -- 172.21.15.94:0/3531265357 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7efdc8005860 con 0x7efde0157100 2024-04-25T12:24:25.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.371+0000 7efdd6ffd640 1 -- 172.21.15.94:0/3531265357 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efdd805dcc0 con 0x7efde0157100 2024-04-25T12:24:25.377 INFO:teuthology.orchestra.run.smithi094.stdout:60129542178 2024-04-25T12:24:25.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.375+0000 7efde878d640 1 -- 172.21.15.94:0/3531265357 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7efdc40683b0 msgr2=0x7efdc406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.375+0000 7efde878d640 1 --2- 172.21.15.94:0/3531265357 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7efdc40683b0 0x7efdc406a870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efde0154e50 tx=0x7efdd0009450 comp rx=0 tx=0).stop 2024-04-25T12:24:25.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.375+0000 7efde878d640 1 -- 172.21.15.94:0/3531265357 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efde0157100 msgr2=0x7efde01533f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:25.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.375+0000 7efde878d640 1 --2- 172.21.15.94:0/3531265357 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efde0157100 0x7efde01533f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efdd80056c0 tx=0x7efdd8005b80 comp rx=0 tx=0).stop 2024-04-25T12:24:25.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.375+0000 7efde878d640 1 -- 172.21.15.94:0/3531265357 shutdown_connections 2024-04-25T12:24:25.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.375+0000 7efde878d640 1 --2- 172.21.15.94:0/3531265357 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7efdc40683b0 0x7efdc406a870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.375+0000 7efde878d640 1 --2- 172.21.15.94:0/3531265357 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efde0158c00 0x7efde0151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.375+0000 7efde878d640 1 --2- 172.21.15.94:0/3531265357 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efde01efac0 0x7efde00cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.375+0000 7efde878d640 1 --2- 172.21.15.94:0/3531265357 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efde0157100 0x7efde01533f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:25.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.375+0000 7efde878d640 1 -- 172.21.15.94:0/3531265357 >> 172.21.15.94:0/3531265357 conn(0x7efde00c9050 msgr2=0x7efde00c9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:25.381 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476772 got 68719476771 for osd.6 2024-04-25T12:24:25.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.375+0000 7efde878d640 1 -- 172.21.15.94:0/3531265357 shutdown_connections 2024-04-25T12:24:25.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:25.375+0000 7efde878d640 1 -- 172.21.15.94:0/3531265357 wait complete. 2024-04-25T12:24:25.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542178 for osd.0 2024-04-25T12:24:25.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476770 got 68719476769 for osd.4 2024-04-25T12:24:25.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542178 for osd.3 2024-04-25T12:24:25.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476771 got 68719476770 for osd.7 2024-04-25T12:24:25.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542178 for osd.1 2024-04-25T12:24:25.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542180 got 60129542179 for osd.2 2024-04-25T12:24:26.365 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T12:24:26.382 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T12:24:26.393 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T12:24:26.395 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T12:24:26.397 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T12:24:26.402 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T12:24:26.403 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T12:24:26.404 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T12:24:26.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.538+0000 7fd5a14c2640 1 Processor -- start 2024-04-25T12:24:26.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.538+0000 7fd5a14c2640 1 -- start start 2024-04-25T12:24:26.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.542+0000 7fd5a14c2640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd59c1512d0 0x7fd59c0c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.542+0000 7fd5a14c2640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd59c157100 0x7fd59c072510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.542+0000 7fd5a14c2640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd59c072a50 0x7fd59c070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.542+0000 7fd5a14c2640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fd59c071a50 con 0x7fd59c072a50 2024-04-25T12:24:26.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.542+0000 7fd5a14c2640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fd59c0c77e0 con 0x7fd59c1512d0 2024-04-25T12:24:26.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.542+0000 7fd5a14c2640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd59c0c7ac0 con 0x7fd59c157100 2024-04-25T12:24:26.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.542+0000 7fd59b7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd59c072a50 0x7fd59c070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.542+0000 7fd59b7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd59c072a50 0x7fd59c070f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52038/0 (socket says 172.21.15.94:52038) 2024-04-25T12:24:26.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.542+0000 7fd59a7fc640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd59c157100 0x7fd59c072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.542+0000 7fd59b7fe640 1 -- 172.21.15.94:0/3187176202 learned_addr learned my addr 172.21.15.94:0/3187176202 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:26.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.542+0000 7fd59affd640 1 --2- 172.21.15.94:0/3187176202 >> v2:172.21.15.111:3300/0 conn(0x7fd59c1512d0 0x7fd59c0c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.542+0000 7fd59a7fc640 1 -- 172.21.15.94:0/3187176202 >> v2:172.21.15.111:3300/0 conn(0x7fd59c1512d0 msgr2=0x7fd59c0c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:26.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.542+0000 7fd59a7fc640 1 --2- 172.21.15.94:0/3187176202 >> v2:172.21.15.111:3300/0 conn(0x7fd59c1512d0 0x7fd59c0c6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.542+0000 7fd59a7fc640 1 -- 172.21.15.94:0/3187176202 >> v2:172.21.15.94:3300/0 conn(0x7fd59c072a50 msgr2=0x7fd59c070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:26.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.542+0000 7fd59a7fc640 1 --2- 172.21.15.94:0/3187176202 >> v2:172.21.15.94:3300/0 conn(0x7fd59c072a50 0x7fd59c070f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.542+0000 7fd59a7fc640 1 -- 172.21.15.94:0/3187176202 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59c0c7da0 con 0x7fd59c157100 2024-04-25T12:24:26.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.542+0000 7fd59b7fe640 1 --2- 172.21.15.94:0/3187176202 >> v2:172.21.15.94:3300/0 conn(0x7fd59c072a50 0x7fd59c070f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:24:26.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.546+0000 7fd59a7fc640 1 --2- 172.21.15.94:0/3187176202 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd59c157100 0x7fd59c072510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd59c06de00 tx=0x7fd59401cce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4643d8fa87a63695 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:26.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.546+0000 7fd599ffb640 1 -- 172.21.15.94:0/3187176202 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd594007dc0 con 0x7fd59c157100 2024-04-25T12:24:26.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.546+0000 7fd599ffb640 1 -- 172.21.15.94:0/3187176202 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5940a5b70 con 0x7fd59c157100 2024-04-25T12:24:26.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.546+0000 7fd5a14c2640 1 -- 172.21.15.94:0/3187176202 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd59c157100 msgr2=0x7fd59c072510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.546+0000 7fd5a14c2640 1 --2- 172.21.15.94:0/3187176202 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd59c157100 0x7fd59c072510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd59c06de00 tx=0x7fd59401cce0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.546+0000 7fd5a14c2640 1 -- 172.21.15.94:0/3187176202 shutdown_connections 2024-04-25T12:24:26.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.546+0000 7fd5a14c2640 1 --2- 172.21.15.94:0/3187176202 >> v2:172.21.15.94:3300/0 conn(0x7fd59c072a50 0x7fd59c070f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.546+0000 7fd5a14c2640 1 --2- 172.21.15.94:0/3187176202 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd59c157100 0x7fd59c072510 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.546+0000 7fd5a14c2640 1 --2- 172.21.15.94:0/3187176202 >> v2:172.21.15.111:3300/0 conn(0x7fd59c1512d0 0x7fd59c0c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.546+0000 7fd5a14c2640 1 -- 172.21.15.94:0/3187176202 >> 172.21.15.94:0/3187176202 conn(0x7fd59c0c9050 msgr2=0x7fd59c0c9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:26.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.546+0000 7fd5a14c2640 1 -- 172.21.15.94:0/3187176202 shutdown_connections 2024-04-25T12:24:26.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.546+0000 7fd5a14c2640 1 -- 172.21.15.94:0/3187176202 wait complete. 2024-04-25T12:24:26.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.550+0000 7fd5a14c2640 1 Processor -- start 2024-04-25T12:24:26.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.550+0000 7fd5a14c2640 1 -- start start 2024-04-25T12:24:26.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.550+0000 7fd5a14c2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd59c072a50 0x7fd59c14d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.550+0000 7fd5a14c2640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd59c1512d0 0x7fd59c0cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.550+0000 7fd5a14c2640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd59c157100 0x7fd59c0cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.550+0000 7fd5a14c2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c06e710 con 0x7fd59c072a50 2024-04-25T12:24:26.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.550+0000 7fd5a14c2640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c06e590 con 0x7fd59c157100 2024-04-25T12:24:26.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.550+0000 7fd5a14c2640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd59c0c8c30 con 0x7fd59c1512d0 2024-04-25T12:24:26.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.550+0000 7fd59b7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd59c157100 0x7fd59c0cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.550+0000 7fd59b7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd59c157100 0x7fd59c0cb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.94:53722/0 (socket says 172.21.15.94:53722) 2024-04-25T12:24:26.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.550+0000 7fd59b7fe640 1 -- 172.21.15.94:0/3206926800 learned_addr learned my addr 172.21.15.94:0/3206926800 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:26.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.550+0000 7fd59affd640 1 --2- 172.21.15.94:0/3206926800 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd59c072a50 0x7fd59c14d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.550+0000 7fd59a7fc640 1 --2- 172.21.15.94:0/3206926800 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd59c1512d0 0x7fd59c0cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.550+0000 7fd59b7fe640 1 -- 172.21.15.94:0/3206926800 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd59c1512d0 msgr2=0x7fd59c0cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.550+0000 7fd59b7fe640 1 --2- 172.21.15.94:0/3206926800 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd59c1512d0 0x7fd59c0cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.550+0000 7fd59b7fe640 1 -- 172.21.15.94:0/3206926800 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd59c072a50 msgr2=0x7fd59c14d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.550+0000 7fd59b7fe640 1 --2- 172.21.15.94:0/3206926800 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd59c072a50 0x7fd59c14d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.550+0000 7fd59b7fe640 1 -- 172.21.15.94:0/3206926800 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59c0c28d0 con 0x7fd59c157100 2024-04-25T12:24:26.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.550+0000 7fd59b7fe640 1 --2- 172.21.15.94:0/3206926800 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd59c157100 0x7fd59c0cb910 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd58c006e10 tx=0x7fd58c00fd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:26.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.550+0000 7fd5837fe640 1 -- 172.21.15.94:0/3206926800 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58c00dc50 con 0x7fd59c157100 2024-04-25T12:24:26.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.554+0000 7fd5a14c2640 1 -- 172.21.15.94:0/3206926800 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd59c0c2b70 con 0x7fd59c157100 2024-04-25T12:24:26.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.554+0000 7fd5a14c2640 1 -- 172.21.15.94:0/3206926800 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd59c0cabd0 con 0x7fd59c157100 2024-04-25T12:24:26.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.554+0000 7fd5837fe640 1 -- 172.21.15.94:0/3206926800 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd58c00ddf0 con 0x7fd59c157100 2024-04-25T12:24:26.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.554+0000 7fd5837fe640 1 -- 172.21.15.94:0/3206926800 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58c004250 con 0x7fd59c157100 2024-04-25T12:24:26.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.554+0000 7fd5a14c2640 1 -- 172.21.15.94:0/3206926800 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd57c0052a0 con 0x7fd59c157100 2024-04-25T12:24:26.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.554+0000 7fd5837fe640 1 -- 172.21.15.94:0/3206926800 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd58c039bb0 con 0x7fd59c157100 2024-04-25T12:24:26.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.554+0000 7fd5837fe640 1 --2- 172.21.15.94:0/3206926800 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd588068380 0x7fd58806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.554+0000 7fd5837fe640 1 -- 172.21.15.94:0/3206926800 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fd58c0871d0 con 0x7fd59c157100 2024-04-25T12:24:26.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.554+0000 7fd59affd640 1 --2- 172.21.15.94:0/3206926800 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd588068380 0x7fd58806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.558+0000 7fd59affd640 1 --2- 172.21.15.94:0/3206926800 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd588068380 0x7fd58806a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd59000bac0 tx=0x7fd590008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:26.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.566+0000 7fd5837fe640 1 -- 172.21.15.94:0/3206926800 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd58c017020 con 0x7fd59c157100 2024-04-25T12:24:26.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.578+0000 7f2c6b380640 1 Processor -- start 2024-04-25T12:24:26.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.578+0000 7f2c6b380640 1 -- start start 2024-04-25T12:24:26.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.578+0000 7f2c6b380640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c640c8120 0x7f2c64163310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.578+0000 7f2c6b380640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c64159a20 con 0x7f2c64159640 2024-04-25T12:24:26.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.578+0000 7f2c6b380640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c6415f570 con 0x7f2c640703c0 2024-04-25T12:24:26.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.578+0000 7f2c6b380640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2c64160180 con 0x7f2c640c8120 2024-04-25T12:24:26.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.578+0000 7f2c6891b640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c640c8120 0x7f2c64163310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.578+0000 7f2c6891b640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c640c8120 0x7f2c64163310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.94:50252/0 (socket says 172.21.15.94:50252) 2024-04-25T12:24:26.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.578+0000 7f2c6891b640 1 -- 172.21.15.94:0/3687046002 learned_addr learned my addr 172.21.15.94:0/3687046002 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:26.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.578+0000 7f2c6911c640 1 --1- 172.21.15.94:0/3687046002 >> v1:172.21.15.94:6789/0 conn(0x7f2c64159640 0x7f2c6406cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39330/0 (socket says 172.21.15.94:39330) 2024-04-25T12:24:26.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.582+0000 7f2c6891b640 1 -- 172.21.15.94:0/3687046002 >> v1:172.21.15.111:6789/0 conn(0x7f2c640703c0 legacy=0x7f2c640c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:26.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.582+0000 7f2c6891b640 1 -- 172.21.15.94:0/3687046002 >> v1:172.21.15.94:6789/0 conn(0x7f2c64159640 legacy=0x7f2c6406cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:26.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.582+0000 7f2c6891b640 1 -- 172.21.15.94:0/3687046002 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6415f850 con 0x7f2c640c8120 2024-04-25T12:24:26.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.582+0000 7fe46692d640 1 Processor -- start 2024-04-25T12:24:26.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.582+0000 7f2c6891b640 1 --2- 172.21.15.94:0/3687046002 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c640c8120 0x7f2c64163310 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c009e80 tx=0x7f2c5c01ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b34d01413be9a68b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:26.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.582+0000 7f2c5bfff640 1 -- 172.21.15.94:0/3687046002 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c0a56e0 con 0x7f2c640c8120 2024-04-25T12:24:26.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.582+0000 7fe46692d640 1 -- start start 2024-04-25T12:24:26.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.582+0000 7f2c5bfff640 1 -- 172.21.15.94:0/3687046002 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c5c0a5880 con 0x7f2c640c8120 2024-04-25T12:24:26.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.582+0000 7f2c5bfff640 1 -- 172.21.15.94:0/3687046002 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c0a5c50 con 0x7f2c640c8120 2024-04-25T12:24:26.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7fe46692d640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe458050cb0 0x7fe4580d5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7fe46692d640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe45804c2e0 0x7fe4580347a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7fe46692d640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe45804b990 con 0x7fe4580dad30 2024-04-25T12:24:26.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7fe46692d640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fe45804bc70 con 0x7fe45804c2e0 2024-04-25T12:24:26.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7fe46692d640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe458006a50 con 0x7fe458050cb0 2024-04-25T12:24:26.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7f2c6b380640 1 -- 172.21.15.94:0/3687046002 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c640c8120 msgr2=0x7f2c64163310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7f2c6b380640 1 --2- 172.21.15.94:0/3687046002 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c640c8120 0x7f2c64163310 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c009e80 tx=0x7f2c5c01ca10 comp rx=0 tx=0).stop 2024-04-25T12:24:26.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7f2c6b380640 1 -- 172.21.15.94:0/3687046002 shutdown_connections 2024-04-25T12:24:26.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7f2c6b380640 1 --2- 172.21.15.94:0/3687046002 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c640c8120 0x7f2c64163310 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7f2c6b380640 1 -- 172.21.15.94:0/3687046002 >> 172.21.15.94:0/3687046002 conn(0x7f2c640ca570 msgr2=0x7f2c640ca980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:26.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7fe46512a640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe45804c2e0 0x7fe4580347a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7fe46512a640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe45804c2e0 0x7fe4580347a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.94:53734/0 (socket says 172.21.15.94:53734) 2024-04-25T12:24:26.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7fe46512a640 1 -- 172.21.15.94:0/2460626783 learned_addr learned my addr 172.21.15.94:0/2460626783 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:26.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7f2c6b380640 1 -- 172.21.15.94:0/3687046002 shutdown_connections 2024-04-25T12:24:26.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7fe46592b640 1 --2- 172.21.15.94:0/2460626783 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe458050cb0 0x7fe4580d5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7fe46512a640 1 -- 172.21.15.94:0/2460626783 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe458050cb0 msgr2=0x7fe4580d5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:26.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7fe46512a640 1 --2- 172.21.15.94:0/2460626783 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe458050cb0 0x7fe4580d5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7fe46512a640 1 -- 172.21.15.94:0/2460626783 >> v1:172.21.15.111:6789/0 conn(0x7fe4580dad30 legacy=0x7fe4580db180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7f2c6b380640 1 -- 172.21.15.94:0/3687046002 wait complete. 2024-04-25T12:24:26.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7fe46512a640 1 -- 172.21.15.94:0/2460626783 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe458006d30 con 0x7fe45804c2e0 2024-04-25T12:24:26.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7fe464929640 1 -- 172.21.15.94:0/2460626783 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2796592407 0 0) 0x7fe45804b990 con 0x7fe4580dad30 2024-04-25T12:24:26.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7fbd2211b640 1 Processor -- start 2024-04-25T12:24:26.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7fbd2211b640 1 -- start start 2024-04-25T12:24:26.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7f2c6b380640 1 Processor -- start 2024-04-25T12:24:26.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7fbd2211b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbd1c06cdc0 0x7fbd1c0c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7fbd2211b640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fbd1c0c36f0 0x7fbd1c073d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7fbd2211b640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd1c06d8e0 con 0x7fbd1c1593e0 2024-04-25T12:24:26.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7fbd2211b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fbd1c06d320 con 0x7fbd1c06cdc0 2024-04-25T12:24:26.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7fbd2211b640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fbd1c06d600 con 0x7fbd1c0c36f0 2024-04-25T12:24:26.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7fbd2191a640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fbd1c0c36f0 0x7fbd1c073d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7fbd2191a640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fbd1c0c36f0 0x7fbd1c073d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.94:53736/0 (socket says 172.21.15.94:53736) 2024-04-25T12:24:26.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7fbd2191a640 1 -- 172.21.15.94:0/2326396561 learned_addr learned my addr 172.21.15.94:0/2326396561 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:26.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fbd20918640 1 --2- 172.21.15.94:0/2326396561 >> v2:172.21.15.94:3300/0 conn(0x7fbd1c06cdc0 0x7fbd1c0c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7f2c6b380640 1 -- start start 2024-04-25T12:24:26.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7f2c6b380640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c640703c0 0x7f2c641503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.586+0000 7f2c6b380640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c640c8120 0x7f2c640cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7f2c6b380640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2c64159640 0x7f2c64159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7f2c6b380640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6416d510 con 0x7f2c640703c0 2024-04-25T12:24:26.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7f2c6b380640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2c64070870 con 0x7f2c64159640 2024-04-25T12:24:26.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7f2c6b380640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2c6416d690 con 0x7f2c640c8120 2024-04-25T12:24:26.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fe46512a640 1 --2- 172.21.15.94:0/2460626783 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe45804c2e0 0x7fe4580347a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe4600512e0 tx=0x7fe46009b3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34625a6678b14e29 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:26.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fbd2191a640 1 -- 172.21.15.94:0/2326396561 >> v2:172.21.15.94:3300/0 conn(0x7fbd1c06cdc0 msgr2=0x7fbd1c0c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:26.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fbd2191a640 1 --2- 172.21.15.94:0/2326396561 >> v2:172.21.15.94:3300/0 conn(0x7fbd1c06cdc0 0x7fbd1c0c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fbd2191a640 1 -- 172.21.15.94:0/2326396561 >> v1:172.21.15.111:6789/0 conn(0x7fbd1c1593e0 legacy=0x7fbd1c06baf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T12:24:26.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7f2c6911c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c640703c0 0x7f2c641503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7f2c6911c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c640703c0 0x7f2c641503f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52066/0 (socket says 172.21.15.94:52066) 2024-04-25T12:24:26.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7f2c6911c640 1 -- 172.21.15.94:0/47895669 learned_addr learned my addr 172.21.15.94:0/47895669 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:26.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fe464929640 1 -- 172.21.15.94:0/2460626783 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe460130070 con 0x7fe45804c2e0 2024-04-25T12:24:26.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7f2c6991d640 1 --2- 172.21.15.94:0/47895669 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2c64159640 0x7f2c64159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7f2c6891b640 1 --2- 172.21.15.94:0/47895669 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c640c8120 0x7f2c640cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fe464929640 1 -- 172.21.15.94:0/2460626783 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe46012b640 con 0x7fe45804c2e0 2024-04-25T12:24:26.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fe464929640 1 -- 172.21.15.94:0/2460626783 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46012ba70 con 0x7fe45804c2e0 2024-04-25T12:24:26.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7f2c6911c640 1 -- 172.21.15.94:0/47895669 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c640c8120 msgr2=0x7f2c640cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7f2c6911c640 1 --2- 172.21.15.94:0/47895669 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c640c8120 0x7f2c640cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7f2c6911c640 1 -- 172.21.15.94:0/47895669 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2c64159640 msgr2=0x7f2c64159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7f2c6911c640 1 --2- 172.21.15.94:0/47895669 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2c64159640 0x7f2c64159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7f2c6911c640 1 -- 172.21.15.94:0/47895669 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6415c8c0 con 0x7f2c640703c0 2024-04-25T12:24:26.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7f2c6911c640 1 --2- 172.21.15.94:0/47895669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c640703c0 0x7f2c641503f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2c5400c430 tx=0x7f2c5400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:26.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fd9d4962640 1 Processor -- start 2024-04-25T12:24:26.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7f2c59ffb640 1 -- 172.21.15.94:0/47895669 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c540074e0 con 0x7f2c640703c0 2024-04-25T12:24:26.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7f2c59ffb640 1 -- 172.21.15.94:0/47895669 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c54007680 con 0x7f2c640703c0 2024-04-25T12:24:26.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7f2c59ffb640 1 -- 172.21.15.94:0/47895669 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c54004a10 con 0x7f2c640703c0 2024-04-25T12:24:26.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7f2c6b380640 1 -- 172.21.15.94:0/47895669 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c6415cba0 con 0x7f2c640703c0 2024-04-25T12:24:26.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7f2c6b380640 1 -- 172.21.15.94:0/47895669 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c641fbb10 con 0x7f2c640703c0 2024-04-25T12:24:26.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fbd2191a640 1 -- 172.21.15.94:0/2326396561 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd1c0c7ce0 con 0x7fbd1c0c36f0 2024-04-25T12:24:26.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fbd20918640 1 --2- 172.21.15.94:0/2326396561 >> v2:172.21.15.94:3300/0 conn(0x7fbd1c06cdc0 0x7fbd1c0c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:24:26.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fd9d4962640 1 -- start start 2024-04-25T12:24:26.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fd9d4962640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd9c8046360 0x7fd9c8046770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fd9d4962640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9c8006940 con 0x7fd9c80dd5e0 2024-04-25T12:24:26.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fd9d4962640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9c8007130 con 0x7fd9c80e71a0 2024-04-25T12:24:26.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fd9d4962640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fd9c804bad0 con 0x7fd9c8046360 2024-04-25T12:24:26.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fd9ced9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd9c8046360 0x7fd9c8046770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fd9cdd9b640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fd9c80e71a0 0x7fd9c8006230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.94:36040/0 (socket says 172.21.15.94:36040) 2024-04-25T12:24:26.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fd9cdd9b640 1 -- 172.21.15.94:0/99589928 learned_addr learned my addr 172.21.15.94:0/99589928 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:26.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fd9ced9d640 1 -- 172.21.15.94:0/99589928 >> v1:172.21.15.111:6789/0 conn(0x7fd9c80e71a0 legacy=0x7fd9c8006230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fd9ced9d640 1 -- 172.21.15.94:0/99589928 >> v1:172.21.15.94:6789/0 conn(0x7fd9c80dd5e0 legacy=0x7fd9c804b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fd9ced9d640 1 -- 172.21.15.94:0/99589928 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c8007410 con 0x7fd9c8046360 2024-04-25T12:24:26.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fe46692d640 1 -- 172.21.15.94:0/2460626783 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe45804c2e0 msgr2=0x7fe4580347a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fe46692d640 1 --2- 172.21.15.94:0/2460626783 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe45804c2e0 0x7fe4580347a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe4600512e0 tx=0x7fe46009b3a0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fe46692d640 1 -- 172.21.15.94:0/2460626783 shutdown_connections 2024-04-25T12:24:26.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fe46692d640 1 --2- 172.21.15.94:0/2460626783 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe45804c2e0 0x7fe4580347a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fe46692d640 1 --2- 172.21.15.94:0/2460626783 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe458050cb0 0x7fe4580d5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7fe46692d640 1 -- 172.21.15.94:0/2460626783 >> 172.21.15.94:0/2460626783 conn(0x7fe458050190 msgr2=0x7fe4580505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:26.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7f29260be640 1 Processor -- start 2024-04-25T12:24:26.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.590+0000 7f29260be640 1 -- start start 2024-04-25T12:24:26.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7fbd2191a640 1 --2- 172.21.15.94:0/2326396561 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbd1c0c36f0 0x7fbd1c073d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0c64b0 tx=0x7fbd1801c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=313c2a2a04f863f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:26.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7fbd13fff640 1 -- 172.21.15.94:0/2326396561 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd180b1070 con 0x7fbd1c0c36f0 2024-04-25T12:24:26.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7fbd13fff640 1 -- 172.21.15.94:0/2326396561 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd180ac630 con 0x7fbd1c0c36f0 2024-04-25T12:24:26.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7fbd13fff640 1 -- 172.21.15.94:0/2326396561 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd180a8050 con 0x7fbd1c0c36f0 2024-04-25T12:24:26.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7fe46692d640 1 -- 172.21.15.94:0/2460626783 shutdown_connections 2024-04-25T12:24:26.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7fe46692d640 1 -- 172.21.15.94:0/2460626783 wait complete. 2024-04-25T12:24:26.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7f29260be640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f292006e800 0x7f292006ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7f291f7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f292006e800 0x7f292006ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7f291f7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f292006e800 0x7f292006ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52086/0 (socket says 172.21.15.94:52086) 2024-04-25T12:24:26.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7f291f7fe640 1 -- 172.21.15.94:0/261272075 learned_addr learned my addr 172.21.15.94:0/261272075 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:26.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7f29260be640 1 --2- 172.21.15.94:0/261272075 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f292016b3a0 0x7f29200ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7f29260be640 1 -- 172.21.15.94:0/261272075 --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29200c6360 con 0x7f29200cbd10 2024-04-25T12:24:26.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7f2c6b380640 1 -- 172.21.15.94:0/47895669 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c64075df0 con 0x7f2c640703c0 2024-04-25T12:24:26.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7f2c59ffb640 1 -- 172.21.15.94:0/47895669 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2c5401a020 con 0x7f2c640703c0 2024-04-25T12:24:26.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7f2c59ffb640 1 --2- 172.21.15.94:0/47895669 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2c48068450 0x7f2c4806a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7f2c59ffb640 1 -- 172.21.15.94:0/47895669 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f2c54086490 con 0x7f2c640703c0 2024-04-25T12:24:26.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7f29260be640 1 -- 172.21.15.94:0/261272075 --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f2920071790 con 0x7f292006e800 2024-04-25T12:24:26.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7f29260be640 1 -- 172.21.15.94:0/261272075 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f29200cb100 con 0x7f292016b3a0 2024-04-25T12:24:26.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7fbd2211b640 1 -- 172.21.15.94:0/2326396561 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbd1c0c36f0 msgr2=0x7fbd1c073d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7fbd2211b640 1 --2- 172.21.15.94:0/2326396561 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbd1c0c36f0 0x7fbd1c073d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0c64b0 tx=0x7fbd1801c4e0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7fe46692d640 1 Processor -- start 2024-04-25T12:24:26.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7fbd2211b640 1 -- 172.21.15.94:0/2326396561 shutdown_connections 2024-04-25T12:24:26.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7fbd2211b640 1 --2- 172.21.15.94:0/2326396561 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbd1c0c36f0 0x7fbd1c073d40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7fbd2211b640 1 --2- 172.21.15.94:0/2326396561 >> v2:172.21.15.94:3300/0 conn(0x7fbd1c06cdc0 0x7fbd1c0c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7fbd2211b640 1 -- 172.21.15.94:0/2326396561 >> 172.21.15.94:0/2326396561 conn(0x7fbd1c06e0d0 msgr2=0x7fbd1c06e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:26.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7f2c6891b640 1 --2- 172.21.15.94:0/47895669 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2c48068450 0x7f2c4806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7f2c6891b640 1 --2- 172.21.15.94:0/47895669 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2c48068450 0x7f2c4806a910 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0ae000 tx=0x7f2c5c0a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:26.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7fd9ced9d640 1 --2- 172.21.15.94:0/99589928 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9c8046360 0x7fd9c8046770 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0009740 tx=0x7fd9c001c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05f181ba4d5cc8d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:26.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fe2b91ba640 1 Processor -- start 2024-04-25T12:24:26.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7fe46692d640 1 -- start start 2024-04-25T12:24:26.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7fe46692d640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe45804c2e0 0x7fe4580497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7fe46692d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe458050cb0 0x7fe458184160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7fe46692d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4580dad30 0x7fe4581846a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7fe46692d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe458034ce0 con 0x7fe4580dad30 2024-04-25T12:24:26.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7fe46692d640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe458045130 con 0x7fe458050cb0 2024-04-25T12:24:26.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7fe46692d640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe45804c720 con 0x7fe45804c2e0 2024-04-25T12:24:26.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7f291f7fe640 1 -- 172.21.15.94:0/261272075 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f292016b3a0 msgr2=0x7f29200ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:26.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7f291f7fe640 1 --2- 172.21.15.94:0/261272075 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f292016b3a0 0x7f29200ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7f291f7fe640 1 -- 172.21.15.94:0/261272075 >> v1:172.21.15.111:6789/0 conn(0x7f29200cbd10 legacy=0x7f29200cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.594+0000 7f291f7fe640 1 -- 172.21.15.94:0/261272075 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292006f720 con 0x7f292006e800 2024-04-25T12:24:26.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fbd2211b640 1 -- 172.21.15.94:0/2326396561 shutdown_connections 2024-04-25T12:24:26.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fe2b91ba640 1 -- start start 2024-04-25T12:24:26.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7f89293e0640 1 Processor -- start 2024-04-25T12:24:26.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fe46512a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe458050cb0 0x7fe458184160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fe46612c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4580dad30 0x7fe4581846a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fe46512a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe458050cb0 0x7fe458184160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.94:53750/0 (socket says 172.21.15.94:53750) 2024-04-25T12:24:26.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fe46612c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4580dad30 0x7fe4581846a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52096/0 (socket says 172.21.15.94:52096) 2024-04-25T12:24:26.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fe46512a640 1 -- 172.21.15.94:0/3515025246 learned_addr learned my addr 172.21.15.94:0/3515025246 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:26.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fe46592b640 1 --2- 172.21.15.94:0/3515025246 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe45804c2e0 0x7fe4580497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7f89293e0640 1 -- start start 2024-04-25T12:24:26.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fe46612c640 1 -- 172.21.15.94:0/3515025246 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe45804c2e0 msgr2=0x7fe4580497a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fe46612c640 1 --2- 172.21.15.94:0/3515025246 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe45804c2e0 0x7fe4580497a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fe46612c640 1 -- 172.21.15.94:0/3515025246 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe458050cb0 msgr2=0x7fe458184160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fe46612c640 1 --2- 172.21.15.94:0/3515025246 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe458050cb0 0x7fe458184160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fe46612c640 1 -- 172.21.15.94:0/3515025246 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe45804a3c0 con 0x7fe4580dad30 2024-04-25T12:24:26.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fe46612c640 1 --2- 172.21.15.94:0/3515025246 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4580dad30 0x7fe4581846a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe45000c3e0 tx=0x7fe45000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:26.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7f89293e0640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f89241512d0 0x7f89240c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7f89293e0640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8924157100 0x7f8924072510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7f89293e0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8924072a50 0x7f8924070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7f89293e0640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f8924071a50 con 0x7f8924072a50 2024-04-25T12:24:26.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7f89293e0640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f89240c77e0 con 0x7f89241512d0 2024-04-25T12:24:26.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7f89293e0640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f89240c7ac0 con 0x7f8924157100 2024-04-25T12:24:26.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fbd2211b640 1 -- 172.21.15.94:0/2326396561 wait complete. 2024-04-25T12:24:26.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fe2b91ba640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe2ac0d5be0 0x7fe2ac04c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fe2b91ba640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2ac035290 con 0x7fe2ac046200 2024-04-25T12:24:26.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fe2b91ba640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2ac005fc0 con 0x7fe2ac0d5800 2024-04-25T12:24:26.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fe2b91ba640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fe2ac035530 con 0x7fe2ac0d5be0 2024-04-25T12:24:26.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7f8922ffd640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f89241512d0 0x7f89240c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7f89227fc640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8924157100 0x7f8924072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7f8922ffd640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f89241512d0 0x7f89240c6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.94:53754/0 (socket says 172.21.15.94:53754) 2024-04-25T12:24:26.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7f8922ffd640 1 -- 172.21.15.94:0/1156942950 learned_addr learned my addr 172.21.15.94:0/1156942950 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:26.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7f291f7fe640 1 --2- 172.21.15.94:0/261272075 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f292006e800 0x7f292006ebe0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2914007040 tx=0x7f291401fd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3a224cfe5ca505 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:26.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fe2b3fff640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fe2ac0d5800 0x7fe2ac045af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.94:36046/0 (socket says 172.21.15.94:36046) 2024-04-25T12:24:26.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fe2b3fff640 1 -- 172.21.15.94:0/1428259763 learned_addr learned my addr 172.21.15.94:0/1428259763 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:26.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7f89227fc640 1 --2- 172.21.15.94:0/1156942950 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8924157100 0x7f8924072510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.94:50304/0 (socket says 172.21.15.94:50304) 2024-04-25T12:24:26.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fe2b89b9640 1 --2- 172.21.15.94:0/1428259763 >> v2:172.21.15.94:3300/0 conn(0x7fe2ac0d5be0 0x7fe2ac04c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7f89227fc640 1 -- 172.21.15.94:0/1156942950 >> v2:172.21.15.111:3300/0 conn(0x7f89241512d0 msgr2=0x7f89240c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:26.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7f89227fc640 1 --2- 172.21.15.94:0/1156942950 >> v2:172.21.15.111:3300/0 conn(0x7f89241512d0 0x7f89240c6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7f89227fc640 1 -- 172.21.15.94:0/1156942950 >> v2:172.21.15.94:3300/0 conn(0x7f8924072a50 msgr2=0x7f8924070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:26.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7f89227fc640 1 --2- 172.21.15.94:0/1156942950 >> v2:172.21.15.94:3300/0 conn(0x7f8924072a50 0x7f8924070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7f89227fc640 1 -- 172.21.15.94:0/1156942950 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89240c7da0 con 0x7f8924157100 2024-04-25T12:24:26.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7f8922ffd640 1 --2- 172.21.15.94:0/1156942950 >> v2:172.21.15.111:3300/0 conn(0x7f89241512d0 0x7f89240c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:24:26.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fe2b89b9640 1 -- 172.21.15.94:0/1428259763 >> v1:172.21.15.111:6789/0 conn(0x7fe2ac0d5800 legacy=0x7fe2ac045af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fe2b89b9640 1 -- 172.21.15.94:0/1428259763 >> v1:172.21.15.94:6789/0 conn(0x7fe2ac046200 legacy=0x7fe2ac0def90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fe2b89b9640 1 -- 172.21.15.94:0/1428259763 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2ac035810 con 0x7fe2ac0d5be0 2024-04-25T12:24:26.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fbd2211b640 1 Processor -- start 2024-04-25T12:24:26.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fbd2211b640 1 -- start start 2024-04-25T12:24:26.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fbd2211b640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbd1c06cdc0 0x7fbd1c15c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fbd2211b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbd1c0c36f0 0x7fbd1c1fbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fbd2211b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd1c1593e0 0x7fbd1c1fc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fbd2211b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1c159940 con 0x7fbd1c1593e0 2024-04-25T12:24:26.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fbd2211b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1c1597c0 con 0x7fbd1c0c36f0 2024-04-25T12:24:26.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fbd2211b640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fbd1c06c200 con 0x7fbd1c06cdc0 2024-04-25T12:24:26.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fbd2191a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd1c1593e0 0x7fbd1c1fc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fbd2191a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd1c1593e0 0x7fbd1c1fc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52116/0 (socket says 172.21.15.94:52116) 2024-04-25T12:24:26.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.598+0000 7fbd2191a640 1 -- 172.21.15.94:0/1586099254 learned_addr learned my addr 172.21.15.94:0/1586099254 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:26.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7fbd21119640 1 --2- 172.21.15.94:0/1586099254 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbd1c06cdc0 0x7fbd1c15c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7fbd20918640 1 --2- 172.21.15.94:0/1586099254 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbd1c0c36f0 0x7fbd1c1fbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7fbd2191a640 1 -- 172.21.15.94:0/1586099254 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbd1c06cdc0 msgr2=0x7fbd1c15c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7fbd2191a640 1 --2- 172.21.15.94:0/1586099254 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbd1c06cdc0 0x7fbd1c15c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7fbd2191a640 1 -- 172.21.15.94:0/1586099254 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbd1c0c36f0 msgr2=0x7fbd1c1fbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7fbd2191a640 1 --2- 172.21.15.94:0/1586099254 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbd1c0c36f0 0x7fbd1c1fbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7fbd2191a640 1 -- 172.21.15.94:0/1586099254 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd1c15e950 con 0x7fbd1c1593e0 2024-04-25T12:24:26.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7fbd2191a640 1 --2- 172.21.15.94:0/1586099254 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd1c1593e0 0x7fbd1c1fc0b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbd180190f0 tx=0x7fbd18019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:26.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7fe2b89b9640 1 --2- 172.21.15.94:0/1428259763 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2ac0d5be0 0x7fe2ac04c6d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe2a00097c0 tx=0x7fe2a001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec044a746b5f01d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:26.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7f89227fc640 1 --2- 172.21.15.94:0/1156942950 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8924157100 0x7f8924072510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f892406de00 tx=0x7f891801c5e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1177256504c6569 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:26.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7f8921ffb640 1 -- 172.21.15.94:0/1156942950 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89180ae020 con 0x7f8924157100 2024-04-25T12:24:26.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7f8921ffb640 1 -- 172.21.15.94:0/1156942950 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89180a6670 con 0x7f8924157100 2024-04-25T12:24:26.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7f8921ffb640 1 -- 172.21.15.94:0/1156942950 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89180a6a40 con 0x7f8924157100 2024-04-25T12:24:26.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7f89293e0640 1 -- 172.21.15.94:0/1156942950 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8924157100 msgr2=0x7f8924072510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7f89293e0640 1 --2- 172.21.15.94:0/1156942950 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8924157100 0x7f8924072510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f892406de00 tx=0x7f891801c5e0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7f89293e0640 1 -- 172.21.15.94:0/1156942950 shutdown_connections 2024-04-25T12:24:26.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7f89293e0640 1 --2- 172.21.15.94:0/1156942950 >> v2:172.21.15.94:3300/0 conn(0x7f8924072a50 0x7f8924070f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7f89293e0640 1 --2- 172.21.15.94:0/1156942950 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8924157100 0x7f8924072510 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7f89293e0640 1 --2- 172.21.15.94:0/1156942950 >> v2:172.21.15.111:3300/0 conn(0x7f89241512d0 0x7f89240c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7f89293e0640 1 -- 172.21.15.94:0/1156942950 >> 172.21.15.94:0/1156942950 conn(0x7f89240c9050 msgr2=0x7f89240c9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:26.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7f89293e0640 1 -- 172.21.15.94:0/1156942950 shutdown_connections 2024-04-25T12:24:26.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7f89293e0640 1 -- 172.21.15.94:0/1156942950 wait complete. 2024-04-25T12:24:26.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7f89293e0640 1 Processor -- start 2024-04-25T12:24:26.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7f291e7fc640 1 -- 172.21.15.94:0/261272075 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29140a9b60 con 0x7f292006e800 2024-04-25T12:24:26.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7fd9cd59a640 1 -- 172.21.15.94:0/99589928 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c00b0070 con 0x7fd9c8046360 2024-04-25T12:24:26.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7fe4567fc640 1 -- 172.21.15.94:0/3515025246 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe450017070 con 0x7fe4580dad30 2024-04-25T12:24:26.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7fe46692d640 1 -- 172.21.15.94:0/3515025246 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe458048700 con 0x7fe4580dad30 2024-04-25T12:24:26.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7fe46692d640 1 -- 172.21.15.94:0/3515025246 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe458048cc0 con 0x7fe4580dad30 2024-04-25T12:24:26.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7f2c59ffb640 1 -- 172.21.15.94:0/47895669 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2c54055ff0 con 0x7f2c640703c0 2024-04-25T12:24:26.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7fe4567fc640 1 -- 172.21.15.94:0/3515025246 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe450003600 con 0x7fe4580dad30 2024-04-25T12:24:26.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7fe4567fc640 1 -- 172.21.15.94:0/3515025246 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4500039b0 con 0x7fe4580dad30 2024-04-25T12:24:26.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7f291e7fc640 1 -- 172.21.15.94:0/261272075 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29140a9d00 con 0x7f292006e800 2024-04-25T12:24:26.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7f291e7fc640 1 -- 172.21.15.94:0/261272075 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2914007af0 con 0x7f292006e800 2024-04-25T12:24:26.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7f29260be640 1 -- 172.21.15.94:0/261272075 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f292006e800 msgr2=0x7f292006ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7f29260be640 1 --2- 172.21.15.94:0/261272075 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f292006e800 0x7f292006ebe0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2914007040 tx=0x7f291401fd90 comp rx=0 tx=0).stop 2024-04-25T12:24:26.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7fd9cd59a640 1 -- 172.21.15.94:0/99589928 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9c00ab600 con 0x7fd9c8046360 2024-04-25T12:24:26.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7fd9cd59a640 1 -- 172.21.15.94:0/99589928 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c00ab9d0 con 0x7fd9c8046360 2024-04-25T12:24:26.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7fd9d4962640 1 -- 172.21.15.94:0/99589928 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9c8046360 msgr2=0x7fd9c8046770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7fd9d4962640 1 --2- 172.21.15.94:0/99589928 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9c8046360 0x7fd9c8046770 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0009740 tx=0x7fd9c001c350 comp rx=0 tx=0).stop 2024-04-25T12:24:26.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7fd9d4962640 1 -- 172.21.15.94:0/99589928 shutdown_connections 2024-04-25T12:24:26.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7fd9d4962640 1 --2- 172.21.15.94:0/99589928 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9c8046360 0x7fd9c8046770 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7fd9d4962640 1 -- 172.21.15.94:0/99589928 >> 172.21.15.94:0/99589928 conn(0x7fd9c804d4c0 msgr2=0x7fd9c804d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:26.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7fe2b2ffd640 1 -- 172.21.15.94:0/1428259763 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a00b5070 con 0x7fe2ac0d5be0 2024-04-25T12:24:26.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7fe2b2ffd640 1 -- 172.21.15.94:0/1428259763 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a00a8990 con 0x7fe2ac0d5be0 2024-04-25T12:24:26.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7fe2b2ffd640 1 -- 172.21.15.94:0/1428259763 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a00a8d60 con 0x7fe2ac0d5be0 2024-04-25T12:24:26.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7fe2b91ba640 1 -- 172.21.15.94:0/1428259763 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2ac0d5be0 msgr2=0x7fe2ac04c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7fe2b91ba640 1 --2- 172.21.15.94:0/1428259763 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2ac0d5be0 0x7fe2ac04c6d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe2a00097c0 tx=0x7fe2a001ec90 comp rx=0 tx=0).stop 2024-04-25T12:24:26.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.602+0000 7f89293e0640 1 -- start start 2024-04-25T12:24:26.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7f89293e0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8924072a50 0x7f8924159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7f89293e0640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f89241512d0 0x7f89240c5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7f89293e0640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8924157100 0x7f89241f8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7f89293e0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f892406e710 con 0x7f8924072a50 2024-04-25T12:24:26.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7f89293e0640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f892406e590 con 0x7f89241512d0 2024-04-25T12:24:26.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7f89293e0640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f89240c8c30 con 0x7f8924157100 2024-04-25T12:24:26.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7fbd11ffb640 1 -- 172.21.15.94:0/1586099254 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd180b1050 con 0x7fbd1c1593e0 2024-04-25T12:24:26.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7fbd11ffb640 1 -- 172.21.15.94:0/1586099254 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd180bb070 con 0x7fbd1c1593e0 2024-04-25T12:24:26.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7fbd11ffb640 1 -- 172.21.15.94:0/1586099254 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd180a8040 con 0x7fbd1c1593e0 2024-04-25T12:24:26.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7fbd2211b640 1 -- 172.21.15.94:0/1586099254 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd1c1f6ec0 con 0x7fbd1c1593e0 2024-04-25T12:24:26.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7fe2b91ba640 1 -- 172.21.15.94:0/1428259763 shutdown_connections 2024-04-25T12:24:26.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7fe2b91ba640 1 --2- 172.21.15.94:0/1428259763 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2ac0d5be0 0x7fe2ac04c6d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7fe2b91ba640 1 -- 172.21.15.94:0/1428259763 >> 172.21.15.94:0/1428259763 conn(0x7fe2ac050190 msgr2=0x7fe2ac0505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:26.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7fbd2211b640 1 -- 172.21.15.94:0/1586099254 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd1c15e670 con 0x7fbd1c1593e0 2024-04-25T12:24:26.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7f8922ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8924072a50 0x7f8924159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7f8922ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8924072a50 0x7f8924159f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52132/0 (socket says 172.21.15.94:52132) 2024-04-25T12:24:26.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7f8922ffd640 1 -- 172.21.15.94:0/3737516824 learned_addr learned my addr 172.21.15.94:0/3737516824 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:26.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7f89227fc640 1 --2- 172.21.15.94:0/3737516824 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f89241512d0 0x7f89240c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7f8922ffd640 1 -- 172.21.15.94:0/3737516824 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8924157100 msgr2=0x7f89241f8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7f8922ffd640 1 --2- 172.21.15.94:0/3737516824 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8924157100 0x7f89241f8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7f8922ffd640 1 -- 172.21.15.94:0/3737516824 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f89241512d0 msgr2=0x7f89240c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7f8922ffd640 1 --2- 172.21.15.94:0/3737516824 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f89241512d0 0x7f89240c5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7f8922ffd640 1 -- 172.21.15.94:0/3737516824 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89240ca540 con 0x7f8924072a50 2024-04-25T12:24:26.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7f8922ffd640 1 --2- 172.21.15.94:0/3737516824 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8924072a50 0x7f8924159f60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f891c009e80 tx=0x7f891c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:26.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7fe46692d640 1 -- 172.21.15.94:0/3515025246 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4480052a0 con 0x7fe4580dad30 2024-04-25T12:24:26.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7fe2b91ba640 1 -- 172.21.15.94:0/1428259763 shutdown_connections 2024-04-25T12:24:26.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7fbd2211b640 1 -- 172.21.15.94:0/1586099254 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd1c076440 con 0x7fbd1c1593e0 2024-04-25T12:24:26.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7fe2b91ba640 1 -- 172.21.15.94:0/1428259763 wait complete. 2024-04-25T12:24:26.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7fe2b91ba640 1 Processor -- start 2024-04-25T12:24:26.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.606+0000 7fe2b91ba640 1 -- start start 2024-04-25T12:24:26.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7fe2b91ba640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe2ac0d5800 0x7fe2ac0dea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7fe2b91ba640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe2ac0d5be0 0x7fe2ac0d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7fe2b91ba640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2ac165150 0x7fe2ac1658a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7fe2b91ba640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ac006250 con 0x7fe2ac165150 2024-04-25T12:24:26.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7fe2b91ba640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ac035dd0 con 0x7fe2ac0d5800 2024-04-25T12:24:26.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7fe2b91ba640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe2ac0063d0 con 0x7fe2ac0d5be0 2024-04-25T12:24:26.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7fe2b89b9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2ac165150 0x7fe2ac1658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7fe2b89b9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2ac165150 0x7fe2ac1658a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52136/0 (socket says 172.21.15.94:52136) 2024-04-25T12:24:26.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7fe2b89b9640 1 -- 172.21.15.94:0/2241685428 learned_addr learned my addr 172.21.15.94:0/2241685428 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:26.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7fe2b89b9640 1 -- 172.21.15.94:0/2241685428 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe2ac0d5be0 msgr2=0x7fe2ac0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7fe2b89b9640 1 --2- 172.21.15.94:0/2241685428 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe2ac0d5be0 0x7fe2ac0d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7fe2b89b9640 1 -- 172.21.15.94:0/2241685428 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe2ac0d5800 msgr2=0x7fe2ac0dea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7fe2b89b9640 1 --2- 172.21.15.94:0/2241685428 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe2ac0d5800 0x7fe2ac0dea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7fe2b89b9640 1 -- 172.21.15.94:0/2241685428 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2ac167040 con 0x7fe2ac165150 2024-04-25T12:24:26.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7fe2b89b9640 1 --2- 172.21.15.94:0/2241685428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2ac165150 0x7fe2ac1658a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe2a001c8c0 tx=0x7fe2a001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:26.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7fe4567fc640 1 -- 172.21.15.94:0/3515025246 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe45001a070 con 0x7fe4580dad30 2024-04-25T12:24:26.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7fe4567fc640 1 --2- 172.21.15.94:0/3515025246 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe444068380 0x7fe44406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7fe4567fc640 1 -- 172.21.15.94:0/3515025246 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fe450086860 con 0x7fe4580dad30 2024-04-25T12:24:26.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7fe46592b640 1 --2- 172.21.15.94:0/3515025246 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe444068380 0x7fe44406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7f890b7fe640 1 -- 172.21.15.94:0/3737516824 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891c00ce00 con 0x7f8924072a50 2024-04-25T12:24:26.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7f89293e0640 1 -- 172.21.15.94:0/3737516824 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89240ca800 con 0x7f8924072a50 2024-04-25T12:24:26.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7f89293e0640 1 -- 172.21.15.94:0/3737516824 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89241fc320 con 0x7f8924072a50 2024-04-25T12:24:26.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7f89293e0640 1 -- 172.21.15.94:0/3737516824 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8924076440 con 0x7f8924072a50 2024-04-25T12:24:26.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7fbd11ffb640 1 -- 172.21.15.94:0/1586099254 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbd180ab820 con 0x7fbd1c1593e0 2024-04-25T12:24:26.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7fbd11ffb640 1 --2- 172.21.15.94:0/1586099254 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fbd00068380 0x7fbd0006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7fe46592b640 1 --2- 172.21.15.94:0/3515025246 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe444068380 0x7fe44406a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe45c009af0 tx=0x7fe45c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:26.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7fbd21119640 1 --2- 172.21.15.94:0/1586099254 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fbd00068380 0x7fbd0006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7fbd21119640 1 --2- 172.21.15.94:0/1586099254 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fbd00068380 0x7fbd0006a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c009890 tx=0x7fbd0c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:26.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7fd9d4962640 1 -- 172.21.15.94:0/99589928 shutdown_connections 2024-04-25T12:24:26.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.610+0000 7fd9d4962640 1 -- 172.21.15.94:0/99589928 wait complete. 2024-04-25T12:24:26.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7f29260be640 1 -- 172.21.15.94:0/261272075 shutdown_connections 2024-04-25T12:24:26.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7f29260be640 1 --2- 172.21.15.94:0/261272075 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f292016b3a0 0x7f29200ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7f29260be640 1 --2- 172.21.15.94:0/261272075 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f292006e800 0x7f292006ebe0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7f29260be640 1 -- 172.21.15.94:0/261272075 >> 172.21.15.94:0/261272075 conn(0x7f29200cc380 msgr2=0x7f29200cc790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:26.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7f29260be640 1 -- 172.21.15.94:0/261272075 shutdown_connections 2024-04-25T12:24:26.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7fd9d4962640 1 Processor -- start 2024-04-25T12:24:26.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7fd9d4962640 1 -- start start 2024-04-25T12:24:26.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7fd9d4962640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9c8046360 0x7fd9c80d4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7fd9d4962640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd9c80dd5e0 0x7fd9c80d7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7fd9d4962640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd9c80e71a0 0x7fd9c817c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7fd9d4962640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c8007d40 con 0x7fd9c8046360 2024-04-25T12:24:26.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7fd9d4962640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c8006c00 con 0x7fd9c80dd5e0 2024-04-25T12:24:26.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7fd9d4962640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd9c80081b0 con 0x7fd9c80e71a0 2024-04-25T12:24:26.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7fd9ce59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9c8046360 0x7fd9c80d4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7fd9ce59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9c8046360 0x7fd9c80d4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52140/0 (socket says 172.21.15.94:52140) 2024-04-25T12:24:26.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7fd9ce59c640 1 -- 172.21.15.94:0/3937136957 learned_addr learned my addr 172.21.15.94:0/3937136957 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:26.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7fd9ced9d640 1 --2- 172.21.15.94:0/3937136957 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd9c80e71a0 0x7fd9c817c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7fd9ce59c640 1 -- 172.21.15.94:0/3937136957 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd9c80e71a0 msgr2=0x7fd9c817c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7fd9ce59c640 1 --2- 172.21.15.94:0/3937136957 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd9c80e71a0 0x7fd9c817c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7fd9ce59c640 1 -- 172.21.15.94:0/3937136957 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd9c80dd5e0 msgr2=0x7fd9c80d7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7fd9ce59c640 1 --2- 172.21.15.94:0/3937136957 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd9c80dd5e0 0x7fd9c80d7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7fd9ce59c640 1 -- 172.21.15.94:0/3937136957 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c80e1010 con 0x7fd9c8046360 2024-04-25T12:24:26.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7fd9ce59c640 1 --2- 172.21.15.94:0/3937136957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9c8046360 0x7fd9c80d4d70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd9c400c440 tx=0x7fd9c400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:26.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7f29260be640 1 -- 172.21.15.94:0/261272075 wait complete. 2024-04-25T12:24:26.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7f29260be640 1 Processor -- start 2024-04-25T12:24:26.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7fe4567fc640 1 -- 172.21.15.94:0/3515025246 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe450021070 con 0x7fe4580dad30 2024-04-25T12:24:26.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7f890b7fe640 1 -- 172.21.15.94:0/3737516824 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f891c019070 con 0x7f8924072a50 2024-04-25T12:24:26.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7fbd11ffb640 1 -- 172.21.15.94:0/1586099254 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fbd180ef440 con 0x7fbd1c1593e0 2024-04-25T12:24:26.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7f890b7fe640 1 -- 172.21.15.94:0/3737516824 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891c003ba0 con 0x7f8924072a50 2024-04-25T12:24:26.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7f29260be640 1 -- start start 2024-04-25T12:24:26.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7f29260be640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f292006e800 0x7f292020f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7f29260be640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f29200cbd10 0x7f29200c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7f29260be640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f292016b3a0 0x7f29201f7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7f29260be640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2920071fa0 con 0x7f292006e800 2024-04-25T12:24:26.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7f29260be640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2920071cc0 con 0x7f292016b3a0 2024-04-25T12:24:26.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7f29260be640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f29200cad90 con 0x7f29200cbd10 2024-04-25T12:24:26.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7f291f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f292006e800 0x7f292020f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7f291f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f292006e800 0x7f292020f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52148/0 (socket says 172.21.15.94:52148) 2024-04-25T12:24:26.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7f291f7fe640 1 -- 172.21.15.94:0/1884004493 learned_addr learned my addr 172.21.15.94:0/1884004493 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:26.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7f291effd640 1 --2- 172.21.15.94:0/1884004493 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f29200cbd10 0x7f29200c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7f291ffff640 1 --2- 172.21.15.94:0/1884004493 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f292016b3a0 0x7f29201f7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7fe2b0ff9640 1 -- 172.21.15.94:0/2241685428 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a00b5040 con 0x7fe2ac165150 2024-04-25T12:24:26.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.614+0000 7fe2b91ba640 1 -- 172.21.15.94:0/2241685428 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2ac0ddb50 con 0x7fe2ac165150 2024-04-25T12:24:26.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.618+0000 7fe2b91ba640 1 -- 172.21.15.94:0/2241685428 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2ac167ae0 con 0x7fe2ac165150 2024-04-25T12:24:26.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.618+0000 7fd9beffd640 1 -- 172.21.15.94:0/3937136957 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c40052d0 con 0x7fd9c8046360 2024-04-25T12:24:26.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.618+0000 7fd9d4962640 1 -- 172.21.15.94:0/3937136957 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9c80e12b0 con 0x7fd9c8046360 2024-04-25T12:24:26.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.618+0000 7f291effd640 1 -- 172.21.15.94:0/1884004493 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f292016b3a0 msgr2=0x7f29201f7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.618+0000 7f291effd640 1 --2- 172.21.15.94:0/1884004493 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f292016b3a0 0x7f29201f7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.618+0000 7f291effd640 1 -- 172.21.15.94:0/1884004493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f292006e800 msgr2=0x7f292020f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.618+0000 7f291effd640 1 --2- 172.21.15.94:0/1884004493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f292006e800 0x7f292020f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.618+0000 7f291effd640 1 -- 172.21.15.94:0/1884004493 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2920163f90 con 0x7f29200cbd10 2024-04-25T12:24:26.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.618+0000 7f291f7fe640 1 --2- 172.21.15.94:0/1884004493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f292006e800 0x7f292020f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:24:26.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.618+0000 7fd9d4962640 1 -- 172.21.15.94:0/3937136957 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9c817cc90 con 0x7fd9c8046360 2024-04-25T12:24:26.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.618+0000 7f291effd640 1 --2- 172.21.15.94:0/1884004493 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f29200cbd10 0x7f29200c89a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f29200cc130 tx=0x7f290c00c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:26.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.618+0000 7f290bfff640 1 -- 172.21.15.94:0/1884004493 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c017070 con 0x7f29200cbd10 2024-04-25T12:24:26.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.618+0000 7fd9d4962640 1 -- 172.21.15.94:0/3937136957 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9c80057f0 con 0x7fd9c8046360 2024-04-25T12:24:26.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.618+0000 7fe2b91ba640 1 -- 172.21.15.94:0/2241685428 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2ac0053a0 con 0x7fe2ac165150 2024-04-25T12:24:26.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.618+0000 7f290bfff640 1 -- 172.21.15.94:0/1884004493 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f290c0052d0 con 0x7f29200cbd10 2024-04-25T12:24:26.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.618+0000 7f29260be640 1 -- 172.21.15.94:0/1884004493 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29200c6a50 con 0x7f29200cbd10 2024-04-25T12:24:26.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.618+0000 7f29260be640 1 -- 172.21.15.94:0/1884004493 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f29200c6fd0 con 0x7f29200cbd10 2024-04-25T12:24:26.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.618+0000 7f29260be640 1 -- 172.21.15.94:0/1884004493 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2920076440 con 0x7f29200cbd10 2024-04-25T12:24:26.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.618+0000 7f290bfff640 1 -- 172.21.15.94:0/1884004493 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c003840 con 0x7f29200cbd10 2024-04-25T12:24:26.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.622+0000 7f290bfff640 1 -- 172.21.15.94:0/1884004493 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f290c01a070 con 0x7f29200cbd10 2024-04-25T12:24:26.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.622+0000 7f290bfff640 1 --2- 172.21.15.94:0/1884004493 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f29040683b0 0x7f290406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.622+0000 7f290bfff640 1 -- 172.21.15.94:0/1884004493 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f290c0864f0 con 0x7f29200cbd10 2024-04-25T12:24:26.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.622+0000 7f291f7fe640 1 --2- 172.21.15.94:0/1884004493 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f29040683b0 0x7f290406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.622+0000 7f291f7fe640 1 --2- 172.21.15.94:0/1884004493 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f29040683b0 0x7f290406a870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f291401fdd0 tx=0x7f291400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:26.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.622+0000 7fbd11ffb640 1 -- 172.21.15.94:0/1586099254 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbd180160d0 con 0x7fbd1c1593e0 2024-04-25T12:24:26.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.626+0000 7fe2b0ff9640 1 -- 172.21.15.94:0/2241685428 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a00c0070 con 0x7fe2ac165150 2024-04-25T12:24:26.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.626+0000 7fe2b0ff9640 1 -- 172.21.15.94:0/2241685428 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a00b1b00 con 0x7fe2ac165150 2024-04-25T12:24:26.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.626+0000 7fd9beffd640 1 -- 172.21.15.94:0/3937136957 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9c4005470 con 0x7fd9c8046360 2024-04-25T12:24:26.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.626+0000 7fd9beffd640 1 -- 172.21.15.94:0/3937136957 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4012830 con 0x7fd9c8046360 2024-04-25T12:24:26.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.626+0000 7f890b7fe640 1 -- 172.21.15.94:0/3737516824 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f891c012050 con 0x7f8924072a50 2024-04-25T12:24:26.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.626+0000 7f890b7fe640 1 --2- 172.21.15.94:0/3737516824 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8910068380 0x7f891006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.626+0000 7f890b7fe640 1 -- 172.21.15.94:0/3737516824 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f891c087950 con 0x7f8924072a50 2024-04-25T12:24:26.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.626+0000 7f89227fc640 1 --2- 172.21.15.94:0/3737516824 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8910068380 0x7f891006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.626+0000 7f89227fc640 1 --2- 172.21.15.94:0/3737516824 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8910068380 0x7f891006a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f89180af000 tx=0x7f89180b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:26.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.626+0000 7fe2b0ff9640 1 -- 172.21.15.94:0/2241685428 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe2a00b1ca0 con 0x7fe2ac165150 2024-04-25T12:24:26.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.626+0000 7fe2b0ff9640 1 --2- 172.21.15.94:0/2241685428 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe298068380 0x7fe29806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.630+0000 7fe2b3fff640 1 --2- 172.21.15.94:0/2241685428 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe298068380 0x7fe29806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.630+0000 7fe2b3fff640 1 --2- 172.21.15.94:0/2241685428 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe298068380 0x7fe29806a840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8000f70 tx=0x7fe2a8007a90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:26.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.630+0000 7fd9beffd640 1 -- 172.21.15.94:0/3937136957 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd9c40129d0 con 0x7fd9c8046360 2024-04-25T12:24:26.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.630+0000 7fd9beffd640 1 --2- 172.21.15.94:0/3937136957 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd9b00683b0 0x7fd9b006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:26.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.630+0000 7fd9cdd9b640 1 --2- 172.21.15.94:0/3937136957 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd9b00683b0 0x7fd9b006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:26.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.630+0000 7fd9cdd9b640 1 --2- 172.21.15.94:0/3937136957 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd9b00683b0 0x7fd9b006a870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8005740 tx=0x7fd9d0063450 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:26.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.630+0000 7f290bfff640 1 -- 172.21.15.94:0/1884004493 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f290c021020 con 0x7f29200cbd10 2024-04-25T12:24:26.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.634+0000 7f890b7fe640 1 -- 172.21.15.94:0/3737516824 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f891c022020 con 0x7f8924072a50 2024-04-25T12:24:26.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.634+0000 7fd9beffd640 1 -- 172.21.15.94:0/3937136957 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fd9c4055030 con 0x7fd9c8046360 2024-04-25T12:24:26.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.634+0000 7fe2b0ff9640 1 -- 172.21.15.94:0/2241685428 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fe2a00f2930 con 0x7fe2ac165150 2024-04-25T12:24:26.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.638+0000 7fe2b0ff9640 1 -- 172.21.15.94:0/2241685428 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe2a00187f0 con 0x7fe2ac165150 2024-04-25T12:24:26.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.646+0000 7fd9beffd640 1 -- 172.21.15.94:0/3937136957 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd9c4057690 con 0x7fd9c8046360 2024-04-25T12:24:26.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.890+0000 7fd5a14c2640 1 -- 172.21.15.94:0/3206926800 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd57c005860 con 0x7fd59c157100 2024-04-25T12:24:26.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.890+0000 7fd5837fe640 1 -- 172.21.15.94:0/3206926800 <== mon.1 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd58c056ca0 con 0x7fd59c157100 2024-04-25T12:24:26.899 INFO:teuthology.orchestra.run.smithi094.stdout:68719476771 2024-04-25T12:24:26.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.894+0000 7fd5817fa640 1 -- 172.21.15.94:0/3206926800 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd588068380 msgr2=0x7fd58806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.894+0000 7fd5817fa640 1 --2- 172.21.15.94:0/3206926800 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd588068380 0x7fd58806a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd59000bac0 tx=0x7fd590008040 comp rx=0 tx=0).stop 2024-04-25T12:24:26.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.894+0000 7fd5817fa640 1 -- 172.21.15.94:0/3206926800 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd59c157100 msgr2=0x7fd59c0cb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.894+0000 7fd5817fa640 1 --2- 172.21.15.94:0/3206926800 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd59c157100 0x7fd59c0cb910 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd58c006e10 tx=0x7fd58c00fd40 comp rx=0 tx=0).stop 2024-04-25T12:24:26.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.894+0000 7fd5817fa640 1 -- 172.21.15.94:0/3206926800 shutdown_connections 2024-04-25T12:24:26.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.894+0000 7fd5817fa640 1 --2- 172.21.15.94:0/3206926800 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd588068380 0x7fd58806a840 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.894+0000 7fd5817fa640 1 --2- 172.21.15.94:0/3206926800 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd59c1512d0 0x7fd59c0cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.894+0000 7fd5817fa640 1 --2- 172.21.15.94:0/3206926800 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd59c157100 0x7fd59c0cb910 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.894+0000 7fd5817fa640 1 --2- 172.21.15.94:0/3206926800 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd59c072a50 0x7fd59c14d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.894+0000 7fd5817fa640 1 -- 172.21.15.94:0/3206926800 >> 172.21.15.94:0/3206926800 conn(0x7fd59c0c9050 msgr2=0x7fd59c0c9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:26.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.894+0000 7fd5817fa640 1 -- 172.21.15.94:0/3206926800 shutdown_connections 2024-04-25T12:24:26.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.894+0000 7fd5817fa640 1 -- 172.21.15.94:0/3206926800 wait complete. 2024-04-25T12:24:26.922 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476771 got 68719476771 for osd.5 2024-04-25T12:24:26.922 DEBUG:teuthology.parallel:result is None 2024-04-25T12:24:26.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.930+0000 7fe46692d640 1 -- 172.21.15.94:0/3515025246 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe448005860 con 0x7fe4580dad30 2024-04-25T12:24:26.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.930+0000 7fe4567fc640 1 -- 172.21.15.94:0/3515025246 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe450056a10 con 0x7fe4580dad30 2024-04-25T12:24:26.934 INFO:teuthology.orchestra.run.smithi094.stdout:60129542180 2024-04-25T12:24:26.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.930+0000 7fe46692d640 1 -- 172.21.15.94:0/3515025246 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe444068380 msgr2=0x7fe44406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.930+0000 7fe46692d640 1 --2- 172.21.15.94:0/3515025246 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe444068380 0x7fe44406a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe45c009af0 tx=0x7fe45c008040 comp rx=0 tx=0).stop 2024-04-25T12:24:26.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.930+0000 7fe46692d640 1 -- 172.21.15.94:0/3515025246 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4580dad30 msgr2=0x7fe4581846a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.934+0000 7fe46692d640 1 --2- 172.21.15.94:0/3515025246 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4580dad30 0x7fe4581846a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe45000c3e0 tx=0x7fe45000c8a0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.934+0000 7fe46692d640 1 -- 172.21.15.94:0/3515025246 shutdown_connections 2024-04-25T12:24:26.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.934+0000 7fe46692d640 1 --2- 172.21.15.94:0/3515025246 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe444068380 0x7fe44406a840 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.934+0000 7fe46692d640 1 --2- 172.21.15.94:0/3515025246 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4580dad30 0x7fe4581846a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.934+0000 7fe46692d640 1 --2- 172.21.15.94:0/3515025246 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe458050cb0 0x7fe458184160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.934+0000 7fe46692d640 1 --2- 172.21.15.94:0/3515025246 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe45804c2e0 0x7fe4580497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.934+0000 7fe46692d640 1 -- 172.21.15.94:0/3515025246 >> 172.21.15.94:0/3515025246 conn(0x7fe458050190 msgr2=0x7fe458046230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:26.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.934+0000 7fe46692d640 1 -- 172.21.15.94:0/3515025246 shutdown_connections 2024-04-25T12:24:26.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.934+0000 7fe46692d640 1 -- 172.21.15.94:0/3515025246 wait complete. 2024-04-25T12:24:26.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.938+0000 7f29260be640 1 -- 172.21.15.94:0/1884004493 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f29200caad0 con 0x7f29200cbd10 2024-04-25T12:24:26.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.938+0000 7f290bfff640 1 -- 172.21.15.94:0/1884004493 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f290c005480 con 0x7f29200cbd10 2024-04-25T12:24:26.944 INFO:teuthology.orchestra.run.smithi094.stdout:68719476772 2024-04-25T12:24:26.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.942+0000 7f29260be640 1 -- 172.21.15.94:0/1884004493 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f29040683b0 msgr2=0x7f290406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.942+0000 7f29260be640 1 --2- 172.21.15.94:0/1884004493 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f29040683b0 0x7f290406a870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f291401fdd0 tx=0x7f291400b040 comp rx=0 tx=0).stop 2024-04-25T12:24:26.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.942+0000 7f29260be640 1 -- 172.21.15.94:0/1884004493 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f29200cbd10 msgr2=0x7f29200c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.942+0000 7f29260be640 1 --2- 172.21.15.94:0/1884004493 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f29200cbd10 0x7f29200c89a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f29200cc130 tx=0x7f290c00c820 comp rx=0 tx=0).stop 2024-04-25T12:24:26.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.942+0000 7f29260be640 1 -- 172.21.15.94:0/1884004493 shutdown_connections 2024-04-25T12:24:26.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.942+0000 7f29260be640 1 --2- 172.21.15.94:0/1884004493 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f29040683b0 0x7f290406a870 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.942+0000 7f29260be640 1 --2- 172.21.15.94:0/1884004493 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f29200cbd10 0x7f29200c89a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.942+0000 7f29260be640 1 --2- 172.21.15.94:0/1884004493 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f292016b3a0 0x7f29201f7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.942+0000 7f29260be640 1 --2- 172.21.15.94:0/1884004493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f292006e800 0x7f292020f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.942+0000 7f29260be640 1 -- 172.21.15.94:0/1884004493 >> 172.21.15.94:0/1884004493 conn(0x7f29200cc380 msgr2=0x7f292016aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:26.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.942+0000 7f29260be640 1 -- 172.21.15.94:0/1884004493 shutdown_connections 2024-04-25T12:24:26.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.942+0000 7f29260be640 1 -- 172.21.15.94:0/1884004493 wait complete. 2024-04-25T12:24:26.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.942+0000 7f2c6b380640 1 -- 172.21.15.94:0/47895669 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2c640caa80 con 0x7f2c640703c0 2024-04-25T12:24:26.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.942+0000 7f2c59ffb640 1 -- 172.21.15.94:0/47895669 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2c5405a2f0 con 0x7f2c640703c0 2024-04-25T12:24:26.948 INFO:teuthology.orchestra.run.smithi094.stdout:60129542180 2024-04-25T12:24:26.949 INFO:teuthology.orchestra.run.smithi094.stdout:68719476770 2024-04-25T12:24:26.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.942+0000 7fbd2211b640 1 -- 172.21.15.94:0/1586099254 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fbd1c06c650 con 0x7fbd1c1593e0 2024-04-25T12:24:26.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.942+0000 7fbd11ffb640 1 -- 172.21.15.94:0/1586099254 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbd180f1aa0 con 0x7fbd1c1593e0 2024-04-25T12:24:26.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.946+0000 7f2c6b380640 1 -- 172.21.15.94:0/47895669 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2c48068450 msgr2=0x7f2c4806a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.946+0000 7f2c6b380640 1 --2- 172.21.15.94:0/47895669 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2c48068450 0x7f2c4806a910 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0ae000 tx=0x7f2c5c0a7070 comp rx=0 tx=0).stop 2024-04-25T12:24:26.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.946+0000 7f2c6b380640 1 -- 172.21.15.94:0/47895669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c640703c0 msgr2=0x7f2c641503f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.946+0000 7f2c6b380640 1 --2- 172.21.15.94:0/47895669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c640703c0 0x7f2c641503f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2c5400c430 tx=0x7f2c5400c8f0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.946+0000 7fbd2211b640 1 -- 172.21.15.94:0/1586099254 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fbd00068380 msgr2=0x7fbd0006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.946+0000 7fbd2211b640 1 --2- 172.21.15.94:0/1586099254 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fbd00068380 0x7fbd0006a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c009890 tx=0x7fbd0c008040 comp rx=0 tx=0).stop 2024-04-25T12:24:26.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.946+0000 7fbd2211b640 1 -- 172.21.15.94:0/1586099254 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd1c1593e0 msgr2=0x7fbd1c1fc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.946+0000 7fbd2211b640 1 --2- 172.21.15.94:0/1586099254 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd1c1593e0 0x7fbd1c1fc0b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbd180190f0 tx=0x7fbd18019280 comp rx=0 tx=0).stop 2024-04-25T12:24:26.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.946+0000 7f2c6b380640 1 -- 172.21.15.94:0/47895669 shutdown_connections 2024-04-25T12:24:26.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.946+0000 7f2c6b380640 1 --2- 172.21.15.94:0/47895669 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2c48068450 0x7f2c4806a910 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.946+0000 7f2c6b380640 1 --2- 172.21.15.94:0/47895669 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c640c8120 0x7f2c640cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.946+0000 7f2c6b380640 1 --2- 172.21.15.94:0/47895669 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2c64159640 0x7f2c64159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.946+0000 7f2c6b380640 1 --2- 172.21.15.94:0/47895669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c640703c0 0x7f2c641503f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.946+0000 7f2c6b380640 1 -- 172.21.15.94:0/47895669 >> 172.21.15.94:0/47895669 conn(0x7f2c640ca570 msgr2=0x7f2c6415eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:26.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.946+0000 7f2c6b380640 1 -- 172.21.15.94:0/47895669 shutdown_connections 2024-04-25T12:24:26.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.946+0000 7f2c6b380640 1 -- 172.21.15.94:0/47895669 wait complete. 2024-04-25T12:24:26.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.946+0000 7fbd2211b640 1 -- 172.21.15.94:0/1586099254 shutdown_connections 2024-04-25T12:24:26.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.946+0000 7fbd2211b640 1 --2- 172.21.15.94:0/1586099254 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fbd00068380 0x7fbd0006a840 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.946+0000 7fbd2211b640 1 --2- 172.21.15.94:0/1586099254 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd1c1593e0 0x7fbd1c1fc0b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.946+0000 7fbd2211b640 1 --2- 172.21.15.94:0/1586099254 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbd1c0c36f0 0x7fbd1c1fbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.946+0000 7fbd2211b640 1 --2- 172.21.15.94:0/1586099254 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbd1c06cdc0 0x7fbd1c15c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.946+0000 7fbd2211b640 1 -- 172.21.15.94:0/1586099254 >> 172.21.15.94:0/1586099254 conn(0x7fbd1c06e0d0 msgr2=0x7fbd1c0ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:26.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.946+0000 7fbd2211b640 1 -- 172.21.15.94:0/1586099254 shutdown_connections 2024-04-25T12:24:26.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.946+0000 7fbd2211b640 1 -- 172.21.15.94:0/1586099254 wait complete. 2024-04-25T12:24:26.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.958+0000 7f89293e0640 1 -- 172.21.15.94:0/3737516824 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8924072e30 con 0x7f8924072a50 2024-04-25T12:24:26.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.958+0000 7f890b7fe640 1 -- 172.21.15.94:0/3737516824 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f891c010040 con 0x7f8924072a50 2024-04-25T12:24:26.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542180 for osd.1 2024-04-25T12:24:26.967 DEBUG:teuthology.parallel:result is None 2024-04-25T12:24:26.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.962+0000 7fe2b91ba640 1 -- 172.21.15.94:0/2241685428 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe2ac032d60 con 0x7fe2ac165150 2024-04-25T12:24:26.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.962+0000 7fe2b0ff9640 1 -- 172.21.15.94:0/2241685428 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe2a00f4f90 con 0x7fe2ac165150 2024-04-25T12:24:26.968 INFO:teuthology.orchestra.run.smithi094.stdout:68719476771 2024-04-25T12:24:26.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476772 got 68719476772 for osd.6 2024-04-25T12:24:26.969 INFO:teuthology.orchestra.run.smithi094.stdout:60129542181 2024-04-25T12:24:26.970 DEBUG:teuthology.parallel:result is None 2024-04-25T12:24:26.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.966+0000 7fe2b91ba640 1 -- 172.21.15.94:0/2241685428 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe298068380 msgr2=0x7fe29806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.966+0000 7fe2b91ba640 1 --2- 172.21.15.94:0/2241685428 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe298068380 0x7fe29806a840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8000f70 tx=0x7fe2a8007a90 comp rx=0 tx=0).stop 2024-04-25T12:24:26.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.966+0000 7fe2b91ba640 1 -- 172.21.15.94:0/2241685428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2ac165150 msgr2=0x7fe2ac1658a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.966+0000 7fe2b91ba640 1 --2- 172.21.15.94:0/2241685428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2ac165150 0x7fe2ac1658a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe2a001c8c0 tx=0x7fe2a001ba30 comp rx=0 tx=0).stop 2024-04-25T12:24:26.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.966+0000 7fe2b91ba640 1 -- 172.21.15.94:0/2241685428 shutdown_connections 2024-04-25T12:24:26.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.966+0000 7fe2b91ba640 1 --2- 172.21.15.94:0/2241685428 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe298068380 0x7fe29806a840 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.966+0000 7fe2b91ba640 1 --2- 172.21.15.94:0/2241685428 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe2ac0d5be0 0x7fe2ac0d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.966+0000 7fe2b91ba640 1 --2- 172.21.15.94:0/2241685428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2ac165150 0x7fe2ac1658a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.966+0000 7fe2b91ba640 1 --2- 172.21.15.94:0/2241685428 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe2ac0d5800 0x7fe2ac0dea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.966+0000 7fe2b91ba640 1 -- 172.21.15.94:0/2241685428 >> 172.21.15.94:0/2241685428 conn(0x7fe2ac050190 msgr2=0x7fe2ac0d3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:26.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.966+0000 7fd9d4962640 1 -- 172.21.15.94:0/3937136957 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd9c8006de0 con 0x7fd9c8046360 2024-04-25T12:24:26.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.966+0000 7fe2b91ba640 1 -- 172.21.15.94:0/2241685428 shutdown_connections 2024-04-25T12:24:26.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.966+0000 7fe2b91ba640 1 -- 172.21.15.94:0/2241685428 wait complete. 2024-04-25T12:24:26.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.966+0000 7fd9beffd640 1 -- 172.21.15.94:0/3937136957 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd9c4056f90 con 0x7fd9c8046360 2024-04-25T12:24:26.973 INFO:teuthology.orchestra.run.smithi094.stdout:60129542180 2024-04-25T12:24:26.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.966+0000 7f89293e0640 1 -- 172.21.15.94:0/3737516824 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8910068380 msgr2=0x7f891006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.966+0000 7f89293e0640 1 --2- 172.21.15.94:0/3737516824 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8910068380 0x7f891006a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f89180af000 tx=0x7f89180b5040 comp rx=0 tx=0).stop 2024-04-25T12:24:26.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.966+0000 7f89293e0640 1 -- 172.21.15.94:0/3737516824 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8924072a50 msgr2=0x7f8924159f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.966+0000 7f89293e0640 1 --2- 172.21.15.94:0/3737516824 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8924072a50 0x7f8924159f60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f891c009e80 tx=0x7f891c00c490 comp rx=0 tx=0).stop 2024-04-25T12:24:26.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.966+0000 7f89293e0640 1 -- 172.21.15.94:0/3737516824 shutdown_connections 2024-04-25T12:24:26.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.966+0000 7f89293e0640 1 --2- 172.21.15.94:0/3737516824 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8910068380 0x7f891006a840 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.966+0000 7f89293e0640 1 --2- 172.21.15.94:0/3737516824 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8924157100 0x7f89241f8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.966+0000 7f89293e0640 1 --2- 172.21.15.94:0/3737516824 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f89241512d0 0x7f89240c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.966+0000 7f89293e0640 1 --2- 172.21.15.94:0/3737516824 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8924072a50 0x7f8924159f60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.966+0000 7f89293e0640 1 -- 172.21.15.94:0/3737516824 >> 172.21.15.94:0/3737516824 conn(0x7f89240c9050 msgr2=0x7f892414e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:26.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.966+0000 7f89293e0640 1 -- 172.21.15.94:0/3737516824 shutdown_connections 2024-04-25T12:24:26.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.966+0000 7f89293e0640 1 -- 172.21.15.94:0/3737516824 wait complete. 2024-04-25T12:24:26.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.970+0000 7fd9d4962640 1 -- 172.21.15.94:0/3937136957 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd9b00683b0 msgr2=0x7fd9b006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.970+0000 7fd9d4962640 1 --2- 172.21.15.94:0/3937136957 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd9b00683b0 0x7fd9b006a870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8005740 tx=0x7fd9d0063450 comp rx=0 tx=0).stop 2024-04-25T12:24:26.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.970+0000 7fd9d4962640 1 -- 172.21.15.94:0/3937136957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9c8046360 msgr2=0x7fd9c80d4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:26.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.970+0000 7fd9d4962640 1 --2- 172.21.15.94:0/3937136957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9c8046360 0x7fd9c80d4d70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd9c400c440 tx=0x7fd9c400c900 comp rx=0 tx=0).stop 2024-04-25T12:24:26.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.970+0000 7fd9d4962640 1 -- 172.21.15.94:0/3937136957 shutdown_connections 2024-04-25T12:24:26.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.970+0000 7fd9d4962640 1 --2- 172.21.15.94:0/3937136957 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd9b00683b0 0x7fd9b006a870 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.970+0000 7fd9d4962640 1 --2- 172.21.15.94:0/3937136957 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd9c80e71a0 0x7fd9c817c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.970+0000 7fd9d4962640 1 --2- 172.21.15.94:0/3937136957 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd9c80dd5e0 0x7fd9c80d7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.970+0000 7fd9d4962640 1 --2- 172.21.15.94:0/3937136957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9c8046360 0x7fd9c80d4d70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:26.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.970+0000 7fd9d4962640 1 -- 172.21.15.94:0/3937136957 >> 172.21.15.94:0/3937136957 conn(0x7fd9c804d4c0 msgr2=0x7fd9c8005a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:26.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.970+0000 7fd9d4962640 1 -- 172.21.15.94:0/3937136957 shutdown_connections 2024-04-25T12:24:26.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:26.970+0000 7fd9d4962640 1 -- 172.21.15.94:0/3937136957 wait complete. 2024-04-25T12:24:26.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542180 for osd.0 2024-04-25T12:24:26.980 DEBUG:teuthology.parallel:result is None 2024-04-25T12:24:26.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476770 got 68719476770 for osd.4 2024-04-25T12:24:26.983 DEBUG:teuthology.parallel:result is None 2024-04-25T12:24:26.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542180 for osd.3 2024-04-25T12:24:26.996 DEBUG:teuthology.parallel:result is None 2024-04-25T12:24:26.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476771 got 68719476771 for osd.7 2024-04-25T12:24:26.997 DEBUG:teuthology.parallel:result is None 2024-04-25T12:24:26.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542180 got 60129542181 for osd.2 2024-04-25T12:24:26.997 DEBUG:teuthology.parallel:result is None 2024-04-25T12:24:26.997 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T12:24:26.997 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:24:27.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdacc125640 1 Processor -- start 2024-04-25T12:24:27.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdacc125640 1 -- start start 2024-04-25T12:24:27.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdacc125640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fdac40c8630 0x7fdac4151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:27.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdacc125640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdac415b740 con 0x7fdac40c8250 2024-04-25T12:24:27.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdacc125640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdac40c40f0 con 0x7fdac40c8a70 2024-04-25T12:24:27.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdacc125640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fdac40c6490 con 0x7fdac40c8630 2024-04-25T12:24:27.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdac9ec1640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fdac40c8250 0x7fdac40c39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39356/0 (socket says 172.21.15.94:39356) 2024-04-25T12:24:27.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdac9ec1640 1 -- 172.21.15.94:0/3987317183 learned_addr learned my addr 172.21.15.94:0/3987317183 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:27.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdac96c0640 1 --2- 172.21.15.94:0/3987317183 >> v2:172.21.15.111:3300/0 conn(0x7fdac40c8630 0x7fdac4151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:27.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdac8ebf640 1 -- 172.21.15.94:0/3987317183 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3091673724 0 0) 0x7fdac415b740 con 0x7fdac40c8250 2024-04-25T12:24:27.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdac8ebf640 1 -- 172.21.15.94:0/3987317183 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdab0003530 con 0x7fdac40c8250 2024-04-25T12:24:27.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdac8ebf640 1 -- 172.21.15.94:0/3987317183 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 649780235 0 0) 0x7fdac40c40f0 con 0x7fdac40c8a70 2024-04-25T12:24:27.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdac8ebf640 1 -- 172.21.15.94:0/3987317183 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdac415b740 con 0x7fdac40c8a70 2024-04-25T12:24:27.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdac8ebf640 1 -- 172.21.15.94:0/3987317183 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 676531364 0 0) 0x7fdab0003530 con 0x7fdac40c8250 2024-04-25T12:24:27.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdac8ebf640 1 -- 172.21.15.94:0/3987317183 >> v2:172.21.15.111:3300/0 conn(0x7fdac40c8630 msgr2=0x7fdac4151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:27.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdac8ebf640 1 --2- 172.21.15.94:0/3987317183 >> v2:172.21.15.111:3300/0 conn(0x7fdac40c8630 0x7fdac4151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:27.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdac8ebf640 1 -- 172.21.15.94:0/3987317183 >> v1:172.21.15.111:6789/0 conn(0x7fdac40c8a70 legacy=0x7fdac4152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:27.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdac8ebf640 1 -- 172.21.15.94:0/3987317183 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac40c58c0 con 0x7fdac40c8250 2024-04-25T12:24:27.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdac8ebf640 1 -- 172.21.15.94:0/3987317183 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7fdac0001680 con 0x7fdac40c8250 2024-04-25T12:24:27.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdac8ebf640 1 -- 172.21.15.94:0/3987317183 >> v1:172.21.15.94:6789/0 conn(0x7fdac40c8250 legacy=0x7fdac40c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:27.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdac8ebf640 1 --2- 172.21.15.94:0/3987317183 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdab0003b50 0x7fdab0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:27.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdac8ebf640 1 --2- 172.21.15.94:0/3987317183 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdab0004810 0x7fdab0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:27.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdac8ebf640 1 --2- 172.21.15.94:0/3987317183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdab00051d0 0x7fdab000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:27.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdac8ebf640 1 -- 172.21.15.94:0/3987317183 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fdac40c6490 con 0x7fdab00051d0 2024-04-25T12:24:27.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdac8ebf640 1 -- 172.21.15.94:0/3987317183 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fdab00099f0 con 0x7fdab0003b50 2024-04-25T12:24:27.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdac8ebf640 1 -- 172.21.15.94:0/3987317183 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fdab0009bf0 con 0x7fdab0004810 2024-04-25T12:24:27.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdaca6c2640 1 --2- 172.21.15.94:0/3987317183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdab00051d0 0x7fdab000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:27.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdac96c0640 1 --2- 172.21.15.94:0/3987317183 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdab0004810 0x7fdab0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:27.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdaca6c2640 1 -- 172.21.15.94:0/3987317183 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdab0004810 msgr2=0x7fdab0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:27.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdaca6c2640 1 --2- 172.21.15.94:0/3987317183 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdab0004810 0x7fdab0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:27.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdaca6c2640 1 -- 172.21.15.94:0/3987317183 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdab0003b50 msgr2=0x7fdab0003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:27.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdaca6c2640 1 --2- 172.21.15.94:0/3987317183 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdab0003b50 0x7fdab0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:27.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.138+0000 7fdaca6c2640 1 -- 172.21.15.94:0/3987317183 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab0003530 con 0x7fdab00051d0 2024-04-25T12:24:27.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdaca6c2640 1 -- 172.21.15.94:0/3987317183 reap_dead start 2024-04-25T12:24:27.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdaca6c2640 1 --2- 172.21.15.94:0/3987317183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdab00051d0 0x7fdab000dbe0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdabc001fd0 tx=0x7fdabc01f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e7e01a5eb462591 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:27.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdac8ebf640 1 -- 172.21.15.94:0/3987317183 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdabc001c20 con 0x7fdab00051d0 2024-04-25T12:24:27.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdac8ebf640 1 -- 172.21.15.94:0/3987317183 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdabc0a8c90 con 0x7fdab00051d0 2024-04-25T12:24:27.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdac8ebf640 1 -- 172.21.15.94:0/3987317183 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdabc003bc0 con 0x7fdab00051d0 2024-04-25T12:24:27.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdacc125640 1 -- 172.21.15.94:0/3987317183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdab00051d0 msgr2=0x7fdab000dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:27.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdacc125640 1 --2- 172.21.15.94:0/3987317183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdab00051d0 0x7fdab000dbe0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdabc001fd0 tx=0x7fdabc01f070 comp rx=0 tx=0).stop 2024-04-25T12:24:27.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdacc125640 1 -- 172.21.15.94:0/3987317183 shutdown_connections 2024-04-25T12:24:27.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdacc125640 1 --2- 172.21.15.94:0/3987317183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdab00051d0 0x7fdab000dbe0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:27.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdacc125640 1 -- 172.21.15.94:0/3987317183 >> 172.21.15.94:0/3987317183 conn(0x7fdac406b9d0 msgr2=0x7fdac406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:27.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdacc125640 1 -- 172.21.15.94:0/3987317183 shutdown_connections 2024-04-25T12:24:27.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdacc125640 1 -- 172.21.15.94:0/3987317183 wait complete. 2024-04-25T12:24:27.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdacc125640 1 Processor -- start 2024-04-25T12:24:27.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdacc125640 1 -- start start 2024-04-25T12:24:27.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdacc125640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdab00051d0 0x7fdac4148ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:27.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdacc125640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdac41537f0 0x7fdac414ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:27.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdacc125640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdac414e8b0 0x7fdac414b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:27.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdacc125640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fdac40c5e40 con 0x7fdab00051d0 2024-04-25T12:24:27.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdacc125640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fdac40c5710 con 0x7fdac41537f0 2024-04-25T12:24:27.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdacc125640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fdac40c6120 con 0x7fdac414e8b0 2024-04-25T12:24:27.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdac9ec1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdab00051d0 0x7fdac4148ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:27.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdac9ec1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdab00051d0 0x7fdac4148ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52164/0 (socket says 172.21.15.94:52164) 2024-04-25T12:24:27.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdac9ec1640 1 -- 172.21.15.94:0/1475843960 learned_addr learned my addr 172.21.15.94:0/1475843960 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:27.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdac96c0640 1 --2- 172.21.15.94:0/1475843960 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdac41537f0 0x7fdac414ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:27.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdaca6c2640 1 --2- 172.21.15.94:0/1475843960 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdac414e8b0 0x7fdac414b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:27.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdac9ec1640 1 -- 172.21.15.94:0/1475843960 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdac414e8b0 msgr2=0x7fdac414b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:27.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdac9ec1640 1 --2- 172.21.15.94:0/1475843960 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdac414e8b0 0x7fdac414b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:27.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdac9ec1640 1 -- 172.21.15.94:0/1475843960 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdac41537f0 msgr2=0x7fdac414ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:27.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdac9ec1640 1 --2- 172.21.15.94:0/1475843960 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdac41537f0 0x7fdac414ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:27.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdac9ec1640 1 -- 172.21.15.94:0/1475843960 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac4148450 con 0x7fdab00051d0 2024-04-25T12:24:27.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdac96c0640 1 --2- 172.21.15.94:0/1475843960 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdac41537f0 0x7fdac414ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:24:27.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.142+0000 7fdac9ec1640 1 --2- 172.21.15.94:0/1475843960 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdab00051d0 0x7fdac4148ef0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdac000c760 tx=0x7fdac000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:27.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.146+0000 7fdaba7fc640 1 -- 172.21.15.94:0/1475843960 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac0018070 con 0x7fdab00051d0 2024-04-25T12:24:27.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.146+0000 7fdaba7fc640 1 -- 172.21.15.94:0/1475843960 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdac00072d0 con 0x7fdab00051d0 2024-04-25T12:24:27.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.146+0000 7fdacc125640 1 -- 172.21.15.94:0/1475843960 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdac41ed7d0 con 0x7fdab00051d0 2024-04-25T12:24:27.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.146+0000 7fdaba7fc640 1 -- 172.21.15.94:0/1475843960 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac00047f0 con 0x7fdab00051d0 2024-04-25T12:24:27.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.146+0000 7fdacc125640 1 -- 172.21.15.94:0/1475843960 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdac41489d0 con 0x7fdab00051d0 2024-04-25T12:24:27.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.146+0000 7fdacc125640 1 -- 172.21.15.94:0/1475843960 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdac4075df0 con 0x7fdab00051d0 2024-04-25T12:24:27.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.146+0000 7fdaba7fc640 1 -- 172.21.15.94:0/1475843960 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdac001b070 con 0x7fdab00051d0 2024-04-25T12:24:27.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.146+0000 7fdaba7fc640 1 --2- 172.21.15.94:0/1475843960 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fdaa8068380 0x7fdaa806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:27.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.146+0000 7fdaba7fc640 1 -- 172.21.15.94:0/1475843960 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fdac00860e0 con 0x7fdab00051d0 2024-04-25T12:24:27.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.146+0000 7fdac96c0640 1 --2- 172.21.15.94:0/1475843960 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fdaa8068380 0x7fdaa806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:27.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.146+0000 7fdac96c0640 1 --2- 172.21.15.94:0/1475843960 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fdaa8068380 0x7fdaa806a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdac4153bd0 tx=0x7fdab4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:27.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.150+0000 7fdaba7fc640 1 -- 172.21.15.94:0/1475843960 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdac0055cf0 con 0x7fdab00051d0 2024-04-25T12:24:27.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.298+0000 7fdacc125640 1 -- 172.21.15.94:0/1475843960 --> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdac40691d0 con 0x7fdaa8068380 2024-04-25T12:24:27.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.322+0000 7fdaba7fc640 1 -- 172.21.15.94:0/1475843960 <== mgr.4101 v2:172.21.15.94:6832/549402167 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332538 (secure 0 0 0) 0x7fdab40139f0 con 0x7fdaa8068380 2024-04-25T12:24:27.331 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:27.333 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-04-25T12:24:27.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.326+0000 7fdacc125640 1 -- 172.21.15.94:0/1475843960 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fdaa8068380 msgr2=0x7fdaa806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:27.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.326+0000 7fdacc125640 1 --2- 172.21.15.94:0/1475843960 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fdaa8068380 0x7fdaa806a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdac4153bd0 tx=0x7fdab4008040 comp rx=0 tx=0).stop 2024-04-25T12:24:27.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.326+0000 7fdacc125640 1 -- 172.21.15.94:0/1475843960 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdab00051d0 msgr2=0x7fdac4148ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:27.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.326+0000 7fdacc125640 1 --2- 172.21.15.94:0/1475843960 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdab00051d0 0x7fdac4148ef0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdac000c760 tx=0x7fdac000cc20 comp rx=0 tx=0).stop 2024-04-25T12:24:27.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.326+0000 7fdacc125640 1 -- 172.21.15.94:0/1475843960 shutdown_connections 2024-04-25T12:24:27.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.326+0000 7fdacc125640 1 --2- 172.21.15.94:0/1475843960 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fdaa8068380 0x7fdaa806a840 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:27.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.326+0000 7fdacc125640 1 --2- 172.21.15.94:0/1475843960 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdac414e8b0 0x7fdac414b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:27.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.326+0000 7fdacc125640 1 --2- 172.21.15.94:0/1475843960 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdac41537f0 0x7fdac414ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:27.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.326+0000 7fdacc125640 1 --2- 172.21.15.94:0/1475843960 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdab00051d0 0x7fdac4148ef0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:27.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.326+0000 7fdacc125640 1 -- 172.21.15.94:0/1475843960 >> 172.21.15.94:0/1475843960 conn(0x7fdac406b9d0 msgr2=0x7fdac406e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:27.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.326+0000 7fdacc125640 1 -- 172.21.15.94:0/1475843960 shutdown_connections 2024-04-25T12:24:27.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.326+0000 7fdacc125640 1 -- 172.21.15.94:0/1475843960 wait complete. 2024-04-25T12:24:27.349 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2024-04-25T12:24:25.804166+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236304,"kb_used_data":3496,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738416,"statfs":{"total":773094113280,"available":772852137984,"internally_reserved":0,"allocated":3579904,"data_stored":2148576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004259"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916423+0000","last_change":"2024-04-25T12:21:53.194776+0000","last_active":"2024-04-25T12:22:34.916423+0000","last_peered":"2024-04-25T12:22:34.916423+0000","last_clean":"2024-04-25T12:22:34.916423+0000","last_became_active":"2024-04-25T12:21:53.194480+0000","last_became_peered":"2024-04-25T12:21:53.194480+0000","last_unstale":"2024-04-25T12:22:34.916423+0000","last_undegraded":"2024-04-25T12:22:34.916423+0000","last_fullsized":"2024-04-25T12:22:34.916423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:52.906255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979743+0000","last_change":"2024-04-25T12:21:54.200481+0000","last_active":"2024-04-25T12:22:34.979743+0000","last_peered":"2024-04-25T12:22:34.979743+0000","last_clean":"2024-04-25T12:22:34.979743+0000","last_became_active":"2024-04-25T12:21:54.199679+0000","last_became_peered":"2024-04-25T12:21:54.199679+0000","last_unstale":"2024-04-25T12:22:34.979743+0000","last_undegraded":"2024-04-25T12:22:34.979743+0000","last_fullsized":"2024-04-25T12:22:34.979743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:59.395265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978348+0000","last_change":"2024-04-25T12:21:58.346732+0000","last_active":"2024-04-25T12:22:34.978348+0000","last_peered":"2024-04-25T12:22:34.978348+0000","last_clean":"2024-04-25T12:22:34.978348+0000","last_became_active":"2024-04-25T12:21:58.346337+0000","last_became_peered":"2024-04-25T12:21:58.346337+0000","last_unstale":"2024-04-25T12:22:34.978348+0000","last_undegraded":"2024-04-25T12:22:34.978348+0000","last_fullsized":"2024-04-25T12:22:34.978348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:20.028661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980382+0000","last_change":"2024-04-25T12:21:53.166281+0000","last_active":"2024-04-25T12:22:34.980382+0000","last_peered":"2024-04-25T12:22:34.980382+0000","last_clean":"2024-04-25T12:22:34.980382+0000","last_became_active":"2024-04-25T12:21:53.165990+0000","last_became_peered":"2024-04-25T12:21:53.165990+0000","last_unstale":"2024-04-25T12:22:34.980382+0000","last_undegraded":"2024-04-25T12:22:34.980382+0000","last_fullsized":"2024-04-25T12:22:34.980382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:07.228743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916094+0000","last_change":"2024-04-25T12:21:54.189754+0000","last_active":"2024-04-25T12:22:34.916094+0000","last_peered":"2024-04-25T12:22:34.916094+0000","last_clean":"2024-04-25T12:22:34.916094+0000","last_became_active":"2024-04-25T12:21:54.188987+0000","last_became_peered":"2024-04-25T12:21:54.188987+0000","last_unstale":"2024-04-25T12:22:34.916094+0000","last_undegraded":"2024-04-25T12:22:34.916094+0000","last_fullsized":"2024-04-25T12:22:34.916094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:29.603368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.892649+0000","last_change":"2024-04-25T12:21:58.251628+0000","last_active":"2024-04-25T12:22:34.892649+0000","last_peered":"2024-04-25T12:22:34.892649+0000","last_clean":"2024-04-25T12:22:34.892649+0000","last_became_active":"2024-04-25T12:21:58.250542+0000","last_became_peered":"2024-04-25T12:21:58.250542+0000","last_unstale":"2024-04-25T12:22:34.892649+0000","last_undegraded":"2024-04-25T12:22:34.892649+0000","last_fullsized":"2024-04-25T12:22:34.892649+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:33.434685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891183+0000","last_change":"2024-04-25T12:21:53.203427+0000","last_active":"2024-04-25T12:22:34.891183+0000","last_peered":"2024-04-25T12:22:34.891183+0000","last_clean":"2024-04-25T12:22:34.891183+0000","last_became_active":"2024-04-25T12:21:53.202760+0000","last_became_peered":"2024-04-25T12:21:53.202760+0000","last_unstale":"2024-04-25T12:22:34.891183+0000","last_undegraded":"2024-04-25T12:22:34.891183+0000","last_fullsized":"2024-04-25T12:22:34.891183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:44.397450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887718+0000","last_change":"2024-04-25T12:21:54.208420+0000","last_active":"2024-04-25T12:22:34.887718+0000","last_peered":"2024-04-25T12:22:34.887718+0000","last_clean":"2024-04-25T12:22:34.887718+0000","last_became_active":"2024-04-25T12:21:54.208093+0000","last_became_peered":"2024-04-25T12:21:54.208093+0000","last_unstale":"2024-04-25T12:22:34.887718+0000","last_undegraded":"2024-04-25T12:22:34.887718+0000","last_fullsized":"2024-04-25T12:22:34.887718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:08.762268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.892999+0000","last_change":"2024-04-25T12:21:58.255963+0000","last_active":"2024-04-25T12:22:34.892999+0000","last_peered":"2024-04-25T12:22:34.892999+0000","last_clean":"2024-04-25T12:22:34.892999+0000","last_became_active":"2024-04-25T12:21:58.254021+0000","last_became_peered":"2024-04-25T12:21:58.254021+0000","last_unstale":"2024-04-25T12:22:34.892999+0000","last_undegraded":"2024-04-25T12:22:34.892999+0000","last_fullsized":"2024-04-25T12:22:34.892999+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:20.528034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890657+0000","last_change":"2024-04-25T12:21:53.208470+0000","last_active":"2024-04-25T12:22:34.890657+0000","last_peered":"2024-04-25T12:22:34.890657+0000","last_clean":"2024-04-25T12:22:34.890657+0000","last_became_active":"2024-04-25T12:21:53.207929+0000","last_became_peered":"2024-04-25T12:21:53.207929+0000","last_unstale":"2024-04-25T12:22:34.890657+0000","last_undegraded":"2024-04-25T12:22:34.890657+0000","last_fullsized":"2024-04-25T12:22:34.890657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:14.904832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887497+0000","last_change":"2024-04-25T12:21:54.206567+0000","last_active":"2024-04-25T12:22:34.887497+0000","last_peered":"2024-04-25T12:22:34.887497+0000","last_clean":"2024-04-25T12:22:34.887497+0000","last_became_active":"2024-04-25T12:21:54.206138+0000","last_became_peered":"2024-04-25T12:21:54.206138+0000","last_unstale":"2024-04-25T12:22:34.887497+0000","last_undegraded":"2024-04-25T12:22:34.887497+0000","last_fullsized":"2024-04-25T12:22:34.887497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:31.698845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893253+0000","last_change":"2024-04-25T12:21:58.245331+0000","last_active":"2024-04-25T12:22:34.893253+0000","last_peered":"2024-04-25T12:22:34.893253+0000","last_clean":"2024-04-25T12:22:34.893253+0000","last_became_active":"2024-04-25T12:21:58.244313+0000","last_became_peered":"2024-04-25T12:21:58.244313+0000","last_unstale":"2024-04-25T12:22:34.893253+0000","last_undegraded":"2024-04-25T12:22:34.893253+0000","last_fullsized":"2024-04-25T12:22:34.893253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:21.595492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029274+0000","last_change":"2024-04-25T12:21:54.208935+0000","last_active":"2024-04-25T12:22:35.029274+0000","last_peered":"2024-04-25T12:22:35.029274+0000","last_clean":"2024-04-25T12:22:35.029274+0000","last_became_active":"2024-04-25T12:21:54.208338+0000","last_became_peered":"2024-04-25T12:21:54.208338+0000","last_unstale":"2024-04-25T12:22:35.029274+0000","last_undegraded":"2024-04-25T12:22:35.029274+0000","last_fullsized":"2024-04-25T12:22:35.029274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:08.485037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890828+0000","last_change":"2024-04-25T12:21:53.203519+0000","last_active":"2024-04-25T12:22:34.890828+0000","last_peered":"2024-04-25T12:22:34.890828+0000","last_clean":"2024-04-25T12:22:34.890828+0000","last_became_active":"2024-04-25T12:21:53.197141+0000","last_became_peered":"2024-04-25T12:21:53.197141+0000","last_unstale":"2024-04-25T12:22:34.890828+0000","last_undegraded":"2024-04-25T12:22:34.890828+0000","last_fullsized":"2024-04-25T12:22:34.890828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:03.010472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894179+0000","last_change":"2024-04-25T12:21:58.250871+0000","last_active":"2024-04-25T12:22:34.894179+0000","last_peered":"2024-04-25T12:22:34.894179+0000","last_clean":"2024-04-25T12:22:34.894179+0000","last_became_active":"2024-04-25T12:21:58.249079+0000","last_became_peered":"2024-04-25T12:21:58.249079+0000","last_unstale":"2024-04-25T12:22:34.894179+0000","last_undegraded":"2024-04-25T12:22:34.894179+0000","last_fullsized":"2024-04-25T12:22:34.894179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:54.201824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978908+0000","last_change":"2024-04-25T12:21:54.209195+0000","last_active":"2024-04-25T12:22:34.978908+0000","last_peered":"2024-04-25T12:22:34.978908+0000","last_clean":"2024-04-25T12:22:34.978908+0000","last_became_active":"2024-04-25T12:21:54.208802+0000","last_became_peered":"2024-04-25T12:21:54.208802+0000","last_unstale":"2024-04-25T12:22:34.978908+0000","last_undegraded":"2024-04-25T12:22:34.978908+0000","last_fullsized":"2024-04-25T12:22:34.978908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:10.846624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293651+0000","last_change":"2024-04-25T12:21:53.165498+0000","last_active":"2024-04-25T12:22:35.293651+0000","last_peered":"2024-04-25T12:22:35.293651+0000","last_clean":"2024-04-25T12:22:35.293651+0000","last_became_active":"2024-04-25T12:21:53.164867+0000","last_became_peered":"2024-04-25T12:21:53.164867+0000","last_unstale":"2024-04-25T12:22:35.293651+0000","last_undegraded":"2024-04-25T12:22:35.293651+0000","last_fullsized":"2024-04-25T12:22:35.293651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:07.312761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893517+0000","last_change":"2024-04-25T12:21:58.260620+0000","last_active":"2024-04-25T12:22:34.893517+0000","last_peered":"2024-04-25T12:22:34.893517+0000","last_clean":"2024-04-25T12:22:34.893517+0000","last_became_active":"2024-04-25T12:21:58.259595+0000","last_became_peered":"2024-04-25T12:21:58.259595+0000","last_unstale":"2024-04-25T12:22:34.893517+0000","last_undegraded":"2024-04-25T12:22:34.893517+0000","last_fullsized":"2024-04-25T12:22:34.893517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:43.230479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979100+0000","last_change":"2024-04-25T12:21:54.206960+0000","last_active":"2024-04-25T12:22:34.979100+0000","last_peered":"2024-04-25T12:22:34.979100+0000","last_clean":"2024-04-25T12:22:34.979100+0000","last_became_active":"2024-04-25T12:21:54.204650+0000","last_became_peered":"2024-04-25T12:21:54.204650+0000","last_unstale":"2024-04-25T12:22:34.979100+0000","last_undegraded":"2024-04-25T12:22:34.979100+0000","last_fullsized":"2024-04-25T12:22:34.979100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:15.888865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293382+0000","last_change":"2024-04-25T12:21:53.193797+0000","last_active":"2024-04-25T12:22:35.293382+0000","last_peered":"2024-04-25T12:22:35.293382+0000","last_clean":"2024-04-25T12:22:35.293382+0000","last_became_active":"2024-04-25T12:21:53.193466+0000","last_became_peered":"2024-04-25T12:21:53.193466+0000","last_unstale":"2024-04-25T12:22:35.293382+0000","last_undegraded":"2024-04-25T12:22:35.293382+0000","last_fullsized":"2024-04-25T12:22:35.293382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:23.341451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292912+0000","last_change":"2024-04-25T12:21:58.348047+0000","last_active":"2024-04-25T12:22:35.292912+0000","last_peered":"2024-04-25T12:22:35.292912+0000","last_clean":"2024-04-25T12:22:35.292912+0000","last_became_active":"2024-04-25T12:21:58.347583+0000","last_became_peered":"2024-04-25T12:21:58.347583+0000","last_unstale":"2024-04-25T12:22:35.292912+0000","last_undegraded":"2024-04-25T12:22:35.292912+0000","last_fullsized":"2024-04-25T12:22:35.292912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:21:48.878907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894218+0000","last_change":"2024-04-25T12:21:54.196479+0000","last_active":"2024-04-25T12:22:34.894218+0000","last_peered":"2024-04-25T12:22:34.894218+0000","last_clean":"2024-04-25T12:22:34.894218+0000","last_became_active":"2024-04-25T12:21:54.195939+0000","last_became_peered":"2024-04-25T12:21:54.195939+0000","last_unstale":"2024-04-25T12:22:34.894218+0000","last_undegraded":"2024-04-25T12:22:34.894218+0000","last_fullsized":"2024-04-25T12:22:34.894218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:17.787145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.886118+0000","last_change":"2024-04-25T12:21:53.198034+0000","last_active":"2024-04-25T12:22:34.886118+0000","last_peered":"2024-04-25T12:22:34.886118+0000","last_clean":"2024-04-25T12:22:34.886118+0000","last_became_active":"2024-04-25T12:21:53.196252+0000","last_became_peered":"2024-04-25T12:21:53.196252+0000","last_unstale":"2024-04-25T12:22:34.886118+0000","last_undegraded":"2024-04-25T12:22:34.886118+0000","last_fullsized":"2024-04-25T12:22:34.886118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:08.329111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.033926+0000","last_change":"2024-04-25T12:22:35.032802+0000","last_active":"2024-04-25T12:22:35.033926+0000","last_peered":"2024-04-25T12:22:35.033926+0000","last_clean":"2024-04-25T12:22:35.033926+0000","last_became_active":"2024-04-25T12:22:35.031906+0000","last_became_peered":"2024-04-25T12:22:35.031906+0000","last_unstale":"2024-04-25T12:22:35.033926+0000","last_undegraded":"2024-04-25T12:22:35.033926+0000","last_fullsized":"2024-04-25T12:22:35.033926+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:40.346041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916736+0000","last_change":"2024-04-25T12:21:54.192601+0000","last_active":"2024-04-25T12:22:34.916736+0000","last_peered":"2024-04-25T12:22:34.916736+0000","last_clean":"2024-04-25T12:22:34.916736+0000","last_became_active":"2024-04-25T12:21:54.191864+0000","last_became_peered":"2024-04-25T12:21:54.191864+0000","last_unstale":"2024-04-25T12:22:34.916736+0000","last_undegraded":"2024-04-25T12:22:34.916736+0000","last_fullsized":"2024-04-25T12:22:34.916736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:50.392769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030915+0000","last_change":"2024-04-25T12:21:53.197793+0000","last_active":"2024-04-25T12:22:35.030915+0000","last_peered":"2024-04-25T12:22:35.030915+0000","last_clean":"2024-04-25T12:22:35.030915+0000","last_became_active":"2024-04-25T12:21:53.197059+0000","last_became_peered":"2024-04-25T12:21:53.197059+0000","last_unstale":"2024-04-25T12:22:35.030915+0000","last_undegraded":"2024-04-25T12:22:35.030915+0000","last_fullsized":"2024-04-25T12:22:35.030915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:58.471408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893581+0000","last_change":"2024-04-25T12:21:58.355166+0000","last_active":"2024-04-25T12:22:34.893581+0000","last_peered":"2024-04-25T12:22:34.893581+0000","last_clean":"2024-04-25T12:22:34.893581+0000","last_became_active":"2024-04-25T12:21:58.353996+0000","last_became_peered":"2024-04-25T12:21:58.353996+0000","last_unstale":"2024-04-25T12:22:34.893581+0000","last_undegraded":"2024-04-25T12:22:34.893581+0000","last_fullsized":"2024-04-25T12:22:34.893581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:22.681720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980643+0000","last_change":"2024-04-25T12:21:54.219182+0000","last_active":"2024-04-25T12:22:34.980643+0000","last_peered":"2024-04-25T12:22:34.980643+0000","last_clean":"2024-04-25T12:22:34.980643+0000","last_became_active":"2024-04-25T12:21:54.218854+0000","last_became_peered":"2024-04-25T12:21:54.218854+0000","last_unstale":"2024-04-25T12:22:34.980643+0000","last_undegraded":"2024-04-25T12:22:34.980643+0000","last_fullsized":"2024-04-25T12:22:34.980643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:08.985962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292883+0000","last_change":"2024-04-25T12:21:53.190102+0000","last_active":"2024-04-25T12:22:35.292883+0000","last_peered":"2024-04-25T12:22:35.292883+0000","last_clean":"2024-04-25T12:22:35.292883+0000","last_became_active":"2024-04-25T12:21:53.189781+0000","last_became_peered":"2024-04-25T12:21:53.189781+0000","last_unstale":"2024-04-25T12:22:35.292883+0000","last_undegraded":"2024-04-25T12:22:35.292883+0000","last_fullsized":"2024-04-25T12:22:35.292883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:52.533217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978106+0000","last_change":"2024-04-25T12:21:58.341932+0000","last_active":"2024-04-25T12:22:34.978106+0000","last_peered":"2024-04-25T12:22:34.978106+0000","last_clean":"2024-04-25T12:22:34.978106+0000","last_became_active":"2024-04-25T12:21:58.341492+0000","last_became_peered":"2024-04-25T12:21:58.341492+0000","last_unstale":"2024-04-25T12:22:34.978106+0000","last_undegraded":"2024-04-25T12:22:34.978106+0000","last_fullsized":"2024-04-25T12:22:34.978106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:51.576036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293382+0000","last_change":"2024-04-25T12:21:54.182541+0000","last_active":"2024-04-25T12:22:35.293382+0000","last_peered":"2024-04-25T12:22:35.293382+0000","last_clean":"2024-04-25T12:22:35.293382+0000","last_became_active":"2024-04-25T12:21:54.181720+0000","last_became_peered":"2024-04-25T12:21:54.181720+0000","last_unstale":"2024-04-25T12:22:35.293382+0000","last_undegraded":"2024-04-25T12:22:35.293382+0000","last_fullsized":"2024-04-25T12:22:35.293382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:00.544076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891591+0000","last_change":"2024-04-25T12:21:53.200521+0000","last_active":"2024-04-25T12:22:34.891591+0000","last_peered":"2024-04-25T12:22:34.891591+0000","last_clean":"2024-04-25T12:22:34.891591+0000","last_became_active":"2024-04-25T12:21:53.196102+0000","last_became_peered":"2024-04-25T12:21:53.196102+0000","last_unstale":"2024-04-25T12:22:34.891591+0000","last_undegraded":"2024-04-25T12:22:34.891591+0000","last_fullsized":"2024-04-25T12:22:34.891591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:54.350452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916195+0000","last_change":"2024-04-25T12:21:58.342064+0000","last_active":"2024-04-25T12:22:34.916195+0000","last_peered":"2024-04-25T12:22:34.916195+0000","last_clean":"2024-04-25T12:22:34.916195+0000","last_became_active":"2024-04-25T12:21:58.341558+0000","last_became_peered":"2024-04-25T12:21:58.341558+0000","last_unstale":"2024-04-25T12:22:34.916195+0000","last_undegraded":"2024-04-25T12:22:34.916195+0000","last_fullsized":"2024-04-25T12:22:34.916195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:11.378767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887849+0000","last_change":"2024-04-25T12:21:54.206427+0000","last_active":"2024-04-25T12:22:34.887849+0000","last_peered":"2024-04-25T12:22:34.887849+0000","last_clean":"2024-04-25T12:22:34.887849+0000","last_became_active":"2024-04-25T12:21:54.205519+0000","last_became_peered":"2024-04-25T12:21:54.205519+0000","last_unstale":"2024-04-25T12:22:34.887849+0000","last_undegraded":"2024-04-25T12:22:34.887849+0000","last_fullsized":"2024-04-25T12:22:34.887849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:59.659460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293573+0000","last_change":"2024-04-25T12:21:53.162914+0000","last_active":"2024-04-25T12:22:35.293573+0000","last_peered":"2024-04-25T12:22:35.293573+0000","last_clean":"2024-04-25T12:22:35.293573+0000","last_became_active":"2024-04-25T12:21:53.162599+0000","last_became_peered":"2024-04-25T12:21:53.162599+0000","last_unstale":"2024-04-25T12:22:35.293573+0000","last_undegraded":"2024-04-25T12:22:35.293573+0000","last_fullsized":"2024-04-25T12:22:35.293573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:23.448280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.919463+0000","last_change":"2024-04-25T12:22:34.919463+0000","last_active":"2024-04-25T12:22:34.919463+0000","last_peered":"2024-04-25T12:22:34.919463+0000","last_clean":"2024-04-25T12:22:34.919463+0000","last_became_active":"2024-04-25T12:22:34.917798+0000","last_became_peered":"2024-04-25T12:22:34.917798+0000","last_unstale":"2024-04-25T12:22:34.919463+0000","last_undegraded":"2024-04-25T12:22:34.919463+0000","last_fullsized":"2024-04-25T12:22:34.919463+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:35.620229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894822+0000","last_change":"2024-04-25T12:21:54.202462+0000","last_active":"2024-04-25T12:22:34.894822+0000","last_peered":"2024-04-25T12:22:34.894822+0000","last_clean":"2024-04-25T12:22:34.894822+0000","last_became_active":"2024-04-25T12:21:54.202112+0000","last_became_peered":"2024-04-25T12:21:54.202112+0000","last_unstale":"2024-04-25T12:22:34.894822+0000","last_undegraded":"2024-04-25T12:22:34.894822+0000","last_fullsized":"2024-04-25T12:22:34.894822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:20.813264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887672+0000","last_change":"2024-04-25T12:21:53.188606+0000","last_active":"2024-04-25T12:22:34.887672+0000","last_peered":"2024-04-25T12:22:34.887672+0000","last_clean":"2024-04-25T12:22:34.887672+0000","last_became_active":"2024-04-25T12:21:53.187855+0000","last_became_peered":"2024-04-25T12:21:53.187855+0000","last_unstale":"2024-04-25T12:22:34.887672+0000","last_undegraded":"2024-04-25T12:22:34.887672+0000","last_fullsized":"2024-04-25T12:22:34.887672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:52.874270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293184+0000","last_change":"2024-04-25T12:21:58.264074+0000","last_active":"2024-04-25T12:22:35.293184+0000","last_peered":"2024-04-25T12:22:35.293184+0000","last_clean":"2024-04-25T12:22:35.293184+0000","last_became_active":"2024-04-25T12:21:58.263425+0000","last_became_peered":"2024-04-25T12:21:58.263425+0000","last_unstale":"2024-04-25T12:22:35.293184+0000","last_undegraded":"2024-04-25T12:22:35.293184+0000","last_fullsized":"2024-04-25T12:22:35.293184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:02.083494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292583+0000","last_change":"2024-04-25T12:21:54.189512+0000","last_active":"2024-04-25T12:22:35.292583+0000","last_peered":"2024-04-25T12:22:35.292583+0000","last_clean":"2024-04-25T12:22:35.292583+0000","last_became_active":"2024-04-25T12:21:54.188587+0000","last_became_peered":"2024-04-25T12:21:54.188587+0000","last_unstale":"2024-04-25T12:22:35.292583+0000","last_undegraded":"2024-04-25T12:22:35.292583+0000","last_fullsized":"2024-04-25T12:22:35.292583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:00.810648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884624+0000","last_change":"2024-04-25T12:21:53.159998+0000","last_active":"2024-04-25T12:22:34.884624+0000","last_peered":"2024-04-25T12:22:34.884624+0000","last_clean":"2024-04-25T12:22:34.884624+0000","last_became_active":"2024-04-25T12:21:53.159714+0000","last_became_peered":"2024-04-25T12:21:53.159714+0000","last_unstale":"2024-04-25T12:22:34.884624+0000","last_undegraded":"2024-04-25T12:22:34.884624+0000","last_fullsized":"2024-04-25T12:22:34.884624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:38.665874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.982542+0000","last_change":"2024-04-25T12:22:34.982542+0000","last_active":"2024-04-25T12:22:34.982542+0000","last_peered":"2024-04-25T12:22:34.982542+0000","last_clean":"2024-04-25T12:22:34.982542+0000","last_became_active":"2024-04-25T12:22:34.981347+0000","last_became_peered":"2024-04-25T12:22:34.981347+0000","last_unstale":"2024-04-25T12:22:34.982542+0000","last_undegraded":"2024-04-25T12:22:34.982542+0000","last_fullsized":"2024-04-25T12:22:34.982542+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:55.180698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915214+0000","last_change":"2024-04-25T12:21:54.205348+0000","last_active":"2024-04-25T12:22:34.915214+0000","last_peered":"2024-04-25T12:22:34.915214+0000","last_clean":"2024-04-25T12:22:34.915214+0000","last_became_active":"2024-04-25T12:21:54.205023+0000","last_became_peered":"2024-04-25T12:21:54.205023+0000","last_unstale":"2024-04-25T12:22:34.915214+0000","last_undegraded":"2024-04-25T12:22:34.915214+0000","last_fullsized":"2024-04-25T12:22:34.915214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:46.381368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.888119+0000","last_change":"2024-04-25T12:21:53.201066+0000","last_active":"2024-04-25T12:22:34.888119+0000","last_peered":"2024-04-25T12:22:34.888119+0000","last_clean":"2024-04-25T12:22:34.888119+0000","last_became_active":"2024-04-25T12:21:53.197081+0000","last_became_peered":"2024-04-25T12:21:53.197081+0000","last_unstale":"2024-04-25T12:22:34.888119+0000","last_undegraded":"2024-04-25T12:22:34.888119+0000","last_fullsized":"2024-04-25T12:22:34.888119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:19.865455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916511+0000","last_change":"2024-04-25T12:21:58.343823+0000","last_active":"2024-04-25T12:22:34.916511+0000","last_peered":"2024-04-25T12:22:34.916511+0000","last_clean":"2024-04-25T12:22:34.916511+0000","last_became_active":"2024-04-25T12:21:58.342796+0000","last_became_peered":"2024-04-25T12:21:58.342796+0000","last_unstale":"2024-04-25T12:22:34.916511+0000","last_undegraded":"2024-04-25T12:22:34.916511+0000","last_fullsized":"2024-04-25T12:22:34.916511+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:14.849636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979107+0000","last_change":"2024-04-25T12:21:54.204569+0000","last_active":"2024-04-25T12:22:34.979107+0000","last_peered":"2024-04-25T12:22:34.979107+0000","last_clean":"2024-04-25T12:22:34.979107+0000","last_became_active":"2024-04-25T12:21:54.204212+0000","last_became_peered":"2024-04-25T12:21:54.204212+0000","last_unstale":"2024-04-25T12:22:34.979107+0000","last_undegraded":"2024-04-25T12:22:34.979107+0000","last_fullsized":"2024-04-25T12:22:34.979107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:44.245327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887147+0000","last_change":"2024-04-25T12:21:53.169844+0000","last_active":"2024-04-25T12:22:34.887147+0000","last_peered":"2024-04-25T12:22:34.887147+0000","last_clean":"2024-04-25T12:22:34.887147+0000","last_became_active":"2024-04-25T12:21:53.168939+0000","last_became_peered":"2024-04-25T12:21:53.168939+0000","last_unstale":"2024-04-25T12:22:34.887147+0000","last_undegraded":"2024-04-25T12:22:34.887147+0000","last_fullsized":"2024-04-25T12:22:34.887147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:57.836476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.888439+0000","last_change":"2024-04-25T12:21:42.610528+0000","last_active":"2024-04-25T12:22:34.888439+0000","last_peered":"2024-04-25T12:22:34.888439+0000","last_clean":"2024-04-25T12:22:34.888439+0000","last_became_active":"2024-04-25T12:21:42.608579+0000","last_became_peered":"2024-04-25T12:21:42.608579+0000","last_unstale":"2024-04-25T12:22:34.888439+0000","last_undegraded":"2024-04-25T12:22:34.888439+0000","last_fullsized":"2024-04-25T12:22:34.888439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:39.904333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:39.904333+0000","last_clean_scrub_stamp":"2024-04-25T12:21:39.904333+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:16.122851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029891+0000","last_change":"2024-04-25T12:21:58.351105+0000","last_active":"2024-04-25T12:22:35.029891+0000","last_peered":"2024-04-25T12:22:35.029891+0000","last_clean":"2024-04-25T12:22:35.029891+0000","last_became_active":"2024-04-25T12:21:58.350087+0000","last_became_peered":"2024-04-25T12:21:58.350087+0000","last_unstale":"2024-04-25T12:22:35.029891+0000","last_undegraded":"2024-04-25T12:22:35.029891+0000","last_fullsized":"2024-04-25T12:22:35.029891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:22.686410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891042+0000","last_change":"2024-04-25T12:21:54.215530+0000","last_active":"2024-04-25T12:22:34.891042+0000","last_peered":"2024-04-25T12:22:34.891042+0000","last_clean":"2024-04-25T12:22:34.891042+0000","last_became_active":"2024-04-25T12:21:54.211077+0000","last_became_peered":"2024-04-25T12:21:54.211077+0000","last_unstale":"2024-04-25T12:22:34.891042+0000","last_undegraded":"2024-04-25T12:22:34.891042+0000","last_fullsized":"2024-04-25T12:22:34.891042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:03.079964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884857+0000","last_change":"2024-04-25T12:21:53.175259+0000","last_active":"2024-04-25T12:22:34.884857+0000","last_peered":"2024-04-25T12:22:34.884857+0000","last_clean":"2024-04-25T12:22:34.884857+0000","last_became_active":"2024-04-25T12:21:53.174980+0000","last_became_peered":"2024-04-25T12:21:53.174980+0000","last_unstale":"2024-04-25T12:22:34.884857+0000","last_undegraded":"2024-04-25T12:22:34.884857+0000","last_fullsized":"2024-04-25T12:22:34.884857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:51.852590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029315+0000","last_change":"2024-04-25T12:21:58.344660+0000","last_active":"2024-04-25T12:22:35.029315+0000","last_peered":"2024-04-25T12:22:35.029315+0000","last_clean":"2024-04-25T12:22:35.029315+0000","last_became_active":"2024-04-25T12:21:58.343502+0000","last_became_peered":"2024-04-25T12:21:58.343502+0000","last_unstale":"2024-04-25T12:22:35.029315+0000","last_undegraded":"2024-04-25T12:22:35.029315+0000","last_fullsized":"2024-04-25T12:22:35.029315+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:46.127740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887959+0000","last_change":"2024-04-25T12:21:54.207666+0000","last_active":"2024-04-25T12:22:34.887959+0000","last_peered":"2024-04-25T12:22:34.887959+0000","last_clean":"2024-04-25T12:22:34.887959+0000","last_became_active":"2024-04-25T12:21:54.206749+0000","last_became_peered":"2024-04-25T12:21:54.206749+0000","last_unstale":"2024-04-25T12:22:34.887959+0000","last_undegraded":"2024-04-25T12:22:34.887959+0000","last_fullsized":"2024-04-25T12:22:34.887959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:36.113364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293367+0000","last_change":"2024-04-25T12:21:53.179412+0000","last_active":"2024-04-25T12:22:35.293367+0000","last_peered":"2024-04-25T12:22:35.293367+0000","last_clean":"2024-04-25T12:22:35.293367+0000","last_became_active":"2024-04-25T12:21:53.179142+0000","last_became_peered":"2024-04-25T12:21:53.179142+0000","last_unstale":"2024-04-25T12:22:35.293367+0000","last_undegraded":"2024-04-25T12:22:35.293367+0000","last_fullsized":"2024-04-25T12:22:35.293367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:08.771439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915942+0000","last_change":"2024-04-25T12:21:58.254119+0000","last_active":"2024-04-25T12:22:34.915942+0000","last_peered":"2024-04-25T12:22:34.915942+0000","last_clean":"2024-04-25T12:22:34.915942+0000","last_became_active":"2024-04-25T12:21:58.253624+0000","last_became_peered":"2024-04-25T12:21:58.253624+0000","last_unstale":"2024-04-25T12:22:34.915942+0000","last_undegraded":"2024-04-25T12:22:34.915942+0000","last_fullsized":"2024-04-25T12:22:34.915942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:54.719908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891979+0000","last_change":"2024-04-25T12:21:54.219803+0000","last_active":"2024-04-25T12:22:34.891979+0000","last_peered":"2024-04-25T12:22:34.891979+0000","last_clean":"2024-04-25T12:22:34.891979+0000","last_became_active":"2024-04-25T12:21:54.219513+0000","last_became_peered":"2024-04-25T12:21:54.219513+0000","last_unstale":"2024-04-25T12:22:34.891979+0000","last_undegraded":"2024-04-25T12:22:34.891979+0000","last_fullsized":"2024-04-25T12:22:34.891979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:03.617773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.886845+0000","last_change":"2024-04-25T12:21:53.159382+0000","last_active":"2024-04-25T12:22:34.886845+0000","last_peered":"2024-04-25T12:22:34.886845+0000","last_clean":"2024-04-25T12:22:34.886845+0000","last_became_active":"2024-04-25T12:21:53.159018+0000","last_became_peered":"2024-04-25T12:21:53.159018+0000","last_unstale":"2024-04-25T12:22:34.886845+0000","last_undegraded":"2024-04-25T12:22:34.886845+0000","last_fullsized":"2024-04-25T12:22:34.886845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:39.868721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.885990+0000","last_change":"2024-04-25T12:21:58.344915+0000","last_active":"2024-04-25T12:22:34.885990+0000","last_peered":"2024-04-25T12:22:34.885990+0000","last_clean":"2024-04-25T12:22:34.885990+0000","last_became_active":"2024-04-25T12:21:58.343839+0000","last_became_peered":"2024-04-25T12:21:58.343839+0000","last_unstale":"2024-04-25T12:22:34.885990+0000","last_undegraded":"2024-04-25T12:22:34.885990+0000","last_fullsized":"2024-04-25T12:22:34.885990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:20.784047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891353+0000","last_change":"2024-04-25T12:21:54.215509+0000","last_active":"2024-04-25T12:22:34.891353+0000","last_peered":"2024-04-25T12:22:34.891353+0000","last_clean":"2024-04-25T12:22:34.891353+0000","last_became_active":"2024-04-25T12:21:54.211719+0000","last_became_peered":"2024-04-25T12:21:54.211719+0000","last_unstale":"2024-04-25T12:22:34.891353+0000","last_undegraded":"2024-04-25T12:22:34.891353+0000","last_fullsized":"2024-04-25T12:22:34.891353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:21.047044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.895010+0000","last_change":"2024-04-25T12:21:53.170513+0000","last_active":"2024-04-25T12:22:34.895010+0000","last_peered":"2024-04-25T12:22:34.895010+0000","last_clean":"2024-04-25T12:22:34.895010+0000","last_became_active":"2024-04-25T12:21:53.169743+0000","last_became_peered":"2024-04-25T12:21:53.169743+0000","last_unstale":"2024-04-25T12:22:34.895010+0000","last_undegraded":"2024-04-25T12:22:34.895010+0000","last_fullsized":"2024-04-25T12:22:34.895010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:03.566639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893058+0000","last_change":"2024-04-25T12:21:58.254432+0000","last_active":"2024-04-25T12:22:34.893058+0000","last_peered":"2024-04-25T12:22:34.893058+0000","last_clean":"2024-04-25T12:22:34.893058+0000","last_became_active":"2024-04-25T12:21:58.253256+0000","last_became_peered":"2024-04-25T12:21:58.253256+0000","last_unstale":"2024-04-25T12:22:34.893058+0000","last_undegraded":"2024-04-25T12:22:34.893058+0000","last_fullsized":"2024-04-25T12:22:34.893058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:13.469118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.896289+0000","last_change":"2024-04-25T12:22:34.896289+0000","last_active":"2024-04-25T12:22:34.896289+0000","last_peered":"2024-04-25T12:22:34.896289+0000","last_clean":"2024-04-25T12:22:34.896289+0000","last_became_active":"2024-04-25T12:22:34.895584+0000","last_became_peered":"2024-04-25T12:22:34.895584+0000","last_unstale":"2024-04-25T12:22:34.896289+0000","last_undegraded":"2024-04-25T12:22:34.896289+0000","last_fullsized":"2024-04-25T12:22:34.896289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:54.648002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884039+0000","last_change":"2024-04-25T12:21:53.163846+0000","last_active":"2024-04-25T12:22:34.884039+0000","last_peered":"2024-04-25T12:22:34.884039+0000","last_clean":"2024-04-25T12:22:34.884039+0000","last_became_active":"2024-04-25T12:21:53.163565+0000","last_became_peered":"2024-04-25T12:21:53.163565+0000","last_unstale":"2024-04-25T12:22:34.884039+0000","last_undegraded":"2024-04-25T12:22:34.884039+0000","last_fullsized":"2024-04-25T12:22:34.884039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:22.297830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916263+0000","last_change":"2024-04-25T12:21:58.250582+0000","last_active":"2024-04-25T12:22:34.916263+0000","last_peered":"2024-04-25T12:22:34.916263+0000","last_clean":"2024-04-25T12:22:34.916263+0000","last_became_active":"2024-04-25T12:21:58.250136+0000","last_became_peered":"2024-04-25T12:21:58.250136+0000","last_unstale":"2024-04-25T12:22:34.916263+0000","last_undegraded":"2024-04-25T12:22:34.916263+0000","last_fullsized":"2024-04-25T12:22:34.916263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:23.786586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030261+0000","last_change":"2024-04-25T12:21:54.200492+0000","last_active":"2024-04-25T12:22:35.030261+0000","last_peered":"2024-04-25T12:22:35.030261+0000","last_clean":"2024-04-25T12:22:35.030261+0000","last_became_active":"2024-04-25T12:21:54.200187+0000","last_became_peered":"2024-04-25T12:21:54.200187+0000","last_unstale":"2024-04-25T12:22:35.030261+0000","last_undegraded":"2024-04-25T12:22:35.030261+0000","last_fullsized":"2024-04-25T12:22:35.030261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:17.428348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029495+0000","last_change":"2024-04-25T12:21:53.186752+0000","last_active":"2024-04-25T12:22:35.029495+0000","last_peered":"2024-04-25T12:22:35.029495+0000","last_clean":"2024-04-25T12:22:35.029495+0000","last_became_active":"2024-04-25T12:21:53.184866+0000","last_became_peered":"2024-04-25T12:21:53.184866+0000","last_unstale":"2024-04-25T12:22:35.029495+0000","last_undegraded":"2024-04-25T12:22:35.029495+0000","last_fullsized":"2024-04-25T12:22:35.029495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:07.228743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980381+0000","last_change":"2024-04-25T12:21:58.344241+0000","last_active":"2024-04-25T12:22:34.980381+0000","last_peered":"2024-04-25T12:22:34.980381+0000","last_clean":"2024-04-25T12:22:34.980381+0000","last_became_active":"2024-04-25T12:21:58.343764+0000","last_became_peered":"2024-04-25T12:21:58.343764+0000","last_unstale":"2024-04-25T12:22:34.980381+0000","last_undegraded":"2024-04-25T12:22:34.980381+0000","last_fullsized":"2024-04-25T12:22:34.980381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:25.931918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890533+0000","last_change":"2024-04-25T12:21:54.216405+0000","last_active":"2024-04-25T12:22:34.890533+0000","last_peered":"2024-04-25T12:22:34.890533+0000","last_clean":"2024-04-25T12:22:34.890533+0000","last_became_active":"2024-04-25T12:21:54.215575+0000","last_became_peered":"2024-04-25T12:21:54.215575+0000","last_unstale":"2024-04-25T12:22:34.890533+0000","last_undegraded":"2024-04-25T12:22:34.890533+0000","last_fullsized":"2024-04-25T12:22:34.890533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:57.935295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887546+0000","last_change":"2024-04-25T12:21:53.198384+0000","last_active":"2024-04-25T12:22:34.887546+0000","last_peered":"2024-04-25T12:22:34.887546+0000","last_clean":"2024-04-25T12:22:34.887546+0000","last_became_active":"2024-04-25T12:21:53.197618+0000","last_became_peered":"2024-04-25T12:21:53.197618+0000","last_unstale":"2024-04-25T12:22:34.887546+0000","last_undegraded":"2024-04-25T12:22:34.887546+0000","last_fullsized":"2024-04-25T12:22:34.887546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:23.368197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979881+0000","last_change":"2024-04-25T12:21:58.342445+0000","last_active":"2024-04-25T12:22:34.979881+0000","last_peered":"2024-04-25T12:22:34.979881+0000","last_clean":"2024-04-25T12:22:34.979881+0000","last_became_active":"2024-04-25T12:21:58.341575+0000","last_became_peered":"2024-04-25T12:21:58.341575+0000","last_unstale":"2024-04-25T12:22:34.979881+0000","last_undegraded":"2024-04-25T12:22:34.979881+0000","last_fullsized":"2024-04-25T12:22:34.979881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:34.553686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915983+0000","last_change":"2024-04-25T12:21:54.200799+0000","last_active":"2024-04-25T12:22:34.915983+0000","last_peered":"2024-04-25T12:22:34.915983+0000","last_clean":"2024-04-25T12:22:34.915983+0000","last_became_active":"2024-04-25T12:21:54.200209+0000","last_became_peered":"2024-04-25T12:21:54.200209+0000","last_unstale":"2024-04-25T12:22:34.915983+0000","last_undegraded":"2024-04-25T12:22:34.915983+0000","last_fullsized":"2024-04-25T12:22:34.915983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:57.958942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916583+0000","last_change":"2024-04-25T12:21:53.168731+0000","last_active":"2024-04-25T12:22:34.916583+0000","last_peered":"2024-04-25T12:22:34.916583+0000","last_clean":"2024-04-25T12:22:34.916583+0000","last_became_active":"2024-04-25T12:21:53.168461+0000","last_became_peered":"2024-04-25T12:21:53.168461+0000","last_unstale":"2024-04-25T12:22:34.916583+0000","last_undegraded":"2024-04-25T12:22:34.916583+0000","last_fullsized":"2024-04-25T12:22:34.916583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:34.935857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887582+0000","last_change":"2024-04-25T12:21:58.344622+0000","last_active":"2024-04-25T12:22:34.887582+0000","last_peered":"2024-04-25T12:22:34.887582+0000","last_clean":"2024-04-25T12:22:34.887582+0000","last_became_active":"2024-04-25T12:21:58.343533+0000","last_became_peered":"2024-04-25T12:21:58.343533+0000","last_unstale":"2024-04-25T12:22:34.887582+0000","last_undegraded":"2024-04-25T12:22:34.887582+0000","last_fullsized":"2024-04-25T12:22:34.887582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:35.536857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891003+0000","last_change":"2024-04-25T12:21:54.216903+0000","last_active":"2024-04-25T12:22:34.891003+0000","last_peered":"2024-04-25T12:22:34.891003+0000","last_clean":"2024-04-25T12:22:34.891003+0000","last_became_active":"2024-04-25T12:21:54.216312+0000","last_became_peered":"2024-04-25T12:21:54.216312+0000","last_unstale":"2024-04-25T12:22:34.891003+0000","last_undegraded":"2024-04-25T12:22:34.891003+0000","last_fullsized":"2024-04-25T12:22:34.891003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:12.963783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'10","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:11.327474+0000","last_change":"2024-04-25T12:21:53.179160+0000","last_active":"2024-04-25T12:24:11.327474+0000","last_peered":"2024-04-25T12:24:11.327474+0000","last_clean":"2024-04-25T12:24:11.327474+0000","last_became_active":"2024-04-25T12:21:53.177229+0000","last_became_peered":"2024-04-25T12:21:53.177229+0000","last_unstale":"2024-04-25T12:24:11.327474+0000","last_undegraded":"2024-04-25T12:24:11.327474+0000","last_fullsized":"2024-04-25T12:24:11.327474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:09.082459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293725+0000","last_change":"2024-04-25T12:21:58.245003+0000","last_active":"2024-04-25T12:22:35.293725+0000","last_peered":"2024-04-25T12:22:35.293725+0000","last_clean":"2024-04-25T12:22:35.293725+0000","last_became_active":"2024-04-25T12:21:58.244500+0000","last_became_peered":"2024-04-25T12:21:58.244500+0000","last_unstale":"2024-04-25T12:22:35.293725+0000","last_undegraded":"2024-04-25T12:22:35.293725+0000","last_fullsized":"2024-04-25T12:22:35.293725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:35.010344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.895285+0000","last_change":"2024-04-25T12:21:54.213845+0000","last_active":"2024-04-25T12:22:34.895285+0000","last_peered":"2024-04-25T12:22:34.895285+0000","last_clean":"2024-04-25T12:22:34.895285+0000","last_became_active":"2024-04-25T12:21:54.213413+0000","last_became_peered":"2024-04-25T12:21:54.213413+0000","last_unstale":"2024-04-25T12:22:34.895285+0000","last_undegraded":"2024-04-25T12:22:34.895285+0000","last_fullsized":"2024-04-25T12:22:34.895285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:59.864079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293155+0000","last_change":"2024-04-25T12:21:53.186487+0000","last_active":"2024-04-25T12:22:35.293155+0000","last_peered":"2024-04-25T12:22:35.293155+0000","last_clean":"2024-04-25T12:22:35.293155+0000","last_became_active":"2024-04-25T12:21:53.186227+0000","last_became_peered":"2024-04-25T12:21:53.186227+0000","last_unstale":"2024-04-25T12:22:35.293155+0000","last_undegraded":"2024-04-25T12:22:35.293155+0000","last_fullsized":"2024-04-25T12:22:35.293155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:20.317103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894312+0000","last_change":"2024-04-25T12:21:58.249806+0000","last_active":"2024-04-25T12:22:34.894312+0000","last_peered":"2024-04-25T12:22:34.894312+0000","last_clean":"2024-04-25T12:22:34.894312+0000","last_became_active":"2024-04-25T12:21:58.248841+0000","last_became_peered":"2024-04-25T12:21:58.248841+0000","last_unstale":"2024-04-25T12:22:34.894312+0000","last_undegraded":"2024-04-25T12:22:34.894312+0000","last_fullsized":"2024-04-25T12:22:34.894312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:18.448118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916576+0000","last_change":"2024-04-25T12:21:54.189948+0000","last_active":"2024-04-25T12:22:34.916576+0000","last_peered":"2024-04-25T12:22:34.916576+0000","last_clean":"2024-04-25T12:22:34.916576+0000","last_became_active":"2024-04-25T12:21:54.189097+0000","last_became_peered":"2024-04-25T12:21:54.189097+0000","last_unstale":"2024-04-25T12:22:34.916576+0000","last_undegraded":"2024-04-25T12:22:34.916576+0000","last_fullsized":"2024-04-25T12:22:34.916576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:09.029536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.888984+0000","last_change":"2024-04-25T12:21:53.206472+0000","last_active":"2024-04-25T12:22:34.888984+0000","last_peered":"2024-04-25T12:22:34.888984+0000","last_clean":"2024-04-25T12:22:34.888984+0000","last_became_active":"2024-04-25T12:21:53.205742+0000","last_became_peered":"2024-04-25T12:21:53.205742+0000","last_unstale":"2024-04-25T12:22:34.888984+0000","last_undegraded":"2024-04-25T12:22:34.888984+0000","last_fullsized":"2024-04-25T12:22:34.888984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:37.444336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978676+0000","last_change":"2024-04-25T12:21:58.261490+0000","last_active":"2024-04-25T12:22:34.978676+0000","last_peered":"2024-04-25T12:22:34.978676+0000","last_clean":"2024-04-25T12:22:34.978676+0000","last_became_active":"2024-04-25T12:21:58.260979+0000","last_became_peered":"2024-04-25T12:21:58.260979+0000","last_unstale":"2024-04-25T12:22:34.978676+0000","last_undegraded":"2024-04-25T12:22:34.978676+0000","last_fullsized":"2024-04-25T12:22:34.978676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:51.396618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890271+0000","last_change":"2024-04-25T12:22:34.890271+0000","last_active":"2024-04-25T12:22:34.890271+0000","last_peered":"2024-04-25T12:22:34.890271+0000","last_clean":"2024-04-25T12:22:34.890271+0000","last_became_active":"2024-04-25T12:22:34.889562+0000","last_became_peered":"2024-04-25T12:22:34.889562+0000","last_unstale":"2024-04-25T12:22:34.890271+0000","last_undegraded":"2024-04-25T12:22:34.890271+0000","last_fullsized":"2024-04-25T12:22:34.890271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:17.476913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030693+0000","last_change":"2024-04-25T12:21:53.206850+0000","last_active":"2024-04-25T12:22:35.030693+0000","last_peered":"2024-04-25T12:22:35.030693+0000","last_clean":"2024-04-25T12:22:35.030693+0000","last_became_active":"2024-04-25T12:21:53.206274+0000","last_became_peered":"2024-04-25T12:21:53.206274+0000","last_unstale":"2024-04-25T12:22:35.030693+0000","last_undegraded":"2024-04-25T12:22:35.030693+0000","last_fullsized":"2024-04-25T12:22:35.030693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:25.867387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979375+0000","last_change":"2024-04-25T12:21:58.346593+0000","last_active":"2024-04-25T12:22:34.979375+0000","last_peered":"2024-04-25T12:22:34.979375+0000","last_clean":"2024-04-25T12:22:34.979375+0000","last_became_active":"2024-04-25T12:21:58.346195+0000","last_became_peered":"2024-04-25T12:21:58.346195+0000","last_unstale":"2024-04-25T12:22:34.979375+0000","last_undegraded":"2024-04-25T12:22:34.979375+0000","last_fullsized":"2024-04-25T12:22:34.979375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:47.745861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915960+0000","last_change":"2024-04-25T12:21:58.347908+0000","last_active":"2024-04-25T12:22:34.915960+0000","last_peered":"2024-04-25T12:22:34.915960+0000","last_clean":"2024-04-25T12:22:34.915960+0000","last_became_active":"2024-04-25T12:21:58.346887+0000","last_became_peered":"2024-04-25T12:21:58.346887+0000","last_unstale":"2024-04-25T12:22:34.915960+0000","last_undegraded":"2024-04-25T12:22:34.915960+0000","last_fullsized":"2024-04-25T12:22:34.915960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:06.228605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.291914+0000","last_change":"2024-04-25T12:21:54.203140+0000","last_active":"2024-04-25T12:22:35.291914+0000","last_peered":"2024-04-25T12:22:35.291914+0000","last_clean":"2024-04-25T12:22:35.291914+0000","last_became_active":"2024-04-25T12:21:54.202399+0000","last_became_peered":"2024-04-25T12:21:54.202399+0000","last_unstale":"2024-04-25T12:22:35.291914+0000","last_undegraded":"2024-04-25T12:22:35.291914+0000","last_fullsized":"2024-04-25T12:22:35.291914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:19.691760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.888025+0000","last_change":"2024-04-25T12:21:53.202038+0000","last_active":"2024-04-25T12:22:34.888025+0000","last_peered":"2024-04-25T12:22:34.888025+0000","last_clean":"2024-04-25T12:22:34.888025+0000","last_became_active":"2024-04-25T12:21:53.189592+0000","last_became_peered":"2024-04-25T12:21:53.189592+0000","last_unstale":"2024-04-25T12:22:34.888025+0000","last_undegraded":"2024-04-25T12:22:34.888025+0000","last_fullsized":"2024-04-25T12:22:34.888025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:38.052120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030482+0000","last_change":"2024-04-25T12:21:58.246247+0000","last_active":"2024-04-25T12:22:35.030482+0000","last_peered":"2024-04-25T12:22:35.030482+0000","last_clean":"2024-04-25T12:22:35.030482+0000","last_became_active":"2024-04-25T12:21:58.245085+0000","last_became_peered":"2024-04-25T12:21:58.245085+0000","last_unstale":"2024-04-25T12:22:35.030482+0000","last_undegraded":"2024-04-25T12:22:35.030482+0000","last_fullsized":"2024-04-25T12:22:35.030482+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:24.660921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978856+0000","last_change":"2024-04-25T12:21:54.207534+0000","last_active":"2024-04-25T12:22:34.978856+0000","last_peered":"2024-04-25T12:22:34.978856+0000","last_clean":"2024-04-25T12:22:34.978856+0000","last_became_active":"2024-04-25T12:21:54.206786+0000","last_became_peered":"2024-04-25T12:21:54.206786+0000","last_unstale":"2024-04-25T12:22:34.978856+0000","last_undegraded":"2024-04-25T12:22:34.978856+0000","last_fullsized":"2024-04-25T12:22:34.978856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:48.775827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979753+0000","last_change":"2024-04-25T12:21:53.190402+0000","last_active":"2024-04-25T12:22:34.979753+0000","last_peered":"2024-04-25T12:22:34.979753+0000","last_clean":"2024-04-25T12:22:34.979753+0000","last_became_active":"2024-04-25T12:21:53.189936+0000","last_became_peered":"2024-04-25T12:21:53.189936+0000","last_unstale":"2024-04-25T12:22:34.979753+0000","last_undegraded":"2024-04-25T12:22:34.979753+0000","last_fullsized":"2024-04-25T12:22:34.979753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:30.984588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029714+0000","last_change":"2024-04-25T12:21:53.186071+0000","last_active":"2024-04-25T12:22:35.029714+0000","last_peered":"2024-04-25T12:22:35.029714+0000","last_clean":"2024-04-25T12:22:35.029714+0000","last_became_active":"2024-04-25T12:21:53.185357+0000","last_became_peered":"2024-04-25T12:21:53.185357+0000","last_unstale":"2024-04-25T12:22:35.029714+0000","last_undegraded":"2024-04-25T12:22:35.029714+0000","last_fullsized":"2024-04-25T12:22:35.029714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:10.148702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916445+0000","last_change":"2024-04-25T12:21:54.205678+0000","last_active":"2024-04-25T12:22:34.916445+0000","last_peered":"2024-04-25T12:22:34.916445+0000","last_clean":"2024-04-25T12:22:34.916445+0000","last_became_active":"2024-04-25T12:21:54.205219+0000","last_became_peered":"2024-04-25T12:21:54.205219+0000","last_unstale":"2024-04-25T12:22:34.916445+0000","last_undegraded":"2024-04-25T12:22:34.916445+0000","last_fullsized":"2024-04-25T12:22:34.916445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:55.152284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884389+0000","last_change":"2024-04-25T12:21:58.257395+0000","last_active":"2024-04-25T12:22:34.884389+0000","last_peered":"2024-04-25T12:22:34.884389+0000","last_clean":"2024-04-25T12:22:34.884389+0000","last_became_active":"2024-04-25T12:21:58.256219+0000","last_became_peered":"2024-04-25T12:21:58.256219+0000","last_unstale":"2024-04-25T12:22:34.884389+0000","last_undegraded":"2024-04-25T12:22:34.884389+0000","last_fullsized":"2024-04-25T12:22:34.884389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:15.119967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979227+0000","last_change":"2024-04-25T12:21:53.194633+0000","last_active":"2024-04-25T12:22:34.979227+0000","last_peered":"2024-04-25T12:22:34.979227+0000","last_clean":"2024-04-25T12:22:34.979227+0000","last_became_active":"2024-04-25T12:21:53.194306+0000","last_became_peered":"2024-04-25T12:21:53.194306+0000","last_unstale":"2024-04-25T12:22:34.979227+0000","last_undegraded":"2024-04-25T12:22:34.979227+0000","last_fullsized":"2024-04-25T12:22:34.979227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:03.566639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894127+0000","last_change":"2024-04-25T12:21:54.201494+0000","last_active":"2024-04-25T12:22:34.894127+0000","last_peered":"2024-04-25T12:22:34.894127+0000","last_clean":"2024-04-25T12:22:34.894127+0000","last_became_active":"2024-04-25T12:21:54.196085+0000","last_became_peered":"2024-04-25T12:21:54.196085+0000","last_unstale":"2024-04-25T12:22:34.894127+0000","last_undegraded":"2024-04-25T12:22:34.894127+0000","last_fullsized":"2024-04-25T12:22:34.894127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:21.183608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979599+0000","last_change":"2024-04-25T12:21:58.261744+0000","last_active":"2024-04-25T12:22:34.979599+0000","last_peered":"2024-04-25T12:22:34.979599+0000","last_clean":"2024-04-25T12:22:34.979599+0000","last_became_active":"2024-04-25T12:21:58.260821+0000","last_became_peered":"2024-04-25T12:21:58.260821+0000","last_unstale":"2024-04-25T12:22:34.979599+0000","last_undegraded":"2024-04-25T12:22:34.979599+0000","last_fullsized":"2024-04-25T12:22:34.979599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:14.169485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029125+0000","last_change":"2024-04-25T12:21:54.201042+0000","last_active":"2024-04-25T12:22:35.029125+0000","last_peered":"2024-04-25T12:22:35.029125+0000","last_clean":"2024-04-25T12:22:35.029125+0000","last_became_active":"2024-04-25T12:21:54.200446+0000","last_became_peered":"2024-04-25T12:21:54.200446+0000","last_unstale":"2024-04-25T12:22:35.029125+0000","last_undegraded":"2024-04-25T12:22:35.029125+0000","last_fullsized":"2024-04-25T12:22:35.029125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:37.866196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884359+0000","last_change":"2024-04-25T12:21:54.188004+0000","last_active":"2024-04-25T12:22:34.884359+0000","last_peered":"2024-04-25T12:22:34.884359+0000","last_clean":"2024-04-25T12:22:34.884359+0000","last_became_active":"2024-04-25T12:21:54.187254+0000","last_became_peered":"2024-04-25T12:21:54.187254+0000","last_unstale":"2024-04-25T12:22:34.884359+0000","last_undegraded":"2024-04-25T12:22:34.884359+0000","last_fullsized":"2024-04-25T12:22:34.884359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:32.252676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887407+0000","last_change":"2024-04-25T12:21:54.206788+0000","last_active":"2024-04-25T12:22:34.887407+0000","last_peered":"2024-04-25T12:22:34.887407+0000","last_clean":"2024-04-25T12:22:34.887407+0000","last_became_active":"2024-04-25T12:21:54.204904+0000","last_became_peered":"2024-04-25T12:21:54.204904+0000","last_unstale":"2024-04-25T12:22:34.887407+0000","last_undegraded":"2024-04-25T12:22:34.887407+0000","last_fullsized":"2024-04-25T12:22:34.887407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:24.928840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916233+0000","last_change":"2024-04-25T12:21:54.204288+0000","last_active":"2024-04-25T12:22:34.916233+0000","last_peered":"2024-04-25T12:22:34.916233+0000","last_clean":"2024-04-25T12:22:34.916233+0000","last_became_active":"2024-04-25T12:21:54.203922+0000","last_became_peered":"2024-04-25T12:21:54.203922+0000","last_unstale":"2024-04-25T12:22:34.916233+0000","last_undegraded":"2024-04-25T12:22:34.916233+0000","last_fullsized":"2024-04-25T12:22:34.916233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:36.299452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980303+0000","last_change":"2024-04-25T12:21:54.208621+0000","last_active":"2024-04-25T12:22:34.980303+0000","last_peered":"2024-04-25T12:22:34.980303+0000","last_clean":"2024-04-25T12:22:34.980303+0000","last_became_active":"2024-04-25T12:21:54.206993+0000","last_became_peered":"2024-04-25T12:21:54.206993+0000","last_unstale":"2024-04-25T12:22:34.980303+0000","last_undegraded":"2024-04-25T12:22:34.980303+0000","last_fullsized":"2024-04-25T12:22:34.980303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:56:08.605883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292881+0000","last_change":"2024-04-25T12:21:54.202203+0000","last_active":"2024-04-25T12:22:35.292881+0000","last_peered":"2024-04-25T12:22:35.292881+0000","last_clean":"2024-04-25T12:22:35.292881+0000","last_became_active":"2024-04-25T12:21:54.201551+0000","last_became_peered":"2024-04-25T12:21:54.201551+0000","last_unstale":"2024-04-25T12:22:35.292881+0000","last_undegraded":"2024-04-25T12:22:35.292881+0000","last_fullsized":"2024-04-25T12:22:35.292881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:12.846584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030100+0000","last_change":"2024-04-25T12:21:54.220705+0000","last_active":"2024-04-25T12:22:35.030100+0000","last_peered":"2024-04-25T12:22:35.030100+0000","last_clean":"2024-04-25T12:22:35.030100+0000","last_became_active":"2024-04-25T12:21:54.220435+0000","last_became_peered":"2024-04-25T12:21:54.220435+0000","last_unstale":"2024-04-25T12:22:35.030100+0000","last_undegraded":"2024-04-25T12:22:35.030100+0000","last_fullsized":"2024-04-25T12:22:35.030100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:27.885210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980397+0000","last_change":"2024-04-25T12:21:54.206568+0000","last_active":"2024-04-25T12:22:34.980397+0000","last_peered":"2024-04-25T12:22:34.980397+0000","last_clean":"2024-04-25T12:22:34.980397+0000","last_became_active":"2024-04-25T12:21:54.204587+0000","last_became_peered":"2024-04-25T12:21:54.204587+0000","last_unstale":"2024-04-25T12:22:34.980397+0000","last_undegraded":"2024-04-25T12:22:34.980397+0000","last_fullsized":"2024-04-25T12:22:34.980397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:37.419230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.295869+0000","last_change":"2024-04-25T12:22:35.295869+0000","last_active":"2024-04-25T12:22:35.295869+0000","last_peered":"2024-04-25T12:22:35.295869+0000","last_clean":"2024-04-25T12:22:35.295869+0000","last_became_active":"2024-04-25T12:22:35.295116+0000","last_became_peered":"2024-04-25T12:22:35.295116+0000","last_unstale":"2024-04-25T12:22:35.295869+0000","last_undegraded":"2024-04-25T12:22:35.295869+0000","last_fullsized":"2024-04-25T12:22:35.295869+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:08.665587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979578+0000","last_change":"2024-04-25T12:21:54.203886+0000","last_active":"2024-04-25T12:22:34.979578+0000","last_peered":"2024-04-25T12:22:34.979578+0000","last_clean":"2024-04-25T12:22:34.979578+0000","last_became_active":"2024-04-25T12:21:54.203464+0000","last_became_peered":"2024-04-25T12:21:54.203464+0000","last_unstale":"2024-04-25T12:22:34.979578+0000","last_undegraded":"2024-04-25T12:22:34.979578+0000","last_fullsized":"2024-04-25T12:22:34.979578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:41.646353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887358+0000","last_change":"2024-04-25T12:21:54.213114+0000","last_active":"2024-04-25T12:22:34.887358+0000","last_peered":"2024-04-25T12:22:34.887358+0000","last_clean":"2024-04-25T12:22:34.887358+0000","last_became_active":"2024-04-25T12:21:54.212559+0000","last_became_peered":"2024-04-25T12:21:54.212559+0000","last_unstale":"2024-04-25T12:22:34.887358+0000","last_undegraded":"2024-04-25T12:22:34.887358+0000","last_fullsized":"2024-04-25T12:22:34.887358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:13.824789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915648+0000","last_change":"2024-04-25T12:21:54.215749+0000","last_active":"2024-04-25T12:22:34.915648+0000","last_peered":"2024-04-25T12:22:34.915648+0000","last_clean":"2024-04-25T12:22:34.915648+0000","last_became_active":"2024-04-25T12:21:54.215446+0000","last_became_peered":"2024-04-25T12:21:54.215446+0000","last_unstale":"2024-04-25T12:22:34.915648+0000","last_undegraded":"2024-04-25T12:22:34.915648+0000","last_fullsized":"2024-04-25T12:22:34.915648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:31.642141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029876+0000","last_change":"2024-04-25T12:21:54.210099+0000","last_active":"2024-04-25T12:22:35.029876+0000","last_peered":"2024-04-25T12:22:35.029876+0000","last_clean":"2024-04-25T12:22:35.029876+0000","last_became_active":"2024-04-25T12:21:54.209393+0000","last_became_peered":"2024-04-25T12:21:54.209393+0000","last_unstale":"2024-04-25T12:22:35.029876+0000","last_undegraded":"2024-04-25T12:22:35.029876+0000","last_fullsized":"2024-04-25T12:22:35.029876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:32.318047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891441+0000","last_change":"2024-04-25T12:21:54.216255+0000","last_active":"2024-04-25T12:22:34.891441+0000","last_peered":"2024-04-25T12:22:34.891441+0000","last_clean":"2024-04-25T12:22:34.891441+0000","last_became_active":"2024-04-25T12:21:54.211787+0000","last_became_peered":"2024-04-25T12:21:54.211787+0000","last_unstale":"2024-04-25T12:22:34.891441+0000","last_undegraded":"2024-04-25T12:22:34.891441+0000","last_fullsized":"2024-04-25T12:22:34.891441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:32.351790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.886612+0000","last_change":"2024-04-25T12:21:54.200503+0000","last_active":"2024-04-25T12:22:34.886612+0000","last_peered":"2024-04-25T12:22:34.886612+0000","last_clean":"2024-04-25T12:22:34.886612+0000","last_became_active":"2024-04-25T12:21:54.200123+0000","last_became_peered":"2024-04-25T12:21:54.200123+0000","last_unstale":"2024-04-25T12:22:34.886612+0000","last_undegraded":"2024-04-25T12:22:34.886612+0000","last_fullsized":"2024-04-25T12:22:34.886612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:04.504889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.889718+0000","last_change":"2024-04-25T12:21:54.220717+0000","last_active":"2024-04-25T12:22:34.889718+0000","last_peered":"2024-04-25T12:22:34.889718+0000","last_clean":"2024-04-25T12:22:34.889718+0000","last_became_active":"2024-04-25T12:21:54.220272+0000","last_became_peered":"2024-04-25T12:21:54.220272+0000","last_unstale":"2024-04-25T12:22:34.889718+0000","last_undegraded":"2024-04-25T12:22:34.889718+0000","last_fullsized":"2024-04-25T12:22:34.889718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:51.165297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.886279+0000","last_change":"2024-04-25T12:21:54.190288+0000","last_active":"2024-04-25T12:22:34.886279+0000","last_peered":"2024-04-25T12:22:34.886279+0000","last_clean":"2024-04-25T12:22:34.886279+0000","last_became_active":"2024-04-25T12:21:54.189535+0000","last_became_peered":"2024-04-25T12:21:54.189535+0000","last_unstale":"2024-04-25T12:22:34.886279+0000","last_undegraded":"2024-04-25T12:22:34.886279+0000","last_fullsized":"2024-04-25T12:22:34.886279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:03.757883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292136+0000","last_change":"2024-04-25T12:21:54.202898+0000","last_active":"2024-04-25T12:22:35.292136+0000","last_peered":"2024-04-25T12:22:35.292136+0000","last_clean":"2024-04-25T12:22:35.292136+0000","last_became_active":"2024-04-25T12:21:54.201641+0000","last_became_peered":"2024-04-25T12:21:54.201641+0000","last_unstale":"2024-04-25T12:22:35.292136+0000","last_undegraded":"2024-04-25T12:22:35.292136+0000","last_fullsized":"2024-04-25T12:22:35.292136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:42.865496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916388+0000","last_change":"2024-04-25T12:21:54.192818+0000","last_active":"2024-04-25T12:22:34.916388+0000","last_peered":"2024-04-25T12:22:34.916388+0000","last_clean":"2024-04-25T12:22:34.916388+0000","last_became_active":"2024-04-25T12:21:54.192052+0000","last_became_peered":"2024-04-25T12:21:54.192052+0000","last_unstale":"2024-04-25T12:22:34.916388+0000","last_undegraded":"2024-04-25T12:22:34.916388+0000","last_fullsized":"2024-04-25T12:22:34.916388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:26.048483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978815+0000","last_change":"2024-04-25T12:21:54.203798+0000","last_active":"2024-04-25T12:22:34.978815+0000","last_peered":"2024-04-25T12:22:34.978815+0000","last_clean":"2024-04-25T12:22:34.978815+0000","last_became_active":"2024-04-25T12:21:54.203472+0000","last_became_peered":"2024-04-25T12:21:54.203472+0000","last_unstale":"2024-04-25T12:22:34.978815+0000","last_undegraded":"2024-04-25T12:22:34.978815+0000","last_fullsized":"2024-04-25T12:22:34.978815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:19.958172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894317+0000","last_change":"2024-04-25T12:21:54.206055+0000","last_active":"2024-04-25T12:22:34.894317+0000","last_peered":"2024-04-25T12:22:34.894317+0000","last_clean":"2024-04-25T12:22:34.894317+0000","last_became_active":"2024-04-25T12:21:54.203030+0000","last_became_peered":"2024-04-25T12:21:54.203030+0000","last_unstale":"2024-04-25T12:22:34.894317+0000","last_undegraded":"2024-04-25T12:22:34.894317+0000","last_fullsized":"2024-04-25T12:22:34.894317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:58.836301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030468+0000","last_change":"2024-04-25T12:21:54.199660+0000","last_active":"2024-04-25T12:22:35.030468+0000","last_peered":"2024-04-25T12:22:35.030468+0000","last_clean":"2024-04-25T12:22:35.030468+0000","last_became_active":"2024-04-25T12:21:54.199362+0000","last_became_peered":"2024-04-25T12:21:54.199362+0000","last_unstale":"2024-04-25T12:22:35.030468+0000","last_undegraded":"2024-04-25T12:22:35.030468+0000","last_fullsized":"2024-04-25T12:22:35.030468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:57.706566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029976+0000","last_change":"2024-04-25T12:21:54.198710+0000","last_active":"2024-04-25T12:22:35.029976+0000","last_peered":"2024-04-25T12:22:35.029976+0000","last_clean":"2024-04-25T12:22:35.029976+0000","last_became_active":"2024-04-25T12:21:54.198432+0000","last_became_peered":"2024-04-25T12:21:54.198432+0000","last_unstale":"2024-04-25T12:22:35.029976+0000","last_undegraded":"2024-04-25T12:22:35.029976+0000","last_fullsized":"2024-04-25T12:22:35.029976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:33.124005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.892012+0000","last_change":"2024-04-25T12:21:54.218474+0000","last_active":"2024-04-25T12:22:34.892012+0000","last_peered":"2024-04-25T12:22:34.892012+0000","last_clean":"2024-04-25T12:22:34.892012+0000","last_became_active":"2024-04-25T12:21:54.216949+0000","last_became_peered":"2024-04-25T12:21:54.216949+0000","last_unstale":"2024-04-25T12:22:34.892012+0000","last_undegraded":"2024-04-25T12:22:34.892012+0000","last_fullsized":"2024-04-25T12:22:34.892012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:56.162843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978395+0000","last_change":"2024-04-25T12:21:54.200590+0000","last_active":"2024-04-25T12:22:34.978395+0000","last_peered":"2024-04-25T12:22:34.978395+0000","last_clean":"2024-04-25T12:22:34.978395+0000","last_became_active":"2024-04-25T12:21:54.200248+0000","last_became_peered":"2024-04-25T12:21:54.200248+0000","last_unstale":"2024-04-25T12:22:34.978395+0000","last_undegraded":"2024-04-25T12:22:34.978395+0000","last_fullsized":"2024-04-25T12:22:34.978395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:12.875315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890043+0000","last_change":"2024-04-25T12:21:54.197805+0000","last_active":"2024-04-25T12:22:34.890043+0000","last_peered":"2024-04-25T12:22:34.890043+0000","last_clean":"2024-04-25T12:22:34.890043+0000","last_became_active":"2024-04-25T12:21:54.197028+0000","last_became_peered":"2024-04-25T12:21:54.197028+0000","last_unstale":"2024-04-25T12:22:34.890043+0000","last_undegraded":"2024-04-25T12:22:34.890043+0000","last_fullsized":"2024-04-25T12:22:34.890043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:03.069305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887087+0000","last_change":"2024-04-25T12:21:54.190517+0000","last_active":"2024-04-25T12:22:34.887087+0000","last_peered":"2024-04-25T12:22:34.887087+0000","last_clean":"2024-04-25T12:22:34.887087+0000","last_became_active":"2024-04-25T12:21:54.189711+0000","last_became_peered":"2024-04-25T12:21:54.189711+0000","last_unstale":"2024-04-25T12:22:34.887087+0000","last_undegraded":"2024-04-25T12:22:34.887087+0000","last_fullsized":"2024-04-25T12:22:34.887087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:17.879060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890186+0000","last_change":"2024-04-25T12:21:54.197205+0000","last_active":"2024-04-25T12:22:34.890186+0000","last_peered":"2024-04-25T12:22:34.890186+0000","last_clean":"2024-04-25T12:22:34.890186+0000","last_became_active":"2024-04-25T12:21:54.196933+0000","last_became_peered":"2024-04-25T12:21:54.196933+0000","last_unstale":"2024-04-25T12:22:34.890186+0000","last_undegraded":"2024-04-25T12:22:34.890186+0000","last_fullsized":"2024-04-25T12:22:34.890186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:32.003058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887450+0000","last_change":"2024-04-25T12:21:54.207709+0000","last_active":"2024-04-25T12:22:34.887450+0000","last_peered":"2024-04-25T12:22:34.887450+0000","last_clean":"2024-04-25T12:22:34.887450+0000","last_became_active":"2024-04-25T12:21:54.207027+0000","last_became_peered":"2024-04-25T12:21:54.207027+0000","last_unstale":"2024-04-25T12:22:34.887450+0000","last_undegraded":"2024-04-25T12:22:34.887450+0000","last_fullsized":"2024-04-25T12:22:34.887450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:15.116440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915838+0000","last_change":"2024-04-25T12:21:54.185338+0000","last_active":"2024-04-25T12:22:34.915838+0000","last_peered":"2024-04-25T12:22:34.915838+0000","last_clean":"2024-04-25T12:22:34.915838+0000","last_became_active":"2024-04-25T12:21:54.184502+0000","last_became_peered":"2024-04-25T12:21:54.184502+0000","last_unstale":"2024-04-25T12:22:34.915838+0000","last_undegraded":"2024-04-25T12:22:34.915838+0000","last_fullsized":"2024-04-25T12:22:34.915838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:29.865959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292679+0000","last_change":"2024-04-25T12:21:54.183773+0000","last_active":"2024-04-25T12:22:35.292679+0000","last_peered":"2024-04-25T12:22:35.292679+0000","last_clean":"2024-04-25T12:22:35.292679+0000","last_became_active":"2024-04-25T12:21:54.182924+0000","last_became_peered":"2024-04-25T12:21:54.182924+0000","last_unstale":"2024-04-25T12:22:35.292679+0000","last_undegraded":"2024-04-25T12:22:35.292679+0000","last_fullsized":"2024-04-25T12:22:35.292679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:22.046777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891694+0000","last_change":"2024-04-25T12:21:54.210631+0000","last_active":"2024-04-25T12:22:34.891694+0000","last_peered":"2024-04-25T12:22:34.891694+0000","last_clean":"2024-04-25T12:22:34.891694+0000","last_became_active":"2024-04-25T12:21:54.210333+0000","last_became_peered":"2024-04-25T12:21:54.210333+0000","last_unstale":"2024-04-25T12:22:34.891694+0000","last_undegraded":"2024-04-25T12:22:34.891694+0000","last_fullsized":"2024-04-25T12:22:34.891694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:39.783406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476771,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":888832,"data_stored":710770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476772,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":123662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476771,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":119910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476770,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":119946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542180,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":303104,"data_stored":123662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542181,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":290816,"data_stored":119820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542180,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":119980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542180,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":897024,"data_stored":710826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:24:27.354 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:24:27.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.506+0000 7fb755587640 1 Processor -- start 2024-04-25T12:24:27.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.506+0000 7fb755587640 1 -- start start 2024-04-25T12:24:27.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.506+0000 7fb755587640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb75014ffa0 0x7fb75006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:27.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.506+0000 7fb755587640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb750074100 0x7fb7500c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:27.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.506+0000 7fb755587640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7500c5d70 con 0x7fb75014fbc0 2024-04-25T12:24:27.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.506+0000 7fb755587640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fb7500c6050 con 0x7fb750074100 2024-04-25T12:24:27.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.506+0000 7fb755587640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fb7500c6330 con 0x7fb75014ffa0 2024-04-25T12:24:27.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.506+0000 7fb747fff640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb75014ffa0 0x7fb75006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:27.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.506+0000 7fb747fff640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb75014ffa0 0x7fb75006f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.94:50368/0 (socket says 172.21.15.94:50368) 2024-04-25T12:24:27.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.506+0000 7fb747fff640 1 -- 172.21.15.94:0/3881853256 learned_addr learned my addr 172.21.15.94:0/3881853256 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:27.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.506+0000 7fb74f7fe640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb750074100 0x7fb7500c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:27.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.506+0000 7fb74f7fe640 1 -- 172.21.15.94:0/3881853256 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb75014ffa0 msgr2=0x7fb75006f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:27.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.506+0000 7fb74f7fe640 1 --2- 172.21.15.94:0/3881853256 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb75014ffa0 0x7fb75006f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:27.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.506+0000 7fb74f7fe640 1 -- 172.21.15.94:0/3881853256 >> v1:172.21.15.111:6789/0 conn(0x7fb75014fbc0 legacy=0x7fb7500c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:27.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.506+0000 7fb74f7fe640 1 -- 172.21.15.94:0/3881853256 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7500c6610 con 0x7fb750074100 2024-04-25T12:24:27.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.506+0000 7fb747fff640 1 --2- 172.21.15.94:0/3881853256 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb75014ffa0 0x7fb75006f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:24:27.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.510+0000 7fb74f7fe640 1 --2- 172.21.15.94:0/3881853256 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb750074100 0x7fb7500c7250 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb748009d90 tx=0x7fb74801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecba54b1c73714c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:27.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.510+0000 7fb74e7fc640 1 -- 172.21.15.94:0/3881853256 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7480b2070 con 0x7fb750074100 2024-04-25T12:24:27.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.510+0000 7fb74e7fc640 1 -- 172.21.15.94:0/3881853256 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7480a5a50 con 0x7fb750074100 2024-04-25T12:24:27.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.510+0000 7fb74e7fc640 1 -- 172.21.15.94:0/3881853256 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7480a5e20 con 0x7fb750074100 2024-04-25T12:24:27.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.510+0000 7fb755587640 1 -- 172.21.15.94:0/3881853256 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb750074100 msgr2=0x7fb7500c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:27.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.510+0000 7fb755587640 1 --2- 172.21.15.94:0/3881853256 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb750074100 0x7fb7500c7250 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb748009d90 tx=0x7fb74801c970 comp rx=0 tx=0).stop 2024-04-25T12:24:27.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.510+0000 7fb755587640 1 -- 172.21.15.94:0/3881853256 shutdown_connections 2024-04-25T12:24:27.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.510+0000 7fb755587640 1 --2- 172.21.15.94:0/3881853256 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb750074100 0x7fb7500c7250 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:27.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.510+0000 7fb755587640 1 --2- 172.21.15.94:0/3881853256 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb75014ffa0 0x7fb75006f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:27.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.510+0000 7fb755587640 1 -- 172.21.15.94:0/3881853256 >> 172.21.15.94:0/3881853256 conn(0x7fb75006b9d0 msgr2=0x7fb75006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:27.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.510+0000 7fb755587640 1 -- 172.21.15.94:0/3881853256 shutdown_connections 2024-04-25T12:24:27.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.510+0000 7fb755587640 1 -- 172.21.15.94:0/3881853256 wait complete. 2024-04-25T12:24:27.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb755587640 1 Processor -- start 2024-04-25T12:24:27.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb755587640 1 -- start start 2024-04-25T12:24:27.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb755587640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb750074100 0x7fb7501f2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:27.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb755587640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb75014fbc0 0x7fb750151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:27.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb755587640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb75014ffa0 0x7fb7501496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:27.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb755587640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb7500c8ab0 con 0x7fb75014ffa0 2024-04-25T12:24:27.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb755587640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb7500c8930 con 0x7fb750074100 2024-04-25T12:24:27.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb755587640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fb750166090 con 0x7fb75014fbc0 2024-04-25T12:24:27.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb74f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb75014ffa0 0x7fb7501496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:27.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb74f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb75014ffa0 0x7fb7501496e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52176/0 (socket says 172.21.15.94:52176) 2024-04-25T12:24:27.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb74f7fe640 1 -- 172.21.15.94:0/2792074598 learned_addr learned my addr 172.21.15.94:0/2792074598 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:27.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb74effd640 1 --2- 172.21.15.94:0/2792074598 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb750074100 0x7fb7501f2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:27.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb747fff640 1 --2- 172.21.15.94:0/2792074598 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb75014fbc0 0x7fb750151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:27.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb74f7fe640 1 -- 172.21.15.94:0/2792074598 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb75014fbc0 msgr2=0x7fb750151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:27.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb74f7fe640 1 --2- 172.21.15.94:0/2792074598 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb75014fbc0 0x7fb750151d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:27.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb74f7fe640 1 -- 172.21.15.94:0/2792074598 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb750074100 msgr2=0x7fb7501f2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:27.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb74f7fe640 1 --2- 172.21.15.94:0/2792074598 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb750074100 0x7fb7501f2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:27.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb74f7fe640 1 -- 172.21.15.94:0/2792074598 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7501f2f70 con 0x7fb75014ffa0 2024-04-25T12:24:27.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb74effd640 1 --2- 172.21.15.94:0/2792074598 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb750074100 0x7fb7501f2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:24:27.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb74f7fe640 1 --2- 172.21.15.94:0/2792074598 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb75014ffa0 0x7fb7501496e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb748009d90 tx=0x7fb748019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:27.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb7477fe640 1 -- 172.21.15.94:0/2792074598 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7480b2050 con 0x7fb75014ffa0 2024-04-25T12:24:27.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb7477fe640 1 -- 172.21.15.94:0/2792074598 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7480be070 con 0x7fb75014ffa0 2024-04-25T12:24:27.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb755587640 1 -- 172.21.15.94:0/2792074598 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7501515b0 con 0x7fb75014ffa0 2024-04-25T12:24:27.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb7477fe640 1 -- 172.21.15.94:0/2792074598 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb748009450 con 0x7fb75014ffa0 2024-04-25T12:24:27.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb755587640 1 -- 172.21.15.94:0/2792074598 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb75014bf60 con 0x7fb75014ffa0 2024-04-25T12:24:27.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb755587640 1 -- 172.21.15.94:0/2792074598 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb750075df0 con 0x7fb75014ffa0 2024-04-25T12:24:27.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb7477fe640 1 -- 172.21.15.94:0/2792074598 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb7480c3460 con 0x7fb75014ffa0 2024-04-25T12:24:27.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb7477fe640 1 --2- 172.21.15.94:0/2792074598 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fb7300683b0 0x7fb73006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:27.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.514+0000 7fb7477fe640 1 -- 172.21.15.94:0/2792074598 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fb748122170 con 0x7fb75014ffa0 2024-04-25T12:24:27.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.518+0000 7fb74effd640 1 --2- 172.21.15.94:0/2792074598 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fb7300683b0 0x7fb73006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:27.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.518+0000 7fb74effd640 1 --2- 172.21.15.94:0/2792074598 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fb7300683b0 0x7fb73006a870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb740001710 tx=0x7fb740009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:27.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.522+0000 7fb7477fe640 1 -- 172.21.15.94:0/2792074598 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb748016560 con 0x7fb75014ffa0 2024-04-25T12:24:27.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.666+0000 7fb755587640 1 -- 172.21.15.94:0/2792074598 --> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb7500c7df0 con 0x7fb7300683b0 2024-04-25T12:24:27.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.674+0000 7fb7477fe640 1 -- 172.21.15.94:0/2792074598 <== mgr.4101 v2:172.21.15.94:6832/549402167 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332538 (secure 0 0 0) 0x7fb7500c7df0 con 0x7fb7300683b0 2024-04-25T12:24:27.680 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:27.684 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-04-25T12:24:27.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.678+0000 7fb755587640 1 -- 172.21.15.94:0/2792074598 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fb7300683b0 msgr2=0x7fb73006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:27.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.678+0000 7fb755587640 1 --2- 172.21.15.94:0/2792074598 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fb7300683b0 0x7fb73006a870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb740001710 tx=0x7fb740009040 comp rx=0 tx=0).stop 2024-04-25T12:24:27.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.678+0000 7fb755587640 1 -- 172.21.15.94:0/2792074598 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb75014ffa0 msgr2=0x7fb7501496e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:27.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.678+0000 7fb755587640 1 --2- 172.21.15.94:0/2792074598 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb75014ffa0 0x7fb7501496e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb748009d90 tx=0x7fb748019710 comp rx=0 tx=0).stop 2024-04-25T12:24:27.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.678+0000 7fb755587640 1 -- 172.21.15.94:0/2792074598 shutdown_connections 2024-04-25T12:24:27.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.678+0000 7fb755587640 1 --2- 172.21.15.94:0/2792074598 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fb7300683b0 0x7fb73006a870 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:27.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.678+0000 7fb755587640 1 --2- 172.21.15.94:0/2792074598 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb75014fbc0 0x7fb750151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:27.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.678+0000 7fb755587640 1 --2- 172.21.15.94:0/2792074598 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb75014ffa0 0x7fb7501496e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:27.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.678+0000 7fb755587640 1 --2- 172.21.15.94:0/2792074598 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb750074100 0x7fb7501f2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:27.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.678+0000 7fb755587640 1 -- 172.21.15.94:0/2792074598 >> 172.21.15.94:0/2792074598 conn(0x7fb75006b9d0 msgr2=0x7fb7500cbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:27.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.678+0000 7fb755587640 1 -- 172.21.15.94:0/2792074598 shutdown_connections 2024-04-25T12:24:27.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.678+0000 7fb755587640 1 -- 172.21.15.94:0/2792074598 wait complete. 2024-04-25T12:24:27.700 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2024-04-25T12:24:25.804166+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236304,"kb_used_data":3496,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738416,"statfs":{"total":773094113280,"available":772852137984,"internally_reserved":0,"allocated":3579904,"data_stored":2148576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004259"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916423+0000","last_change":"2024-04-25T12:21:53.194776+0000","last_active":"2024-04-25T12:22:34.916423+0000","last_peered":"2024-04-25T12:22:34.916423+0000","last_clean":"2024-04-25T12:22:34.916423+0000","last_became_active":"2024-04-25T12:21:53.194480+0000","last_became_peered":"2024-04-25T12:21:53.194480+0000","last_unstale":"2024-04-25T12:22:34.916423+0000","last_undegraded":"2024-04-25T12:22:34.916423+0000","last_fullsized":"2024-04-25T12:22:34.916423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:52.906255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979743+0000","last_change":"2024-04-25T12:21:54.200481+0000","last_active":"2024-04-25T12:22:34.979743+0000","last_peered":"2024-04-25T12:22:34.979743+0000","last_clean":"2024-04-25T12:22:34.979743+0000","last_became_active":"2024-04-25T12:21:54.199679+0000","last_became_peered":"2024-04-25T12:21:54.199679+0000","last_unstale":"2024-04-25T12:22:34.979743+0000","last_undegraded":"2024-04-25T12:22:34.979743+0000","last_fullsized":"2024-04-25T12:22:34.979743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:59.395265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978348+0000","last_change":"2024-04-25T12:21:58.346732+0000","last_active":"2024-04-25T12:22:34.978348+0000","last_peered":"2024-04-25T12:22:34.978348+0000","last_clean":"2024-04-25T12:22:34.978348+0000","last_became_active":"2024-04-25T12:21:58.346337+0000","last_became_peered":"2024-04-25T12:21:58.346337+0000","last_unstale":"2024-04-25T12:22:34.978348+0000","last_undegraded":"2024-04-25T12:22:34.978348+0000","last_fullsized":"2024-04-25T12:22:34.978348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:20.028661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980382+0000","last_change":"2024-04-25T12:21:53.166281+0000","last_active":"2024-04-25T12:22:34.980382+0000","last_peered":"2024-04-25T12:22:34.980382+0000","last_clean":"2024-04-25T12:22:34.980382+0000","last_became_active":"2024-04-25T12:21:53.165990+0000","last_became_peered":"2024-04-25T12:21:53.165990+0000","last_unstale":"2024-04-25T12:22:34.980382+0000","last_undegraded":"2024-04-25T12:22:34.980382+0000","last_fullsized":"2024-04-25T12:22:34.980382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:07.228743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916094+0000","last_change":"2024-04-25T12:21:54.189754+0000","last_active":"2024-04-25T12:22:34.916094+0000","last_peered":"2024-04-25T12:22:34.916094+0000","last_clean":"2024-04-25T12:22:34.916094+0000","last_became_active":"2024-04-25T12:21:54.188987+0000","last_became_peered":"2024-04-25T12:21:54.188987+0000","last_unstale":"2024-04-25T12:22:34.916094+0000","last_undegraded":"2024-04-25T12:22:34.916094+0000","last_fullsized":"2024-04-25T12:22:34.916094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:29.603368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.892649+0000","last_change":"2024-04-25T12:21:58.251628+0000","last_active":"2024-04-25T12:22:34.892649+0000","last_peered":"2024-04-25T12:22:34.892649+0000","last_clean":"2024-04-25T12:22:34.892649+0000","last_became_active":"2024-04-25T12:21:58.250542+0000","last_became_peered":"2024-04-25T12:21:58.250542+0000","last_unstale":"2024-04-25T12:22:34.892649+0000","last_undegraded":"2024-04-25T12:22:34.892649+0000","last_fullsized":"2024-04-25T12:22:34.892649+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:33.434685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891183+0000","last_change":"2024-04-25T12:21:53.203427+0000","last_active":"2024-04-25T12:22:34.891183+0000","last_peered":"2024-04-25T12:22:34.891183+0000","last_clean":"2024-04-25T12:22:34.891183+0000","last_became_active":"2024-04-25T12:21:53.202760+0000","last_became_peered":"2024-04-25T12:21:53.202760+0000","last_unstale":"2024-04-25T12:22:34.891183+0000","last_undegraded":"2024-04-25T12:22:34.891183+0000","last_fullsized":"2024-04-25T12:22:34.891183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:44.397450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887718+0000","last_change":"2024-04-25T12:21:54.208420+0000","last_active":"2024-04-25T12:22:34.887718+0000","last_peered":"2024-04-25T12:22:34.887718+0000","last_clean":"2024-04-25T12:22:34.887718+0000","last_became_active":"2024-04-25T12:21:54.208093+0000","last_became_peered":"2024-04-25T12:21:54.208093+0000","last_unstale":"2024-04-25T12:22:34.887718+0000","last_undegraded":"2024-04-25T12:22:34.887718+0000","last_fullsized":"2024-04-25T12:22:34.887718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:08.762268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.892999+0000","last_change":"2024-04-25T12:21:58.255963+0000","last_active":"2024-04-25T12:22:34.892999+0000","last_peered":"2024-04-25T12:22:34.892999+0000","last_clean":"2024-04-25T12:22:34.892999+0000","last_became_active":"2024-04-25T12:21:58.254021+0000","last_became_peered":"2024-04-25T12:21:58.254021+0000","last_unstale":"2024-04-25T12:22:34.892999+0000","last_undegraded":"2024-04-25T12:22:34.892999+0000","last_fullsized":"2024-04-25T12:22:34.892999+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:20.528034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890657+0000","last_change":"2024-04-25T12:21:53.208470+0000","last_active":"2024-04-25T12:22:34.890657+0000","last_peered":"2024-04-25T12:22:34.890657+0000","last_clean":"2024-04-25T12:22:34.890657+0000","last_became_active":"2024-04-25T12:21:53.207929+0000","last_became_peered":"2024-04-25T12:21:53.207929+0000","last_unstale":"2024-04-25T12:22:34.890657+0000","last_undegraded":"2024-04-25T12:22:34.890657+0000","last_fullsized":"2024-04-25T12:22:34.890657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:14.904832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887497+0000","last_change":"2024-04-25T12:21:54.206567+0000","last_active":"2024-04-25T12:22:34.887497+0000","last_peered":"2024-04-25T12:22:34.887497+0000","last_clean":"2024-04-25T12:22:34.887497+0000","last_became_active":"2024-04-25T12:21:54.206138+0000","last_became_peered":"2024-04-25T12:21:54.206138+0000","last_unstale":"2024-04-25T12:22:34.887497+0000","last_undegraded":"2024-04-25T12:22:34.887497+0000","last_fullsized":"2024-04-25T12:22:34.887497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:31.698845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893253+0000","last_change":"2024-04-25T12:21:58.245331+0000","last_active":"2024-04-25T12:22:34.893253+0000","last_peered":"2024-04-25T12:22:34.893253+0000","last_clean":"2024-04-25T12:22:34.893253+0000","last_became_active":"2024-04-25T12:21:58.244313+0000","last_became_peered":"2024-04-25T12:21:58.244313+0000","last_unstale":"2024-04-25T12:22:34.893253+0000","last_undegraded":"2024-04-25T12:22:34.893253+0000","last_fullsized":"2024-04-25T12:22:34.893253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:21.595492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029274+0000","last_change":"2024-04-25T12:21:54.208935+0000","last_active":"2024-04-25T12:22:35.029274+0000","last_peered":"2024-04-25T12:22:35.029274+0000","last_clean":"2024-04-25T12:22:35.029274+0000","last_became_active":"2024-04-25T12:21:54.208338+0000","last_became_peered":"2024-04-25T12:21:54.208338+0000","last_unstale":"2024-04-25T12:22:35.029274+0000","last_undegraded":"2024-04-25T12:22:35.029274+0000","last_fullsized":"2024-04-25T12:22:35.029274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:08.485037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890828+0000","last_change":"2024-04-25T12:21:53.203519+0000","last_active":"2024-04-25T12:22:34.890828+0000","last_peered":"2024-04-25T12:22:34.890828+0000","last_clean":"2024-04-25T12:22:34.890828+0000","last_became_active":"2024-04-25T12:21:53.197141+0000","last_became_peered":"2024-04-25T12:21:53.197141+0000","last_unstale":"2024-04-25T12:22:34.890828+0000","last_undegraded":"2024-04-25T12:22:34.890828+0000","last_fullsized":"2024-04-25T12:22:34.890828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:03.010472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894179+0000","last_change":"2024-04-25T12:21:58.250871+0000","last_active":"2024-04-25T12:22:34.894179+0000","last_peered":"2024-04-25T12:22:34.894179+0000","last_clean":"2024-04-25T12:22:34.894179+0000","last_became_active":"2024-04-25T12:21:58.249079+0000","last_became_peered":"2024-04-25T12:21:58.249079+0000","last_unstale":"2024-04-25T12:22:34.894179+0000","last_undegraded":"2024-04-25T12:22:34.894179+0000","last_fullsized":"2024-04-25T12:22:34.894179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:54.201824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978908+0000","last_change":"2024-04-25T12:21:54.209195+0000","last_active":"2024-04-25T12:22:34.978908+0000","last_peered":"2024-04-25T12:22:34.978908+0000","last_clean":"2024-04-25T12:22:34.978908+0000","last_became_active":"2024-04-25T12:21:54.208802+0000","last_became_peered":"2024-04-25T12:21:54.208802+0000","last_unstale":"2024-04-25T12:22:34.978908+0000","last_undegraded":"2024-04-25T12:22:34.978908+0000","last_fullsized":"2024-04-25T12:22:34.978908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:10.846624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293651+0000","last_change":"2024-04-25T12:21:53.165498+0000","last_active":"2024-04-25T12:22:35.293651+0000","last_peered":"2024-04-25T12:22:35.293651+0000","last_clean":"2024-04-25T12:22:35.293651+0000","last_became_active":"2024-04-25T12:21:53.164867+0000","last_became_peered":"2024-04-25T12:21:53.164867+0000","last_unstale":"2024-04-25T12:22:35.293651+0000","last_undegraded":"2024-04-25T12:22:35.293651+0000","last_fullsized":"2024-04-25T12:22:35.293651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:07.312761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893517+0000","last_change":"2024-04-25T12:21:58.260620+0000","last_active":"2024-04-25T12:22:34.893517+0000","last_peered":"2024-04-25T12:22:34.893517+0000","last_clean":"2024-04-25T12:22:34.893517+0000","last_became_active":"2024-04-25T12:21:58.259595+0000","last_became_peered":"2024-04-25T12:21:58.259595+0000","last_unstale":"2024-04-25T12:22:34.893517+0000","last_undegraded":"2024-04-25T12:22:34.893517+0000","last_fullsized":"2024-04-25T12:22:34.893517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:43.230479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979100+0000","last_change":"2024-04-25T12:21:54.206960+0000","last_active":"2024-04-25T12:22:34.979100+0000","last_peered":"2024-04-25T12:22:34.979100+0000","last_clean":"2024-04-25T12:22:34.979100+0000","last_became_active":"2024-04-25T12:21:54.204650+0000","last_became_peered":"2024-04-25T12:21:54.204650+0000","last_unstale":"2024-04-25T12:22:34.979100+0000","last_undegraded":"2024-04-25T12:22:34.979100+0000","last_fullsized":"2024-04-25T12:22:34.979100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:15.888865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293382+0000","last_change":"2024-04-25T12:21:53.193797+0000","last_active":"2024-04-25T12:22:35.293382+0000","last_peered":"2024-04-25T12:22:35.293382+0000","last_clean":"2024-04-25T12:22:35.293382+0000","last_became_active":"2024-04-25T12:21:53.193466+0000","last_became_peered":"2024-04-25T12:21:53.193466+0000","last_unstale":"2024-04-25T12:22:35.293382+0000","last_undegraded":"2024-04-25T12:22:35.293382+0000","last_fullsized":"2024-04-25T12:22:35.293382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:23.341451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292912+0000","last_change":"2024-04-25T12:21:58.348047+0000","last_active":"2024-04-25T12:22:35.292912+0000","last_peered":"2024-04-25T12:22:35.292912+0000","last_clean":"2024-04-25T12:22:35.292912+0000","last_became_active":"2024-04-25T12:21:58.347583+0000","last_became_peered":"2024-04-25T12:21:58.347583+0000","last_unstale":"2024-04-25T12:22:35.292912+0000","last_undegraded":"2024-04-25T12:22:35.292912+0000","last_fullsized":"2024-04-25T12:22:35.292912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:21:48.878907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894218+0000","last_change":"2024-04-25T12:21:54.196479+0000","last_active":"2024-04-25T12:22:34.894218+0000","last_peered":"2024-04-25T12:22:34.894218+0000","last_clean":"2024-04-25T12:22:34.894218+0000","last_became_active":"2024-04-25T12:21:54.195939+0000","last_became_peered":"2024-04-25T12:21:54.195939+0000","last_unstale":"2024-04-25T12:22:34.894218+0000","last_undegraded":"2024-04-25T12:22:34.894218+0000","last_fullsized":"2024-04-25T12:22:34.894218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:17.787145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.886118+0000","last_change":"2024-04-25T12:21:53.198034+0000","last_active":"2024-04-25T12:22:34.886118+0000","last_peered":"2024-04-25T12:22:34.886118+0000","last_clean":"2024-04-25T12:22:34.886118+0000","last_became_active":"2024-04-25T12:21:53.196252+0000","last_became_peered":"2024-04-25T12:21:53.196252+0000","last_unstale":"2024-04-25T12:22:34.886118+0000","last_undegraded":"2024-04-25T12:22:34.886118+0000","last_fullsized":"2024-04-25T12:22:34.886118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:08.329111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.033926+0000","last_change":"2024-04-25T12:22:35.032802+0000","last_active":"2024-04-25T12:22:35.033926+0000","last_peered":"2024-04-25T12:22:35.033926+0000","last_clean":"2024-04-25T12:22:35.033926+0000","last_became_active":"2024-04-25T12:22:35.031906+0000","last_became_peered":"2024-04-25T12:22:35.031906+0000","last_unstale":"2024-04-25T12:22:35.033926+0000","last_undegraded":"2024-04-25T12:22:35.033926+0000","last_fullsized":"2024-04-25T12:22:35.033926+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:40.346041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916736+0000","last_change":"2024-04-25T12:21:54.192601+0000","last_active":"2024-04-25T12:22:34.916736+0000","last_peered":"2024-04-25T12:22:34.916736+0000","last_clean":"2024-04-25T12:22:34.916736+0000","last_became_active":"2024-04-25T12:21:54.191864+0000","last_became_peered":"2024-04-25T12:21:54.191864+0000","last_unstale":"2024-04-25T12:22:34.916736+0000","last_undegraded":"2024-04-25T12:22:34.916736+0000","last_fullsized":"2024-04-25T12:22:34.916736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:50.392769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030915+0000","last_change":"2024-04-25T12:21:53.197793+0000","last_active":"2024-04-25T12:22:35.030915+0000","last_peered":"2024-04-25T12:22:35.030915+0000","last_clean":"2024-04-25T12:22:35.030915+0000","last_became_active":"2024-04-25T12:21:53.197059+0000","last_became_peered":"2024-04-25T12:21:53.197059+0000","last_unstale":"2024-04-25T12:22:35.030915+0000","last_undegraded":"2024-04-25T12:22:35.030915+0000","last_fullsized":"2024-04-25T12:22:35.030915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:58.471408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893581+0000","last_change":"2024-04-25T12:21:58.355166+0000","last_active":"2024-04-25T12:22:34.893581+0000","last_peered":"2024-04-25T12:22:34.893581+0000","last_clean":"2024-04-25T12:22:34.893581+0000","last_became_active":"2024-04-25T12:21:58.353996+0000","last_became_peered":"2024-04-25T12:21:58.353996+0000","last_unstale":"2024-04-25T12:22:34.893581+0000","last_undegraded":"2024-04-25T12:22:34.893581+0000","last_fullsized":"2024-04-25T12:22:34.893581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:22.681720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980643+0000","last_change":"2024-04-25T12:21:54.219182+0000","last_active":"2024-04-25T12:22:34.980643+0000","last_peered":"2024-04-25T12:22:34.980643+0000","last_clean":"2024-04-25T12:22:34.980643+0000","last_became_active":"2024-04-25T12:21:54.218854+0000","last_became_peered":"2024-04-25T12:21:54.218854+0000","last_unstale":"2024-04-25T12:22:34.980643+0000","last_undegraded":"2024-04-25T12:22:34.980643+0000","last_fullsized":"2024-04-25T12:22:34.980643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:08.985962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292883+0000","last_change":"2024-04-25T12:21:53.190102+0000","last_active":"2024-04-25T12:22:35.292883+0000","last_peered":"2024-04-25T12:22:35.292883+0000","last_clean":"2024-04-25T12:22:35.292883+0000","last_became_active":"2024-04-25T12:21:53.189781+0000","last_became_peered":"2024-04-25T12:21:53.189781+0000","last_unstale":"2024-04-25T12:22:35.292883+0000","last_undegraded":"2024-04-25T12:22:35.292883+0000","last_fullsized":"2024-04-25T12:22:35.292883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:52.533217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978106+0000","last_change":"2024-04-25T12:21:58.341932+0000","last_active":"2024-04-25T12:22:34.978106+0000","last_peered":"2024-04-25T12:22:34.978106+0000","last_clean":"2024-04-25T12:22:34.978106+0000","last_became_active":"2024-04-25T12:21:58.341492+0000","last_became_peered":"2024-04-25T12:21:58.341492+0000","last_unstale":"2024-04-25T12:22:34.978106+0000","last_undegraded":"2024-04-25T12:22:34.978106+0000","last_fullsized":"2024-04-25T12:22:34.978106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:51.576036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293382+0000","last_change":"2024-04-25T12:21:54.182541+0000","last_active":"2024-04-25T12:22:35.293382+0000","last_peered":"2024-04-25T12:22:35.293382+0000","last_clean":"2024-04-25T12:22:35.293382+0000","last_became_active":"2024-04-25T12:21:54.181720+0000","last_became_peered":"2024-04-25T12:21:54.181720+0000","last_unstale":"2024-04-25T12:22:35.293382+0000","last_undegraded":"2024-04-25T12:22:35.293382+0000","last_fullsized":"2024-04-25T12:22:35.293382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:00.544076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891591+0000","last_change":"2024-04-25T12:21:53.200521+0000","last_active":"2024-04-25T12:22:34.891591+0000","last_peered":"2024-04-25T12:22:34.891591+0000","last_clean":"2024-04-25T12:22:34.891591+0000","last_became_active":"2024-04-25T12:21:53.196102+0000","last_became_peered":"2024-04-25T12:21:53.196102+0000","last_unstale":"2024-04-25T12:22:34.891591+0000","last_undegraded":"2024-04-25T12:22:34.891591+0000","last_fullsized":"2024-04-25T12:22:34.891591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:54.350452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916195+0000","last_change":"2024-04-25T12:21:58.342064+0000","last_active":"2024-04-25T12:22:34.916195+0000","last_peered":"2024-04-25T12:22:34.916195+0000","last_clean":"2024-04-25T12:22:34.916195+0000","last_became_active":"2024-04-25T12:21:58.341558+0000","last_became_peered":"2024-04-25T12:21:58.341558+0000","last_unstale":"2024-04-25T12:22:34.916195+0000","last_undegraded":"2024-04-25T12:22:34.916195+0000","last_fullsized":"2024-04-25T12:22:34.916195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:11.378767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887849+0000","last_change":"2024-04-25T12:21:54.206427+0000","last_active":"2024-04-25T12:22:34.887849+0000","last_peered":"2024-04-25T12:22:34.887849+0000","last_clean":"2024-04-25T12:22:34.887849+0000","last_became_active":"2024-04-25T12:21:54.205519+0000","last_became_peered":"2024-04-25T12:21:54.205519+0000","last_unstale":"2024-04-25T12:22:34.887849+0000","last_undegraded":"2024-04-25T12:22:34.887849+0000","last_fullsized":"2024-04-25T12:22:34.887849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:59.659460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293573+0000","last_change":"2024-04-25T12:21:53.162914+0000","last_active":"2024-04-25T12:22:35.293573+0000","last_peered":"2024-04-25T12:22:35.293573+0000","last_clean":"2024-04-25T12:22:35.293573+0000","last_became_active":"2024-04-25T12:21:53.162599+0000","last_became_peered":"2024-04-25T12:21:53.162599+0000","last_unstale":"2024-04-25T12:22:35.293573+0000","last_undegraded":"2024-04-25T12:22:35.293573+0000","last_fullsized":"2024-04-25T12:22:35.293573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:23.448280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.919463+0000","last_change":"2024-04-25T12:22:34.919463+0000","last_active":"2024-04-25T12:22:34.919463+0000","last_peered":"2024-04-25T12:22:34.919463+0000","last_clean":"2024-04-25T12:22:34.919463+0000","last_became_active":"2024-04-25T12:22:34.917798+0000","last_became_peered":"2024-04-25T12:22:34.917798+0000","last_unstale":"2024-04-25T12:22:34.919463+0000","last_undegraded":"2024-04-25T12:22:34.919463+0000","last_fullsized":"2024-04-25T12:22:34.919463+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:35.620229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894822+0000","last_change":"2024-04-25T12:21:54.202462+0000","last_active":"2024-04-25T12:22:34.894822+0000","last_peered":"2024-04-25T12:22:34.894822+0000","last_clean":"2024-04-25T12:22:34.894822+0000","last_became_active":"2024-04-25T12:21:54.202112+0000","last_became_peered":"2024-04-25T12:21:54.202112+0000","last_unstale":"2024-04-25T12:22:34.894822+0000","last_undegraded":"2024-04-25T12:22:34.894822+0000","last_fullsized":"2024-04-25T12:22:34.894822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:20.813264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887672+0000","last_change":"2024-04-25T12:21:53.188606+0000","last_active":"2024-04-25T12:22:34.887672+0000","last_peered":"2024-04-25T12:22:34.887672+0000","last_clean":"2024-04-25T12:22:34.887672+0000","last_became_active":"2024-04-25T12:21:53.187855+0000","last_became_peered":"2024-04-25T12:21:53.187855+0000","last_unstale":"2024-04-25T12:22:34.887672+0000","last_undegraded":"2024-04-25T12:22:34.887672+0000","last_fullsized":"2024-04-25T12:22:34.887672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:52.874270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293184+0000","last_change":"2024-04-25T12:21:58.264074+0000","last_active":"2024-04-25T12:22:35.293184+0000","last_peered":"2024-04-25T12:22:35.293184+0000","last_clean":"2024-04-25T12:22:35.293184+0000","last_became_active":"2024-04-25T12:21:58.263425+0000","last_became_peered":"2024-04-25T12:21:58.263425+0000","last_unstale":"2024-04-25T12:22:35.293184+0000","last_undegraded":"2024-04-25T12:22:35.293184+0000","last_fullsized":"2024-04-25T12:22:35.293184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:02.083494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292583+0000","last_change":"2024-04-25T12:21:54.189512+0000","last_active":"2024-04-25T12:22:35.292583+0000","last_peered":"2024-04-25T12:22:35.292583+0000","last_clean":"2024-04-25T12:22:35.292583+0000","last_became_active":"2024-04-25T12:21:54.188587+0000","last_became_peered":"2024-04-25T12:21:54.188587+0000","last_unstale":"2024-04-25T12:22:35.292583+0000","last_undegraded":"2024-04-25T12:22:35.292583+0000","last_fullsized":"2024-04-25T12:22:35.292583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:00.810648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884624+0000","last_change":"2024-04-25T12:21:53.159998+0000","last_active":"2024-04-25T12:22:34.884624+0000","last_peered":"2024-04-25T12:22:34.884624+0000","last_clean":"2024-04-25T12:22:34.884624+0000","last_became_active":"2024-04-25T12:21:53.159714+0000","last_became_peered":"2024-04-25T12:21:53.159714+0000","last_unstale":"2024-04-25T12:22:34.884624+0000","last_undegraded":"2024-04-25T12:22:34.884624+0000","last_fullsized":"2024-04-25T12:22:34.884624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:38.665874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.982542+0000","last_change":"2024-04-25T12:22:34.982542+0000","last_active":"2024-04-25T12:22:34.982542+0000","last_peered":"2024-04-25T12:22:34.982542+0000","last_clean":"2024-04-25T12:22:34.982542+0000","last_became_active":"2024-04-25T12:22:34.981347+0000","last_became_peered":"2024-04-25T12:22:34.981347+0000","last_unstale":"2024-04-25T12:22:34.982542+0000","last_undegraded":"2024-04-25T12:22:34.982542+0000","last_fullsized":"2024-04-25T12:22:34.982542+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:55.180698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915214+0000","last_change":"2024-04-25T12:21:54.205348+0000","last_active":"2024-04-25T12:22:34.915214+0000","last_peered":"2024-04-25T12:22:34.915214+0000","last_clean":"2024-04-25T12:22:34.915214+0000","last_became_active":"2024-04-25T12:21:54.205023+0000","last_became_peered":"2024-04-25T12:21:54.205023+0000","last_unstale":"2024-04-25T12:22:34.915214+0000","last_undegraded":"2024-04-25T12:22:34.915214+0000","last_fullsized":"2024-04-25T12:22:34.915214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:46.381368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.888119+0000","last_change":"2024-04-25T12:21:53.201066+0000","last_active":"2024-04-25T12:22:34.888119+0000","last_peered":"2024-04-25T12:22:34.888119+0000","last_clean":"2024-04-25T12:22:34.888119+0000","last_became_active":"2024-04-25T12:21:53.197081+0000","last_became_peered":"2024-04-25T12:21:53.197081+0000","last_unstale":"2024-04-25T12:22:34.888119+0000","last_undegraded":"2024-04-25T12:22:34.888119+0000","last_fullsized":"2024-04-25T12:22:34.888119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:19.865455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916511+0000","last_change":"2024-04-25T12:21:58.343823+0000","last_active":"2024-04-25T12:22:34.916511+0000","last_peered":"2024-04-25T12:22:34.916511+0000","last_clean":"2024-04-25T12:22:34.916511+0000","last_became_active":"2024-04-25T12:21:58.342796+0000","last_became_peered":"2024-04-25T12:21:58.342796+0000","last_unstale":"2024-04-25T12:22:34.916511+0000","last_undegraded":"2024-04-25T12:22:34.916511+0000","last_fullsized":"2024-04-25T12:22:34.916511+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:14.849636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979107+0000","last_change":"2024-04-25T12:21:54.204569+0000","last_active":"2024-04-25T12:22:34.979107+0000","last_peered":"2024-04-25T12:22:34.979107+0000","last_clean":"2024-04-25T12:22:34.979107+0000","last_became_active":"2024-04-25T12:21:54.204212+0000","last_became_peered":"2024-04-25T12:21:54.204212+0000","last_unstale":"2024-04-25T12:22:34.979107+0000","last_undegraded":"2024-04-25T12:22:34.979107+0000","last_fullsized":"2024-04-25T12:22:34.979107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:44.245327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887147+0000","last_change":"2024-04-25T12:21:53.169844+0000","last_active":"2024-04-25T12:22:34.887147+0000","last_peered":"2024-04-25T12:22:34.887147+0000","last_clean":"2024-04-25T12:22:34.887147+0000","last_became_active":"2024-04-25T12:21:53.168939+0000","last_became_peered":"2024-04-25T12:21:53.168939+0000","last_unstale":"2024-04-25T12:22:34.887147+0000","last_undegraded":"2024-04-25T12:22:34.887147+0000","last_fullsized":"2024-04-25T12:22:34.887147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:57.836476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.888439+0000","last_change":"2024-04-25T12:21:42.610528+0000","last_active":"2024-04-25T12:22:34.888439+0000","last_peered":"2024-04-25T12:22:34.888439+0000","last_clean":"2024-04-25T12:22:34.888439+0000","last_became_active":"2024-04-25T12:21:42.608579+0000","last_became_peered":"2024-04-25T12:21:42.608579+0000","last_unstale":"2024-04-25T12:22:34.888439+0000","last_undegraded":"2024-04-25T12:22:34.888439+0000","last_fullsized":"2024-04-25T12:22:34.888439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:39.904333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:39.904333+0000","last_clean_scrub_stamp":"2024-04-25T12:21:39.904333+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:16.122851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029891+0000","last_change":"2024-04-25T12:21:58.351105+0000","last_active":"2024-04-25T12:22:35.029891+0000","last_peered":"2024-04-25T12:22:35.029891+0000","last_clean":"2024-04-25T12:22:35.029891+0000","last_became_active":"2024-04-25T12:21:58.350087+0000","last_became_peered":"2024-04-25T12:21:58.350087+0000","last_unstale":"2024-04-25T12:22:35.029891+0000","last_undegraded":"2024-04-25T12:22:35.029891+0000","last_fullsized":"2024-04-25T12:22:35.029891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:22.686410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891042+0000","last_change":"2024-04-25T12:21:54.215530+0000","last_active":"2024-04-25T12:22:34.891042+0000","last_peered":"2024-04-25T12:22:34.891042+0000","last_clean":"2024-04-25T12:22:34.891042+0000","last_became_active":"2024-04-25T12:21:54.211077+0000","last_became_peered":"2024-04-25T12:21:54.211077+0000","last_unstale":"2024-04-25T12:22:34.891042+0000","last_undegraded":"2024-04-25T12:22:34.891042+0000","last_fullsized":"2024-04-25T12:22:34.891042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:03.079964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884857+0000","last_change":"2024-04-25T12:21:53.175259+0000","last_active":"2024-04-25T12:22:34.884857+0000","last_peered":"2024-04-25T12:22:34.884857+0000","last_clean":"2024-04-25T12:22:34.884857+0000","last_became_active":"2024-04-25T12:21:53.174980+0000","last_became_peered":"2024-04-25T12:21:53.174980+0000","last_unstale":"2024-04-25T12:22:34.884857+0000","last_undegraded":"2024-04-25T12:22:34.884857+0000","last_fullsized":"2024-04-25T12:22:34.884857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:51.852590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029315+0000","last_change":"2024-04-25T12:21:58.344660+0000","last_active":"2024-04-25T12:22:35.029315+0000","last_peered":"2024-04-25T12:22:35.029315+0000","last_clean":"2024-04-25T12:22:35.029315+0000","last_became_active":"2024-04-25T12:21:58.343502+0000","last_became_peered":"2024-04-25T12:21:58.343502+0000","last_unstale":"2024-04-25T12:22:35.029315+0000","last_undegraded":"2024-04-25T12:22:35.029315+0000","last_fullsized":"2024-04-25T12:22:35.029315+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:46.127740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887959+0000","last_change":"2024-04-25T12:21:54.207666+0000","last_active":"2024-04-25T12:22:34.887959+0000","last_peered":"2024-04-25T12:22:34.887959+0000","last_clean":"2024-04-25T12:22:34.887959+0000","last_became_active":"2024-04-25T12:21:54.206749+0000","last_became_peered":"2024-04-25T12:21:54.206749+0000","last_unstale":"2024-04-25T12:22:34.887959+0000","last_undegraded":"2024-04-25T12:22:34.887959+0000","last_fullsized":"2024-04-25T12:22:34.887959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:36.113364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293367+0000","last_change":"2024-04-25T12:21:53.179412+0000","last_active":"2024-04-25T12:22:35.293367+0000","last_peered":"2024-04-25T12:22:35.293367+0000","last_clean":"2024-04-25T12:22:35.293367+0000","last_became_active":"2024-04-25T12:21:53.179142+0000","last_became_peered":"2024-04-25T12:21:53.179142+0000","last_unstale":"2024-04-25T12:22:35.293367+0000","last_undegraded":"2024-04-25T12:22:35.293367+0000","last_fullsized":"2024-04-25T12:22:35.293367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:08.771439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915942+0000","last_change":"2024-04-25T12:21:58.254119+0000","last_active":"2024-04-25T12:22:34.915942+0000","last_peered":"2024-04-25T12:22:34.915942+0000","last_clean":"2024-04-25T12:22:34.915942+0000","last_became_active":"2024-04-25T12:21:58.253624+0000","last_became_peered":"2024-04-25T12:21:58.253624+0000","last_unstale":"2024-04-25T12:22:34.915942+0000","last_undegraded":"2024-04-25T12:22:34.915942+0000","last_fullsized":"2024-04-25T12:22:34.915942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:54.719908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891979+0000","last_change":"2024-04-25T12:21:54.219803+0000","last_active":"2024-04-25T12:22:34.891979+0000","last_peered":"2024-04-25T12:22:34.891979+0000","last_clean":"2024-04-25T12:22:34.891979+0000","last_became_active":"2024-04-25T12:21:54.219513+0000","last_became_peered":"2024-04-25T12:21:54.219513+0000","last_unstale":"2024-04-25T12:22:34.891979+0000","last_undegraded":"2024-04-25T12:22:34.891979+0000","last_fullsized":"2024-04-25T12:22:34.891979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:03.617773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.886845+0000","last_change":"2024-04-25T12:21:53.159382+0000","last_active":"2024-04-25T12:22:34.886845+0000","last_peered":"2024-04-25T12:22:34.886845+0000","last_clean":"2024-04-25T12:22:34.886845+0000","last_became_active":"2024-04-25T12:21:53.159018+0000","last_became_peered":"2024-04-25T12:21:53.159018+0000","last_unstale":"2024-04-25T12:22:34.886845+0000","last_undegraded":"2024-04-25T12:22:34.886845+0000","last_fullsized":"2024-04-25T12:22:34.886845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:39.868721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.885990+0000","last_change":"2024-04-25T12:21:58.344915+0000","last_active":"2024-04-25T12:22:34.885990+0000","last_peered":"2024-04-25T12:22:34.885990+0000","last_clean":"2024-04-25T12:22:34.885990+0000","last_became_active":"2024-04-25T12:21:58.343839+0000","last_became_peered":"2024-04-25T12:21:58.343839+0000","last_unstale":"2024-04-25T12:22:34.885990+0000","last_undegraded":"2024-04-25T12:22:34.885990+0000","last_fullsized":"2024-04-25T12:22:34.885990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:20.784047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891353+0000","last_change":"2024-04-25T12:21:54.215509+0000","last_active":"2024-04-25T12:22:34.891353+0000","last_peered":"2024-04-25T12:22:34.891353+0000","last_clean":"2024-04-25T12:22:34.891353+0000","last_became_active":"2024-04-25T12:21:54.211719+0000","last_became_peered":"2024-04-25T12:21:54.211719+0000","last_unstale":"2024-04-25T12:22:34.891353+0000","last_undegraded":"2024-04-25T12:22:34.891353+0000","last_fullsized":"2024-04-25T12:22:34.891353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:21.047044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.895010+0000","last_change":"2024-04-25T12:21:53.170513+0000","last_active":"2024-04-25T12:22:34.895010+0000","last_peered":"2024-04-25T12:22:34.895010+0000","last_clean":"2024-04-25T12:22:34.895010+0000","last_became_active":"2024-04-25T12:21:53.169743+0000","last_became_peered":"2024-04-25T12:21:53.169743+0000","last_unstale":"2024-04-25T12:22:34.895010+0000","last_undegraded":"2024-04-25T12:22:34.895010+0000","last_fullsized":"2024-04-25T12:22:34.895010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:03.566639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893058+0000","last_change":"2024-04-25T12:21:58.254432+0000","last_active":"2024-04-25T12:22:34.893058+0000","last_peered":"2024-04-25T12:22:34.893058+0000","last_clean":"2024-04-25T12:22:34.893058+0000","last_became_active":"2024-04-25T12:21:58.253256+0000","last_became_peered":"2024-04-25T12:21:58.253256+0000","last_unstale":"2024-04-25T12:22:34.893058+0000","last_undegraded":"2024-04-25T12:22:34.893058+0000","last_fullsized":"2024-04-25T12:22:34.893058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:13.469118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.896289+0000","last_change":"2024-04-25T12:22:34.896289+0000","last_active":"2024-04-25T12:22:34.896289+0000","last_peered":"2024-04-25T12:22:34.896289+0000","last_clean":"2024-04-25T12:22:34.896289+0000","last_became_active":"2024-04-25T12:22:34.895584+0000","last_became_peered":"2024-04-25T12:22:34.895584+0000","last_unstale":"2024-04-25T12:22:34.896289+0000","last_undegraded":"2024-04-25T12:22:34.896289+0000","last_fullsized":"2024-04-25T12:22:34.896289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:54.648002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884039+0000","last_change":"2024-04-25T12:21:53.163846+0000","last_active":"2024-04-25T12:22:34.884039+0000","last_peered":"2024-04-25T12:22:34.884039+0000","last_clean":"2024-04-25T12:22:34.884039+0000","last_became_active":"2024-04-25T12:21:53.163565+0000","last_became_peered":"2024-04-25T12:21:53.163565+0000","last_unstale":"2024-04-25T12:22:34.884039+0000","last_undegraded":"2024-04-25T12:22:34.884039+0000","last_fullsized":"2024-04-25T12:22:34.884039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:22.297830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916263+0000","last_change":"2024-04-25T12:21:58.250582+0000","last_active":"2024-04-25T12:22:34.916263+0000","last_peered":"2024-04-25T12:22:34.916263+0000","last_clean":"2024-04-25T12:22:34.916263+0000","last_became_active":"2024-04-25T12:21:58.250136+0000","last_became_peered":"2024-04-25T12:21:58.250136+0000","last_unstale":"2024-04-25T12:22:34.916263+0000","last_undegraded":"2024-04-25T12:22:34.916263+0000","last_fullsized":"2024-04-25T12:22:34.916263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:23.786586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030261+0000","last_change":"2024-04-25T12:21:54.200492+0000","last_active":"2024-04-25T12:22:35.030261+0000","last_peered":"2024-04-25T12:22:35.030261+0000","last_clean":"2024-04-25T12:22:35.030261+0000","last_became_active":"2024-04-25T12:21:54.200187+0000","last_became_peered":"2024-04-25T12:21:54.200187+0000","last_unstale":"2024-04-25T12:22:35.030261+0000","last_undegraded":"2024-04-25T12:22:35.030261+0000","last_fullsized":"2024-04-25T12:22:35.030261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:17.428348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029495+0000","last_change":"2024-04-25T12:21:53.186752+0000","last_active":"2024-04-25T12:22:35.029495+0000","last_peered":"2024-04-25T12:22:35.029495+0000","last_clean":"2024-04-25T12:22:35.029495+0000","last_became_active":"2024-04-25T12:21:53.184866+0000","last_became_peered":"2024-04-25T12:21:53.184866+0000","last_unstale":"2024-04-25T12:22:35.029495+0000","last_undegraded":"2024-04-25T12:22:35.029495+0000","last_fullsized":"2024-04-25T12:22:35.029495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:07.228743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980381+0000","last_change":"2024-04-25T12:21:58.344241+0000","last_active":"2024-04-25T12:22:34.980381+0000","last_peered":"2024-04-25T12:22:34.980381+0000","last_clean":"2024-04-25T12:22:34.980381+0000","last_became_active":"2024-04-25T12:21:58.343764+0000","last_became_peered":"2024-04-25T12:21:58.343764+0000","last_unstale":"2024-04-25T12:22:34.980381+0000","last_undegraded":"2024-04-25T12:22:34.980381+0000","last_fullsized":"2024-04-25T12:22:34.980381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:25.931918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890533+0000","last_change":"2024-04-25T12:21:54.216405+0000","last_active":"2024-04-25T12:22:34.890533+0000","last_peered":"2024-04-25T12:22:34.890533+0000","last_clean":"2024-04-25T12:22:34.890533+0000","last_became_active":"2024-04-25T12:21:54.215575+0000","last_became_peered":"2024-04-25T12:21:54.215575+0000","last_unstale":"2024-04-25T12:22:34.890533+0000","last_undegraded":"2024-04-25T12:22:34.890533+0000","last_fullsized":"2024-04-25T12:22:34.890533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:57.935295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887546+0000","last_change":"2024-04-25T12:21:53.198384+0000","last_active":"2024-04-25T12:22:34.887546+0000","last_peered":"2024-04-25T12:22:34.887546+0000","last_clean":"2024-04-25T12:22:34.887546+0000","last_became_active":"2024-04-25T12:21:53.197618+0000","last_became_peered":"2024-04-25T12:21:53.197618+0000","last_unstale":"2024-04-25T12:22:34.887546+0000","last_undegraded":"2024-04-25T12:22:34.887546+0000","last_fullsized":"2024-04-25T12:22:34.887546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:23.368197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979881+0000","last_change":"2024-04-25T12:21:58.342445+0000","last_active":"2024-04-25T12:22:34.979881+0000","last_peered":"2024-04-25T12:22:34.979881+0000","last_clean":"2024-04-25T12:22:34.979881+0000","last_became_active":"2024-04-25T12:21:58.341575+0000","last_became_peered":"2024-04-25T12:21:58.341575+0000","last_unstale":"2024-04-25T12:22:34.979881+0000","last_undegraded":"2024-04-25T12:22:34.979881+0000","last_fullsized":"2024-04-25T12:22:34.979881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:34.553686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915983+0000","last_change":"2024-04-25T12:21:54.200799+0000","last_active":"2024-04-25T12:22:34.915983+0000","last_peered":"2024-04-25T12:22:34.915983+0000","last_clean":"2024-04-25T12:22:34.915983+0000","last_became_active":"2024-04-25T12:21:54.200209+0000","last_became_peered":"2024-04-25T12:21:54.200209+0000","last_unstale":"2024-04-25T12:22:34.915983+0000","last_undegraded":"2024-04-25T12:22:34.915983+0000","last_fullsized":"2024-04-25T12:22:34.915983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:57.958942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916583+0000","last_change":"2024-04-25T12:21:53.168731+0000","last_active":"2024-04-25T12:22:34.916583+0000","last_peered":"2024-04-25T12:22:34.916583+0000","last_clean":"2024-04-25T12:22:34.916583+0000","last_became_active":"2024-04-25T12:21:53.168461+0000","last_became_peered":"2024-04-25T12:21:53.168461+0000","last_unstale":"2024-04-25T12:22:34.916583+0000","last_undegraded":"2024-04-25T12:22:34.916583+0000","last_fullsized":"2024-04-25T12:22:34.916583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:34.935857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887582+0000","last_change":"2024-04-25T12:21:58.344622+0000","last_active":"2024-04-25T12:22:34.887582+0000","last_peered":"2024-04-25T12:22:34.887582+0000","last_clean":"2024-04-25T12:22:34.887582+0000","last_became_active":"2024-04-25T12:21:58.343533+0000","last_became_peered":"2024-04-25T12:21:58.343533+0000","last_unstale":"2024-04-25T12:22:34.887582+0000","last_undegraded":"2024-04-25T12:22:34.887582+0000","last_fullsized":"2024-04-25T12:22:34.887582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:35.536857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891003+0000","last_change":"2024-04-25T12:21:54.216903+0000","last_active":"2024-04-25T12:22:34.891003+0000","last_peered":"2024-04-25T12:22:34.891003+0000","last_clean":"2024-04-25T12:22:34.891003+0000","last_became_active":"2024-04-25T12:21:54.216312+0000","last_became_peered":"2024-04-25T12:21:54.216312+0000","last_unstale":"2024-04-25T12:22:34.891003+0000","last_undegraded":"2024-04-25T12:22:34.891003+0000","last_fullsized":"2024-04-25T12:22:34.891003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:12.963783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'10","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:11.327474+0000","last_change":"2024-04-25T12:21:53.179160+0000","last_active":"2024-04-25T12:24:11.327474+0000","last_peered":"2024-04-25T12:24:11.327474+0000","last_clean":"2024-04-25T12:24:11.327474+0000","last_became_active":"2024-04-25T12:21:53.177229+0000","last_became_peered":"2024-04-25T12:21:53.177229+0000","last_unstale":"2024-04-25T12:24:11.327474+0000","last_undegraded":"2024-04-25T12:24:11.327474+0000","last_fullsized":"2024-04-25T12:24:11.327474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:09.082459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293725+0000","last_change":"2024-04-25T12:21:58.245003+0000","last_active":"2024-04-25T12:22:35.293725+0000","last_peered":"2024-04-25T12:22:35.293725+0000","last_clean":"2024-04-25T12:22:35.293725+0000","last_became_active":"2024-04-25T12:21:58.244500+0000","last_became_peered":"2024-04-25T12:21:58.244500+0000","last_unstale":"2024-04-25T12:22:35.293725+0000","last_undegraded":"2024-04-25T12:22:35.293725+0000","last_fullsized":"2024-04-25T12:22:35.293725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:35.010344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.895285+0000","last_change":"2024-04-25T12:21:54.213845+0000","last_active":"2024-04-25T12:22:34.895285+0000","last_peered":"2024-04-25T12:22:34.895285+0000","last_clean":"2024-04-25T12:22:34.895285+0000","last_became_active":"2024-04-25T12:21:54.213413+0000","last_became_peered":"2024-04-25T12:21:54.213413+0000","last_unstale":"2024-04-25T12:22:34.895285+0000","last_undegraded":"2024-04-25T12:22:34.895285+0000","last_fullsized":"2024-04-25T12:22:34.895285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:59.864079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293155+0000","last_change":"2024-04-25T12:21:53.186487+0000","last_active":"2024-04-25T12:22:35.293155+0000","last_peered":"2024-04-25T12:22:35.293155+0000","last_clean":"2024-04-25T12:22:35.293155+0000","last_became_active":"2024-04-25T12:21:53.186227+0000","last_became_peered":"2024-04-25T12:21:53.186227+0000","last_unstale":"2024-04-25T12:22:35.293155+0000","last_undegraded":"2024-04-25T12:22:35.293155+0000","last_fullsized":"2024-04-25T12:22:35.293155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:20.317103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894312+0000","last_change":"2024-04-25T12:21:58.249806+0000","last_active":"2024-04-25T12:22:34.894312+0000","last_peered":"2024-04-25T12:22:34.894312+0000","last_clean":"2024-04-25T12:22:34.894312+0000","last_became_active":"2024-04-25T12:21:58.248841+0000","last_became_peered":"2024-04-25T12:21:58.248841+0000","last_unstale":"2024-04-25T12:22:34.894312+0000","last_undegraded":"2024-04-25T12:22:34.894312+0000","last_fullsized":"2024-04-25T12:22:34.894312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:18.448118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916576+0000","last_change":"2024-04-25T12:21:54.189948+0000","last_active":"2024-04-25T12:22:34.916576+0000","last_peered":"2024-04-25T12:22:34.916576+0000","last_clean":"2024-04-25T12:22:34.916576+0000","last_became_active":"2024-04-25T12:21:54.189097+0000","last_became_peered":"2024-04-25T12:21:54.189097+0000","last_unstale":"2024-04-25T12:22:34.916576+0000","last_undegraded":"2024-04-25T12:22:34.916576+0000","last_fullsized":"2024-04-25T12:22:34.916576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:09.029536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.888984+0000","last_change":"2024-04-25T12:21:53.206472+0000","last_active":"2024-04-25T12:22:34.888984+0000","last_peered":"2024-04-25T12:22:34.888984+0000","last_clean":"2024-04-25T12:22:34.888984+0000","last_became_active":"2024-04-25T12:21:53.205742+0000","last_became_peered":"2024-04-25T12:21:53.205742+0000","last_unstale":"2024-04-25T12:22:34.888984+0000","last_undegraded":"2024-04-25T12:22:34.888984+0000","last_fullsized":"2024-04-25T12:22:34.888984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:37.444336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978676+0000","last_change":"2024-04-25T12:21:58.261490+0000","last_active":"2024-04-25T12:22:34.978676+0000","last_peered":"2024-04-25T12:22:34.978676+0000","last_clean":"2024-04-25T12:22:34.978676+0000","last_became_active":"2024-04-25T12:21:58.260979+0000","last_became_peered":"2024-04-25T12:21:58.260979+0000","last_unstale":"2024-04-25T12:22:34.978676+0000","last_undegraded":"2024-04-25T12:22:34.978676+0000","last_fullsized":"2024-04-25T12:22:34.978676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:51.396618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890271+0000","last_change":"2024-04-25T12:22:34.890271+0000","last_active":"2024-04-25T12:22:34.890271+0000","last_peered":"2024-04-25T12:22:34.890271+0000","last_clean":"2024-04-25T12:22:34.890271+0000","last_became_active":"2024-04-25T12:22:34.889562+0000","last_became_peered":"2024-04-25T12:22:34.889562+0000","last_unstale":"2024-04-25T12:22:34.890271+0000","last_undegraded":"2024-04-25T12:22:34.890271+0000","last_fullsized":"2024-04-25T12:22:34.890271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:17.476913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030693+0000","last_change":"2024-04-25T12:21:53.206850+0000","last_active":"2024-04-25T12:22:35.030693+0000","last_peered":"2024-04-25T12:22:35.030693+0000","last_clean":"2024-04-25T12:22:35.030693+0000","last_became_active":"2024-04-25T12:21:53.206274+0000","last_became_peered":"2024-04-25T12:21:53.206274+0000","last_unstale":"2024-04-25T12:22:35.030693+0000","last_undegraded":"2024-04-25T12:22:35.030693+0000","last_fullsized":"2024-04-25T12:22:35.030693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:25.867387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979375+0000","last_change":"2024-04-25T12:21:58.346593+0000","last_active":"2024-04-25T12:22:34.979375+0000","last_peered":"2024-04-25T12:22:34.979375+0000","last_clean":"2024-04-25T12:22:34.979375+0000","last_became_active":"2024-04-25T12:21:58.346195+0000","last_became_peered":"2024-04-25T12:21:58.346195+0000","last_unstale":"2024-04-25T12:22:34.979375+0000","last_undegraded":"2024-04-25T12:22:34.979375+0000","last_fullsized":"2024-04-25T12:22:34.979375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:47.745861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915960+0000","last_change":"2024-04-25T12:21:58.347908+0000","last_active":"2024-04-25T12:22:34.915960+0000","last_peered":"2024-04-25T12:22:34.915960+0000","last_clean":"2024-04-25T12:22:34.915960+0000","last_became_active":"2024-04-25T12:21:58.346887+0000","last_became_peered":"2024-04-25T12:21:58.346887+0000","last_unstale":"2024-04-25T12:22:34.915960+0000","last_undegraded":"2024-04-25T12:22:34.915960+0000","last_fullsized":"2024-04-25T12:22:34.915960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:06.228605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.291914+0000","last_change":"2024-04-25T12:21:54.203140+0000","last_active":"2024-04-25T12:22:35.291914+0000","last_peered":"2024-04-25T12:22:35.291914+0000","last_clean":"2024-04-25T12:22:35.291914+0000","last_became_active":"2024-04-25T12:21:54.202399+0000","last_became_peered":"2024-04-25T12:21:54.202399+0000","last_unstale":"2024-04-25T12:22:35.291914+0000","last_undegraded":"2024-04-25T12:22:35.291914+0000","last_fullsized":"2024-04-25T12:22:35.291914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:19.691760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.888025+0000","last_change":"2024-04-25T12:21:53.202038+0000","last_active":"2024-04-25T12:22:34.888025+0000","last_peered":"2024-04-25T12:22:34.888025+0000","last_clean":"2024-04-25T12:22:34.888025+0000","last_became_active":"2024-04-25T12:21:53.189592+0000","last_became_peered":"2024-04-25T12:21:53.189592+0000","last_unstale":"2024-04-25T12:22:34.888025+0000","last_undegraded":"2024-04-25T12:22:34.888025+0000","last_fullsized":"2024-04-25T12:22:34.888025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:38.052120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030482+0000","last_change":"2024-04-25T12:21:58.246247+0000","last_active":"2024-04-25T12:22:35.030482+0000","last_peered":"2024-04-25T12:22:35.030482+0000","last_clean":"2024-04-25T12:22:35.030482+0000","last_became_active":"2024-04-25T12:21:58.245085+0000","last_became_peered":"2024-04-25T12:21:58.245085+0000","last_unstale":"2024-04-25T12:22:35.030482+0000","last_undegraded":"2024-04-25T12:22:35.030482+0000","last_fullsized":"2024-04-25T12:22:35.030482+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:24.660921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978856+0000","last_change":"2024-04-25T12:21:54.207534+0000","last_active":"2024-04-25T12:22:34.978856+0000","last_peered":"2024-04-25T12:22:34.978856+0000","last_clean":"2024-04-25T12:22:34.978856+0000","last_became_active":"2024-04-25T12:21:54.206786+0000","last_became_peered":"2024-04-25T12:21:54.206786+0000","last_unstale":"2024-04-25T12:22:34.978856+0000","last_undegraded":"2024-04-25T12:22:34.978856+0000","last_fullsized":"2024-04-25T12:22:34.978856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:48.775827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979753+0000","last_change":"2024-04-25T12:21:53.190402+0000","last_active":"2024-04-25T12:22:34.979753+0000","last_peered":"2024-04-25T12:22:34.979753+0000","last_clean":"2024-04-25T12:22:34.979753+0000","last_became_active":"2024-04-25T12:21:53.189936+0000","last_became_peered":"2024-04-25T12:21:53.189936+0000","last_unstale":"2024-04-25T12:22:34.979753+0000","last_undegraded":"2024-04-25T12:22:34.979753+0000","last_fullsized":"2024-04-25T12:22:34.979753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:30.984588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029714+0000","last_change":"2024-04-25T12:21:53.186071+0000","last_active":"2024-04-25T12:22:35.029714+0000","last_peered":"2024-04-25T12:22:35.029714+0000","last_clean":"2024-04-25T12:22:35.029714+0000","last_became_active":"2024-04-25T12:21:53.185357+0000","last_became_peered":"2024-04-25T12:21:53.185357+0000","last_unstale":"2024-04-25T12:22:35.029714+0000","last_undegraded":"2024-04-25T12:22:35.029714+0000","last_fullsized":"2024-04-25T12:22:35.029714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:10.148702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916445+0000","last_change":"2024-04-25T12:21:54.205678+0000","last_active":"2024-04-25T12:22:34.916445+0000","last_peered":"2024-04-25T12:22:34.916445+0000","last_clean":"2024-04-25T12:22:34.916445+0000","last_became_active":"2024-04-25T12:21:54.205219+0000","last_became_peered":"2024-04-25T12:21:54.205219+0000","last_unstale":"2024-04-25T12:22:34.916445+0000","last_undegraded":"2024-04-25T12:22:34.916445+0000","last_fullsized":"2024-04-25T12:22:34.916445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:55.152284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884389+0000","last_change":"2024-04-25T12:21:58.257395+0000","last_active":"2024-04-25T12:22:34.884389+0000","last_peered":"2024-04-25T12:22:34.884389+0000","last_clean":"2024-04-25T12:22:34.884389+0000","last_became_active":"2024-04-25T12:21:58.256219+0000","last_became_peered":"2024-04-25T12:21:58.256219+0000","last_unstale":"2024-04-25T12:22:34.884389+0000","last_undegraded":"2024-04-25T12:22:34.884389+0000","last_fullsized":"2024-04-25T12:22:34.884389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:15.119967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979227+0000","last_change":"2024-04-25T12:21:53.194633+0000","last_active":"2024-04-25T12:22:34.979227+0000","last_peered":"2024-04-25T12:22:34.979227+0000","last_clean":"2024-04-25T12:22:34.979227+0000","last_became_active":"2024-04-25T12:21:53.194306+0000","last_became_peered":"2024-04-25T12:21:53.194306+0000","last_unstale":"2024-04-25T12:22:34.979227+0000","last_undegraded":"2024-04-25T12:22:34.979227+0000","last_fullsized":"2024-04-25T12:22:34.979227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:03.566639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894127+0000","last_change":"2024-04-25T12:21:54.201494+0000","last_active":"2024-04-25T12:22:34.894127+0000","last_peered":"2024-04-25T12:22:34.894127+0000","last_clean":"2024-04-25T12:22:34.894127+0000","last_became_active":"2024-04-25T12:21:54.196085+0000","last_became_peered":"2024-04-25T12:21:54.196085+0000","last_unstale":"2024-04-25T12:22:34.894127+0000","last_undegraded":"2024-04-25T12:22:34.894127+0000","last_fullsized":"2024-04-25T12:22:34.894127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:21.183608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979599+0000","last_change":"2024-04-25T12:21:58.261744+0000","last_active":"2024-04-25T12:22:34.979599+0000","last_peered":"2024-04-25T12:22:34.979599+0000","last_clean":"2024-04-25T12:22:34.979599+0000","last_became_active":"2024-04-25T12:21:58.260821+0000","last_became_peered":"2024-04-25T12:21:58.260821+0000","last_unstale":"2024-04-25T12:22:34.979599+0000","last_undegraded":"2024-04-25T12:22:34.979599+0000","last_fullsized":"2024-04-25T12:22:34.979599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:14.169485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029125+0000","last_change":"2024-04-25T12:21:54.201042+0000","last_active":"2024-04-25T12:22:35.029125+0000","last_peered":"2024-04-25T12:22:35.029125+0000","last_clean":"2024-04-25T12:22:35.029125+0000","last_became_active":"2024-04-25T12:21:54.200446+0000","last_became_peered":"2024-04-25T12:21:54.200446+0000","last_unstale":"2024-04-25T12:22:35.029125+0000","last_undegraded":"2024-04-25T12:22:35.029125+0000","last_fullsized":"2024-04-25T12:22:35.029125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:37.866196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884359+0000","last_change":"2024-04-25T12:21:54.188004+0000","last_active":"2024-04-25T12:22:34.884359+0000","last_peered":"2024-04-25T12:22:34.884359+0000","last_clean":"2024-04-25T12:22:34.884359+0000","last_became_active":"2024-04-25T12:21:54.187254+0000","last_became_peered":"2024-04-25T12:21:54.187254+0000","last_unstale":"2024-04-25T12:22:34.884359+0000","last_undegraded":"2024-04-25T12:22:34.884359+0000","last_fullsized":"2024-04-25T12:22:34.884359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:32.252676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887407+0000","last_change":"2024-04-25T12:21:54.206788+0000","last_active":"2024-04-25T12:22:34.887407+0000","last_peered":"2024-04-25T12:22:34.887407+0000","last_clean":"2024-04-25T12:22:34.887407+0000","last_became_active":"2024-04-25T12:21:54.204904+0000","last_became_peered":"2024-04-25T12:21:54.204904+0000","last_unstale":"2024-04-25T12:22:34.887407+0000","last_undegraded":"2024-04-25T12:22:34.887407+0000","last_fullsized":"2024-04-25T12:22:34.887407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:24.928840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916233+0000","last_change":"2024-04-25T12:21:54.204288+0000","last_active":"2024-04-25T12:22:34.916233+0000","last_peered":"2024-04-25T12:22:34.916233+0000","last_clean":"2024-04-25T12:22:34.916233+0000","last_became_active":"2024-04-25T12:21:54.203922+0000","last_became_peered":"2024-04-25T12:21:54.203922+0000","last_unstale":"2024-04-25T12:22:34.916233+0000","last_undegraded":"2024-04-25T12:22:34.916233+0000","last_fullsized":"2024-04-25T12:22:34.916233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:36.299452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980303+0000","last_change":"2024-04-25T12:21:54.208621+0000","last_active":"2024-04-25T12:22:34.980303+0000","last_peered":"2024-04-25T12:22:34.980303+0000","last_clean":"2024-04-25T12:22:34.980303+0000","last_became_active":"2024-04-25T12:21:54.206993+0000","last_became_peered":"2024-04-25T12:21:54.206993+0000","last_unstale":"2024-04-25T12:22:34.980303+0000","last_undegraded":"2024-04-25T12:22:34.980303+0000","last_fullsized":"2024-04-25T12:22:34.980303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:56:08.605883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292881+0000","last_change":"2024-04-25T12:21:54.202203+0000","last_active":"2024-04-25T12:22:35.292881+0000","last_peered":"2024-04-25T12:22:35.292881+0000","last_clean":"2024-04-25T12:22:35.292881+0000","last_became_active":"2024-04-25T12:21:54.201551+0000","last_became_peered":"2024-04-25T12:21:54.201551+0000","last_unstale":"2024-04-25T12:22:35.292881+0000","last_undegraded":"2024-04-25T12:22:35.292881+0000","last_fullsized":"2024-04-25T12:22:35.292881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:12.846584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030100+0000","last_change":"2024-04-25T12:21:54.220705+0000","last_active":"2024-04-25T12:22:35.030100+0000","last_peered":"2024-04-25T12:22:35.030100+0000","last_clean":"2024-04-25T12:22:35.030100+0000","last_became_active":"2024-04-25T12:21:54.220435+0000","last_became_peered":"2024-04-25T12:21:54.220435+0000","last_unstale":"2024-04-25T12:22:35.030100+0000","last_undegraded":"2024-04-25T12:22:35.030100+0000","last_fullsized":"2024-04-25T12:22:35.030100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:27.885210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980397+0000","last_change":"2024-04-25T12:21:54.206568+0000","last_active":"2024-04-25T12:22:34.980397+0000","last_peered":"2024-04-25T12:22:34.980397+0000","last_clean":"2024-04-25T12:22:34.980397+0000","last_became_active":"2024-04-25T12:21:54.204587+0000","last_became_peered":"2024-04-25T12:21:54.204587+0000","last_unstale":"2024-04-25T12:22:34.980397+0000","last_undegraded":"2024-04-25T12:22:34.980397+0000","last_fullsized":"2024-04-25T12:22:34.980397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:37.419230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.295869+0000","last_change":"2024-04-25T12:22:35.295869+0000","last_active":"2024-04-25T12:22:35.295869+0000","last_peered":"2024-04-25T12:22:35.295869+0000","last_clean":"2024-04-25T12:22:35.295869+0000","last_became_active":"2024-04-25T12:22:35.295116+0000","last_became_peered":"2024-04-25T12:22:35.295116+0000","last_unstale":"2024-04-25T12:22:35.295869+0000","last_undegraded":"2024-04-25T12:22:35.295869+0000","last_fullsized":"2024-04-25T12:22:35.295869+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:08.665587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979578+0000","last_change":"2024-04-25T12:21:54.203886+0000","last_active":"2024-04-25T12:22:34.979578+0000","last_peered":"2024-04-25T12:22:34.979578+0000","last_clean":"2024-04-25T12:22:34.979578+0000","last_became_active":"2024-04-25T12:21:54.203464+0000","last_became_peered":"2024-04-25T12:21:54.203464+0000","last_unstale":"2024-04-25T12:22:34.979578+0000","last_undegraded":"2024-04-25T12:22:34.979578+0000","last_fullsized":"2024-04-25T12:22:34.979578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:41.646353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887358+0000","last_change":"2024-04-25T12:21:54.213114+0000","last_active":"2024-04-25T12:22:34.887358+0000","last_peered":"2024-04-25T12:22:34.887358+0000","last_clean":"2024-04-25T12:22:34.887358+0000","last_became_active":"2024-04-25T12:21:54.212559+0000","last_became_peered":"2024-04-25T12:21:54.212559+0000","last_unstale":"2024-04-25T12:22:34.887358+0000","last_undegraded":"2024-04-25T12:22:34.887358+0000","last_fullsized":"2024-04-25T12:22:34.887358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:13.824789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915648+0000","last_change":"2024-04-25T12:21:54.215749+0000","last_active":"2024-04-25T12:22:34.915648+0000","last_peered":"2024-04-25T12:22:34.915648+0000","last_clean":"2024-04-25T12:22:34.915648+0000","last_became_active":"2024-04-25T12:21:54.215446+0000","last_became_peered":"2024-04-25T12:21:54.215446+0000","last_unstale":"2024-04-25T12:22:34.915648+0000","last_undegraded":"2024-04-25T12:22:34.915648+0000","last_fullsized":"2024-04-25T12:22:34.915648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:31.642141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029876+0000","last_change":"2024-04-25T12:21:54.210099+0000","last_active":"2024-04-25T12:22:35.029876+0000","last_peered":"2024-04-25T12:22:35.029876+0000","last_clean":"2024-04-25T12:22:35.029876+0000","last_became_active":"2024-04-25T12:21:54.209393+0000","last_became_peered":"2024-04-25T12:21:54.209393+0000","last_unstale":"2024-04-25T12:22:35.029876+0000","last_undegraded":"2024-04-25T12:22:35.029876+0000","last_fullsized":"2024-04-25T12:22:35.029876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:32.318047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891441+0000","last_change":"2024-04-25T12:21:54.216255+0000","last_active":"2024-04-25T12:22:34.891441+0000","last_peered":"2024-04-25T12:22:34.891441+0000","last_clean":"2024-04-25T12:22:34.891441+0000","last_became_active":"2024-04-25T12:21:54.211787+0000","last_became_peered":"2024-04-25T12:21:54.211787+0000","last_unstale":"2024-04-25T12:22:34.891441+0000","last_undegraded":"2024-04-25T12:22:34.891441+0000","last_fullsized":"2024-04-25T12:22:34.891441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:32.351790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.886612+0000","last_change":"2024-04-25T12:21:54.200503+0000","last_active":"2024-04-25T12:22:34.886612+0000","last_peered":"2024-04-25T12:22:34.886612+0000","last_clean":"2024-04-25T12:22:34.886612+0000","last_became_active":"2024-04-25T12:21:54.200123+0000","last_became_peered":"2024-04-25T12:21:54.200123+0000","last_unstale":"2024-04-25T12:22:34.886612+0000","last_undegraded":"2024-04-25T12:22:34.886612+0000","last_fullsized":"2024-04-25T12:22:34.886612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:04.504889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.889718+0000","last_change":"2024-04-25T12:21:54.220717+0000","last_active":"2024-04-25T12:22:34.889718+0000","last_peered":"2024-04-25T12:22:34.889718+0000","last_clean":"2024-04-25T12:22:34.889718+0000","last_became_active":"2024-04-25T12:21:54.220272+0000","last_became_peered":"2024-04-25T12:21:54.220272+0000","last_unstale":"2024-04-25T12:22:34.889718+0000","last_undegraded":"2024-04-25T12:22:34.889718+0000","last_fullsized":"2024-04-25T12:22:34.889718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:51.165297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.886279+0000","last_change":"2024-04-25T12:21:54.190288+0000","last_active":"2024-04-25T12:22:34.886279+0000","last_peered":"2024-04-25T12:22:34.886279+0000","last_clean":"2024-04-25T12:22:34.886279+0000","last_became_active":"2024-04-25T12:21:54.189535+0000","last_became_peered":"2024-04-25T12:21:54.189535+0000","last_unstale":"2024-04-25T12:22:34.886279+0000","last_undegraded":"2024-04-25T12:22:34.886279+0000","last_fullsized":"2024-04-25T12:22:34.886279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:03.757883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292136+0000","last_change":"2024-04-25T12:21:54.202898+0000","last_active":"2024-04-25T12:22:35.292136+0000","last_peered":"2024-04-25T12:22:35.292136+0000","last_clean":"2024-04-25T12:22:35.292136+0000","last_became_active":"2024-04-25T12:21:54.201641+0000","last_became_peered":"2024-04-25T12:21:54.201641+0000","last_unstale":"2024-04-25T12:22:35.292136+0000","last_undegraded":"2024-04-25T12:22:35.292136+0000","last_fullsized":"2024-04-25T12:22:35.292136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:42.865496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916388+0000","last_change":"2024-04-25T12:21:54.192818+0000","last_active":"2024-04-25T12:22:34.916388+0000","last_peered":"2024-04-25T12:22:34.916388+0000","last_clean":"2024-04-25T12:22:34.916388+0000","last_became_active":"2024-04-25T12:21:54.192052+0000","last_became_peered":"2024-04-25T12:21:54.192052+0000","last_unstale":"2024-04-25T12:22:34.916388+0000","last_undegraded":"2024-04-25T12:22:34.916388+0000","last_fullsized":"2024-04-25T12:22:34.916388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:26.048483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978815+0000","last_change":"2024-04-25T12:21:54.203798+0000","last_active":"2024-04-25T12:22:34.978815+0000","last_peered":"2024-04-25T12:22:34.978815+0000","last_clean":"2024-04-25T12:22:34.978815+0000","last_became_active":"2024-04-25T12:21:54.203472+0000","last_became_peered":"2024-04-25T12:21:54.203472+0000","last_unstale":"2024-04-25T12:22:34.978815+0000","last_undegraded":"2024-04-25T12:22:34.978815+0000","last_fullsized":"2024-04-25T12:22:34.978815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:19.958172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894317+0000","last_change":"2024-04-25T12:21:54.206055+0000","last_active":"2024-04-25T12:22:34.894317+0000","last_peered":"2024-04-25T12:22:34.894317+0000","last_clean":"2024-04-25T12:22:34.894317+0000","last_became_active":"2024-04-25T12:21:54.203030+0000","last_became_peered":"2024-04-25T12:21:54.203030+0000","last_unstale":"2024-04-25T12:22:34.894317+0000","last_undegraded":"2024-04-25T12:22:34.894317+0000","last_fullsized":"2024-04-25T12:22:34.894317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:58.836301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030468+0000","last_change":"2024-04-25T12:21:54.199660+0000","last_active":"2024-04-25T12:22:35.030468+0000","last_peered":"2024-04-25T12:22:35.030468+0000","last_clean":"2024-04-25T12:22:35.030468+0000","last_became_active":"2024-04-25T12:21:54.199362+0000","last_became_peered":"2024-04-25T12:21:54.199362+0000","last_unstale":"2024-04-25T12:22:35.030468+0000","last_undegraded":"2024-04-25T12:22:35.030468+0000","last_fullsized":"2024-04-25T12:22:35.030468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:57.706566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029976+0000","last_change":"2024-04-25T12:21:54.198710+0000","last_active":"2024-04-25T12:22:35.029976+0000","last_peered":"2024-04-25T12:22:35.029976+0000","last_clean":"2024-04-25T12:22:35.029976+0000","last_became_active":"2024-04-25T12:21:54.198432+0000","last_became_peered":"2024-04-25T12:21:54.198432+0000","last_unstale":"2024-04-25T12:22:35.029976+0000","last_undegraded":"2024-04-25T12:22:35.029976+0000","last_fullsized":"2024-04-25T12:22:35.029976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:33.124005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.892012+0000","last_change":"2024-04-25T12:21:54.218474+0000","last_active":"2024-04-25T12:22:34.892012+0000","last_peered":"2024-04-25T12:22:34.892012+0000","last_clean":"2024-04-25T12:22:34.892012+0000","last_became_active":"2024-04-25T12:21:54.216949+0000","last_became_peered":"2024-04-25T12:21:54.216949+0000","last_unstale":"2024-04-25T12:22:34.892012+0000","last_undegraded":"2024-04-25T12:22:34.892012+0000","last_fullsized":"2024-04-25T12:22:34.892012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:56.162843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978395+0000","last_change":"2024-04-25T12:21:54.200590+0000","last_active":"2024-04-25T12:22:34.978395+0000","last_peered":"2024-04-25T12:22:34.978395+0000","last_clean":"2024-04-25T12:22:34.978395+0000","last_became_active":"2024-04-25T12:21:54.200248+0000","last_became_peered":"2024-04-25T12:21:54.200248+0000","last_unstale":"2024-04-25T12:22:34.978395+0000","last_undegraded":"2024-04-25T12:22:34.978395+0000","last_fullsized":"2024-04-25T12:22:34.978395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:12.875315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890043+0000","last_change":"2024-04-25T12:21:54.197805+0000","last_active":"2024-04-25T12:22:34.890043+0000","last_peered":"2024-04-25T12:22:34.890043+0000","last_clean":"2024-04-25T12:22:34.890043+0000","last_became_active":"2024-04-25T12:21:54.197028+0000","last_became_peered":"2024-04-25T12:21:54.197028+0000","last_unstale":"2024-04-25T12:22:34.890043+0000","last_undegraded":"2024-04-25T12:22:34.890043+0000","last_fullsized":"2024-04-25T12:22:34.890043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:03.069305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887087+0000","last_change":"2024-04-25T12:21:54.190517+0000","last_active":"2024-04-25T12:22:34.887087+0000","last_peered":"2024-04-25T12:22:34.887087+0000","last_clean":"2024-04-25T12:22:34.887087+0000","last_became_active":"2024-04-25T12:21:54.189711+0000","last_became_peered":"2024-04-25T12:21:54.189711+0000","last_unstale":"2024-04-25T12:22:34.887087+0000","last_undegraded":"2024-04-25T12:22:34.887087+0000","last_fullsized":"2024-04-25T12:22:34.887087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:17.879060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890186+0000","last_change":"2024-04-25T12:21:54.197205+0000","last_active":"2024-04-25T12:22:34.890186+0000","last_peered":"2024-04-25T12:22:34.890186+0000","last_clean":"2024-04-25T12:22:34.890186+0000","last_became_active":"2024-04-25T12:21:54.196933+0000","last_became_peered":"2024-04-25T12:21:54.196933+0000","last_unstale":"2024-04-25T12:22:34.890186+0000","last_undegraded":"2024-04-25T12:22:34.890186+0000","last_fullsized":"2024-04-25T12:22:34.890186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:32.003058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887450+0000","last_change":"2024-04-25T12:21:54.207709+0000","last_active":"2024-04-25T12:22:34.887450+0000","last_peered":"2024-04-25T12:22:34.887450+0000","last_clean":"2024-04-25T12:22:34.887450+0000","last_became_active":"2024-04-25T12:21:54.207027+0000","last_became_peered":"2024-04-25T12:21:54.207027+0000","last_unstale":"2024-04-25T12:22:34.887450+0000","last_undegraded":"2024-04-25T12:22:34.887450+0000","last_fullsized":"2024-04-25T12:22:34.887450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:15.116440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915838+0000","last_change":"2024-04-25T12:21:54.185338+0000","last_active":"2024-04-25T12:22:34.915838+0000","last_peered":"2024-04-25T12:22:34.915838+0000","last_clean":"2024-04-25T12:22:34.915838+0000","last_became_active":"2024-04-25T12:21:54.184502+0000","last_became_peered":"2024-04-25T12:21:54.184502+0000","last_unstale":"2024-04-25T12:22:34.915838+0000","last_undegraded":"2024-04-25T12:22:34.915838+0000","last_fullsized":"2024-04-25T12:22:34.915838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:29.865959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292679+0000","last_change":"2024-04-25T12:21:54.183773+0000","last_active":"2024-04-25T12:22:35.292679+0000","last_peered":"2024-04-25T12:22:35.292679+0000","last_clean":"2024-04-25T12:22:35.292679+0000","last_became_active":"2024-04-25T12:21:54.182924+0000","last_became_peered":"2024-04-25T12:21:54.182924+0000","last_unstale":"2024-04-25T12:22:35.292679+0000","last_undegraded":"2024-04-25T12:22:35.292679+0000","last_fullsized":"2024-04-25T12:22:35.292679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:22.046777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891694+0000","last_change":"2024-04-25T12:21:54.210631+0000","last_active":"2024-04-25T12:22:34.891694+0000","last_peered":"2024-04-25T12:22:34.891694+0000","last_clean":"2024-04-25T12:22:34.891694+0000","last_became_active":"2024-04-25T12:21:54.210333+0000","last_became_peered":"2024-04-25T12:21:54.210333+0000","last_unstale":"2024-04-25T12:22:34.891694+0000","last_undegraded":"2024-04-25T12:22:34.891694+0000","last_fullsized":"2024-04-25T12:22:34.891694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:39.783406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476771,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":888832,"data_stored":710770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476772,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":123662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476771,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":119910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476770,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":119946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542180,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":303104,"data_stored":123662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542181,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":290816,"data_stored":119820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542180,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":119980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542180,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":897024,"data_stored":710826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:24:27.705 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T12:24:27.705 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T12:24:27.705 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T12:24:27.705 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T12:24:27.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.850+0000 7fe643dd3640 1 Processor -- start 2024-04-25T12:24:27.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.850+0000 7fe643dd3640 1 -- start start 2024-04-25T12:24:27.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.850+0000 7fe643dd3640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe63c0c4b40 0x7fe63c0c5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:27.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.850+0000 7fe643dd3640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe63c0c5cc0 0x7fe63c161eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:27.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.850+0000 7fe643dd3640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe63c0c6130 con 0x7fe63c0c8800 2024-04-25T12:24:27.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.850+0000 7fe643dd3640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fe63c158090 con 0x7fe63c0c4b40 2024-04-25T12:24:27.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.850+0000 7fe643dd3640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe63c1585c0 con 0x7fe63c0c5cc0 2024-04-25T12:24:27.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.850+0000 7fe641b6f640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe63c0c8800 0x7fe63c0c39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39368/0 (socket says 172.21.15.94:39368) 2024-04-25T12:24:27.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.850+0000 7fe641b6f640 1 -- 172.21.15.94:0/3570903766 learned_addr learned my addr 172.21.15.94:0/3570903766 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:27.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.850+0000 7fe64136e640 1 --2- 172.21.15.94:0/3570903766 >> v2:172.21.15.111:3300/0 conn(0x7fe63c0c4b40 0x7fe63c0c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:27.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.850+0000 7fe642370640 1 --2- 172.21.15.94:0/3570903766 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe63c0c5cc0 0x7fe63c161eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:27.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.850+0000 7fe640b6d640 1 -- 172.21.15.94:0/3570903766 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1350272500 0 0) 0x7fe63c0c6130 con 0x7fe63c0c8800 2024-04-25T12:24:27.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.850+0000 7fe640b6d640 1 -- 172.21.15.94:0/3570903766 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe628003530 con 0x7fe63c0c8800 2024-04-25T12:24:27.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe640b6d640 1 -- 172.21.15.94:0/3570903766 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2709392778 0 0) 0x7fe628003530 con 0x7fe63c0c8800 2024-04-25T12:24:27.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe640b6d640 1 -- 172.21.15.94:0/3570903766 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe63c0c5cc0 msgr2=0x7fe63c161eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:27.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe640b6d640 1 --2- 172.21.15.94:0/3570903766 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe63c0c5cc0 0x7fe63c161eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:27.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe640b6d640 1 -- 172.21.15.94:0/3570903766 >> v2:172.21.15.111:3300/0 conn(0x7fe63c0c4b40 msgr2=0x7fe63c0c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:27.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe640b6d640 1 --2- 172.21.15.94:0/3570903766 >> v2:172.21.15.111:3300/0 conn(0x7fe63c0c4b40 0x7fe63c0c5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:27.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe640b6d640 1 -- 172.21.15.94:0/3570903766 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe63c0c8be0 con 0x7fe63c0c8800 2024-04-25T12:24:27.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe640b6d640 1 -- 172.21.15.94:0/3570903766 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7fe638001680 con 0x7fe63c0c8800 2024-04-25T12:24:27.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe640b6d640 1 -- 172.21.15.94:0/3570903766 >> v1:172.21.15.94:6789/0 conn(0x7fe63c0c8800 legacy=0x7fe63c0c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:27.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe640b6d640 1 --2- 172.21.15.94:0/3570903766 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6280039c0 0x7fe628003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:27.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe640b6d640 1 --2- 172.21.15.94:0/3570903766 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe628004810 0x7fe628004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:27.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe640b6d640 1 --2- 172.21.15.94:0/3570903766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6280051d0 0x7fe62800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:27.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe640b6d640 1 -- 172.21.15.94:0/3570903766 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c158090 con 0x7fe6280051d0 2024-04-25T12:24:27.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe640b6d640 1 -- 172.21.15.94:0/3570903766 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c1585c0 con 0x7fe6280039c0 2024-04-25T12:24:27.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe640b6d640 1 -- 172.21.15.94:0/3570903766 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe62800bff0 con 0x7fe628004810 2024-04-25T12:24:27.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe642370640 1 --2- 172.21.15.94:0/3570903766 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe63c0c5cc0 0x7fe63c161eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:24:27.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe642370640 1 --2- 172.21.15.94:0/3570903766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6280051d0 0x7fe62800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:27.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe64136e640 1 --2- 172.21.15.94:0/3570903766 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe628004810 0x7fe628004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:27.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe641b6f640 1 --2- 172.21.15.94:0/3570903766 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6280039c0 0x7fe628003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:27.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe642370640 1 -- 172.21.15.94:0/3570903766 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe628004810 msgr2=0x7fe628004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:27.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe642370640 1 --2- 172.21.15.94:0/3570903766 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe628004810 0x7fe628004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:27.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe642370640 1 -- 172.21.15.94:0/3570903766 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6280039c0 msgr2=0x7fe628003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:27.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe642370640 1 --2- 172.21.15.94:0/3570903766 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6280039c0 0x7fe628003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:27.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe642370640 1 -- 172.21.15.94:0/3570903766 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe628003530 con 0x7fe6280051d0 2024-04-25T12:24:27.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe642370640 1 --2- 172.21.15.94:0/3570903766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6280051d0 0x7fe62800b9d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe63c0c60a0 tx=0x7fe63401cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8552c855e6afff4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:27.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe640b6d640 1 -- 172.21.15.94:0/3570903766 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe634009d40 con 0x7fe6280051d0 2024-04-25T12:24:27.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe640b6d640 1 -- 172.21.15.94:0/3570903766 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6340a5cf0 con 0x7fe6280051d0 2024-04-25T12:24:27.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe640b6d640 1 -- 172.21.15.94:0/3570903766 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe634003bc0 con 0x7fe6280051d0 2024-04-25T12:24:27.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe643dd3640 1 -- 172.21.15.94:0/3570903766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6280051d0 msgr2=0x7fe62800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:27.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe643dd3640 1 --2- 172.21.15.94:0/3570903766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6280051d0 0x7fe62800b9d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe63c0c60a0 tx=0x7fe63401cd20 comp rx=0 tx=0).stop 2024-04-25T12:24:27.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe642370640 1 -- 172.21.15.94:0/3570903766 reap_dead start 2024-04-25T12:24:27.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe643dd3640 1 -- 172.21.15.94:0/3570903766 shutdown_connections 2024-04-25T12:24:27.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe643dd3640 1 -- 172.21.15.94:0/3570903766 >> 172.21.15.94:0/3570903766 conn(0x7fe63c06b9d0 msgr2=0x7fe63c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:27.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe643dd3640 1 -- 172.21.15.94:0/3570903766 shutdown_connections 2024-04-25T12:24:27.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.854+0000 7fe643dd3640 1 -- 172.21.15.94:0/3570903766 wait complete. 2024-04-25T12:24:27.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe643dd3640 1 Processor -- start 2024-04-25T12:24:27.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe643dd3640 1 -- start start 2024-04-25T12:24:27.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe643dd3640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe63c15f520 0x7fe63c15f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:27.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe643dd3640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe63c1552e0 0x7fe63c14a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:27.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe643dd3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe63c14adc0 0x7fe63c1439c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:27.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe643dd3640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c074280 con 0x7fe63c14adc0 2024-04-25T12:24:27.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe643dd3640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c0c52f0 con 0x7fe63c15f520 2024-04-25T12:24:27.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe643dd3640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe63c068610 con 0x7fe63c1552e0 2024-04-25T12:24:27.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe642370640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe63c14adc0 0x7fe63c1439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:27.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe642370640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe63c14adc0 0x7fe63c1439c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52192/0 (socket says 172.21.15.94:52192) 2024-04-25T12:24:27.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe642370640 1 -- 172.21.15.94:0/1172960691 learned_addr learned my addr 172.21.15.94:0/1172960691 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:27.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe641b6f640 1 --2- 172.21.15.94:0/1172960691 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe63c15f520 0x7fe63c15f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:27.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe64136e640 1 --2- 172.21.15.94:0/1172960691 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe63c1552e0 0x7fe63c14a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:27.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe642370640 1 -- 172.21.15.94:0/1172960691 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe63c1552e0 msgr2=0x7fe63c14a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:27.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe642370640 1 --2- 172.21.15.94:0/1172960691 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe63c1552e0 0x7fe63c14a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:27.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe642370640 1 -- 172.21.15.94:0/1172960691 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe63c15f520 msgr2=0x7fe63c15f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:27.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe642370640 1 --2- 172.21.15.94:0/1172960691 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe63c15f520 0x7fe63c15f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:27.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe642370640 1 -- 172.21.15.94:0/1172960691 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe63c0c8430 con 0x7fe63c14adc0 2024-04-25T12:24:27.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe642370640 1 --2- 172.21.15.94:0/1172960691 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe63c14adc0 0x7fe63c1439c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe63401d5c0 tx=0x7fe634009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:27.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe6327fc640 1 -- 172.21.15.94:0/1172960691 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe634009d40 con 0x7fe63c14adc0 2024-04-25T12:24:27.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe6327fc640 1 -- 172.21.15.94:0/1172960691 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6340a5af0 con 0x7fe63c14adc0 2024-04-25T12:24:27.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe643dd3640 1 -- 172.21.15.94:0/1172960691 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe63c143680 con 0x7fe63c14adc0 2024-04-25T12:24:27.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe6327fc640 1 -- 172.21.15.94:0/1172960691 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6340042d0 con 0x7fe63c14adc0 2024-04-25T12:24:27.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe643dd3640 1 -- 172.21.15.94:0/1172960691 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe63c1430c0 con 0x7fe63c14adc0 2024-04-25T12:24:27.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe643dd3640 1 -- 172.21.15.94:0/1172960691 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe63c075df0 con 0x7fe63c14adc0 2024-04-25T12:24:27.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe6327fc640 1 -- 172.21.15.94:0/1172960691 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe6340c0020 con 0x7fe63c14adc0 2024-04-25T12:24:27.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe6327fc640 1 --2- 172.21.15.94:0/1172960691 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe6200683b0 0x7fe62006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:27.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe6327fc640 1 -- 172.21.15.94:0/1172960691 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fe634121870 con 0x7fe63c14adc0 2024-04-25T12:24:27.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.858+0000 7fe641b6f640 1 --2- 172.21.15.94:0/1172960691 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe6200683b0 0x7fe62006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:27.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.862+0000 7fe641b6f640 1 --2- 172.21.15.94:0/1172960691 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe6200683b0 0x7fe62006a870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe638000c10 tx=0x7fe638009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:27.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:27.862+0000 7fe6327fc640 1 -- 172.21.15.94:0/1172960691 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe634016a30 con 0x7fe63c14adc0 2024-04-25T12:24:28.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:28.050+0000 7fe643dd3640 1 -- 172.21.15.94:0/1172960691 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe63c1f7b10 con 0x7fe63c14adc0 2024-04-25T12:24:28.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:28.050+0000 7fe6327fc640 1 -- 172.21.15.94:0/1172960691 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7fe6340f1ad0 con 0x7fe63c14adc0 2024-04-25T12:24:28.057 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:28.057 INFO:teuthology.orchestra.run.smithi094.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-25T12:24:28.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:28.054+0000 7fe643dd3640 1 -- 172.21.15.94:0/1172960691 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe6200683b0 msgr2=0x7fe62006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:28.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:28.054+0000 7fe643dd3640 1 --2- 172.21.15.94:0/1172960691 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe6200683b0 0x7fe62006a870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe638000c10 tx=0x7fe638009040 comp rx=0 tx=0).stop 2024-04-25T12:24:28.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:28.054+0000 7fe643dd3640 1 -- 172.21.15.94:0/1172960691 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe63c14adc0 msgr2=0x7fe63c1439c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:28.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:28.054+0000 7fe643dd3640 1 --2- 172.21.15.94:0/1172960691 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe63c14adc0 0x7fe63c1439c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe63401d5c0 tx=0x7fe634009750 comp rx=0 tx=0).stop 2024-04-25T12:24:28.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:28.054+0000 7fe643dd3640 1 -- 172.21.15.94:0/1172960691 shutdown_connections 2024-04-25T12:24:28.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:28.054+0000 7fe643dd3640 1 --2- 172.21.15.94:0/1172960691 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe6200683b0 0x7fe62006a870 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:28.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:28.054+0000 7fe643dd3640 1 --2- 172.21.15.94:0/1172960691 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe63c1552e0 0x7fe63c14a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:28.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:28.054+0000 7fe643dd3640 1 --2- 172.21.15.94:0/1172960691 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe63c14adc0 0x7fe63c1439c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:28.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:28.054+0000 7fe643dd3640 1 --2- 172.21.15.94:0/1172960691 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe63c15f520 0x7fe63c15f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:28.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:28.054+0000 7fe643dd3640 1 -- 172.21.15.94:0/1172960691 >> 172.21.15.94:0/1172960691 conn(0x7fe63c06b9d0 msgr2=0x7fe63c149390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:28.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:28.054+0000 7fe643dd3640 1 -- 172.21.15.94:0/1172960691 shutdown_connections 2024-04-25T12:24:28.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:28.054+0000 7fe643dd3640 1 -- 172.21.15.94:0/1172960691 wait complete. 2024-04-25T12:24:28.060 INFO:tasks.ceph.mds.b.smithi111.stderr:2024-04-25T12:24:28.056+0000 7fc186a0f640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-25T12:24:31.074 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T12:24:31.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.198+0000 7fb291f38640 1 Processor -- start 2024-04-25T12:24:31.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.198+0000 7fb291f38640 1 -- start start 2024-04-25T12:24:31.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.202+0000 7fb291f38640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb28c155300 0x7fb28c0c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:31.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.202+0000 7fb291f38640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb28c0c4e80 con 0x7fb28c15ee20 2024-04-25T12:24:31.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.202+0000 7fb291f38640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb28c15f320 con 0x7fb28c06f700 2024-04-25T12:24:31.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.202+0000 7fb291f38640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fb28c0c4230 con 0x7fb28c155300 2024-04-25T12:24:31.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.202+0000 7fb28b7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb28c155300 0x7fb28c0c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:31.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.202+0000 7fb28b7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb28c155300 0x7fb28c0c3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52198/0 (socket says 172.21.15.94:52198) 2024-04-25T12:24:31.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.202+0000 7fb28bfff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fb28c15ee20 0x7fb28c0c6f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39384/0 (socket says 172.21.15.94:39384) 2024-04-25T12:24:31.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.202+0000 7fb28b7fe640 1 -- 172.21.15.94:0/2355657266 learned_addr learned my addr 172.21.15.94:0/2355657266 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:31.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.202+0000 7fb28b7fe640 1 -- 172.21.15.94:0/2355657266 >> v1:172.21.15.111:6789/0 conn(0x7fb28c06f700 legacy=0x7fb28c15e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:31.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.202+0000 7fb28b7fe640 1 -- 172.21.15.94:0/2355657266 >> v1:172.21.15.94:6789/0 conn(0x7fb28c15ee20 legacy=0x7fb28c0c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:31.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.202+0000 7fb28b7fe640 1 -- 172.21.15.94:0/2355657266 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28c0c5120 con 0x7fb28c155300 2024-04-25T12:24:31.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.202+0000 7fb28a7fc640 1 -- 172.21.15.94:0/2355657266 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1486643685 0 0) 0x7fb28c0c4e80 con 0x7fb28c15ee20 2024-04-25T12:24:31.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.202+0000 7fb28b7fe640 1 --2- 172.21.15.94:0/2355657266 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb28c155300 0x7fb28c0c3cf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb27c009870 tx=0x7fb27c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372398f7a791db8c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:31.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.202+0000 7fb28a7fc640 1 -- 172.21.15.94:0/2355657266 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c0b0070 con 0x7fb28c155300 2024-04-25T12:24:31.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.202+0000 7fb28a7fc640 1 -- 172.21.15.94:0/2355657266 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb27c0ab600 con 0x7fb28c155300 2024-04-25T12:24:31.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.202+0000 7fb28a7fc640 1 -- 172.21.15.94:0/2355657266 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c0ab9d0 con 0x7fb28c155300 2024-04-25T12:24:31.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.202+0000 7fb291f38640 1 -- 172.21.15.94:0/2355657266 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb28c155300 msgr2=0x7fb28c0c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:31.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.202+0000 7fb291f38640 1 --2- 172.21.15.94:0/2355657266 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb28c155300 0x7fb28c0c3cf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb27c009870 tx=0x7fb27c01c520 comp rx=0 tx=0).stop 2024-04-25T12:24:31.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.202+0000 7fb291f38640 1 -- 172.21.15.94:0/2355657266 shutdown_connections 2024-04-25T12:24:31.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.202+0000 7fb291f38640 1 --2- 172.21.15.94:0/2355657266 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb28c155300 0x7fb28c0c3cf0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:31.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.202+0000 7fb291f38640 1 -- 172.21.15.94:0/2355657266 >> 172.21.15.94:0/2355657266 conn(0x7fb28c06b9d0 msgr2=0x7fb28c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:31.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.202+0000 7fb291f38640 1 -- 172.21.15.94:0/2355657266 shutdown_connections 2024-04-25T12:24:31.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.202+0000 7fb291f38640 1 -- 172.21.15.94:0/2355657266 wait complete. 2024-04-25T12:24:31.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.206+0000 7fb291f38640 1 Processor -- start 2024-04-25T12:24:31.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.206+0000 7fb291f38640 1 -- start start 2024-04-25T12:24:31.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.206+0000 7fb291f38640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb28c06f700 0x7fb28c155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:31.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.206+0000 7fb291f38640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb28c155300 0x7fb28c1561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:31.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.206+0000 7fb291f38640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb28c15ee20 0x7fb28c0724d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:31.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.206+0000 7fb291f38640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb28c155860 con 0x7fb28c15ee20 2024-04-25T12:24:31.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.206+0000 7fb291f38640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb28c1556e0 con 0x7fb28c155300 2024-04-25T12:24:31.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.206+0000 7fb291f38640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fb28c1696e0 con 0x7fb28c06f700 2024-04-25T12:24:31.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.206+0000 7fb28bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb28c15ee20 0x7fb28c0724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:31.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.206+0000 7fb28bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb28c15ee20 0x7fb28c0724d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52208/0 (socket says 172.21.15.94:52208) 2024-04-25T12:24:31.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.206+0000 7fb28b7fe640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb28c06f700 0x7fb28c155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:31.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.206+0000 7fb28affd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb28c155300 0x7fb28c1561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:31.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.206+0000 7fb28bfff640 1 -- 172.21.15.94:0/4082254465 learned_addr learned my addr 172.21.15.94:0/4082254465 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:31.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.206+0000 7fb28bfff640 1 -- 172.21.15.94:0/4082254465 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb28c06f700 msgr2=0x7fb28c155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:31.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.206+0000 7fb28bfff640 1 --2- 172.21.15.94:0/4082254465 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb28c06f700 0x7fb28c155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:31.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.206+0000 7fb28bfff640 1 -- 172.21.15.94:0/4082254465 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb28c155300 msgr2=0x7fb28c1561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:31.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.206+0000 7fb28bfff640 1 --2- 172.21.15.94:0/4082254465 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb28c155300 0x7fb28c1561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:31.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.206+0000 7fb28bfff640 1 -- 172.21.15.94:0/4082254465 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28c158ea0 con 0x7fb28c15ee20 2024-04-25T12:24:31.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.206+0000 7fb28b7fe640 1 --2- 172.21.15.94:0/4082254465 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb28c06f700 0x7fb28c155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:24:31.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.206+0000 7fb28bfff640 1 --2- 172.21.15.94:0/4082254465 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb28c15ee20 0x7fb28c0724d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb28400c780 tx=0x7fb28400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:31.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.206+0000 7fb273fff640 1 -- 172.21.15.94:0/4082254465 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb284018070 con 0x7fb28c15ee20 2024-04-25T12:24:31.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.206+0000 7fb273fff640 1 -- 172.21.15.94:0/4082254465 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb28400a640 con 0x7fb28c15ee20 2024-04-25T12:24:31.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.206+0000 7fb291f38640 1 -- 172.21.15.94:0/4082254465 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb28c1f8d30 con 0x7fb28c15ee20 2024-04-25T12:24:31.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.206+0000 7fb273fff640 1 -- 172.21.15.94:0/4082254465 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28400aa70 con 0x7fb28c15ee20 2024-04-25T12:24:31.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.206+0000 7fb291f38640 1 -- 172.21.15.94:0/4082254465 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb28c0719f0 con 0x7fb28c15ee20 2024-04-25T12:24:31.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.206+0000 7fb291f38640 1 -- 172.21.15.94:0/4082254465 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb28c075df0 con 0x7fb28c15ee20 2024-04-25T12:24:31.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.210+0000 7fb273fff640 1 -- 172.21.15.94:0/4082254465 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb28401b070 con 0x7fb28c15ee20 2024-04-25T12:24:31.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.210+0000 7fb273fff640 1 --2- 172.21.15.94:0/4082254465 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fb278068380 0x7fb27806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:31.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.210+0000 7fb28b7fe640 1 --2- 172.21.15.94:0/4082254465 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fb278068380 0x7fb27806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:31.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.210+0000 7fb273fff640 1 -- 172.21.15.94:0/4082254465 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fb284086290 con 0x7fb28c15ee20 2024-04-25T12:24:31.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.210+0000 7fb28b7fe640 1 --2- 172.21.15.94:0/4082254465 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fb278068380 0x7fb27806a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb27c0ad000 tx=0x7fb27c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:31.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.214+0000 7fb273fff640 1 -- 172.21.15.94:0/4082254465 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb284055e10 con 0x7fb28c15ee20 2024-04-25T12:24:31.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.410+0000 7fb291f38640 1 -- 172.21.15.94:0/4082254465 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb28c0c5c50 con 0x7fb28c15ee20 2024-04-25T12:24:31.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.410+0000 7fb273fff640 1 -- 172.21.15.94:0/4082254465 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7fb28405a110 con 0x7fb28c15ee20 2024-04-25T12:24:31.416 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:31.416 INFO:teuthology.orchestra.run.smithi094.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-25T12:24:31.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.414+0000 7fb291f38640 1 -- 172.21.15.94:0/4082254465 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fb278068380 msgr2=0x7fb27806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:31.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.414+0000 7fb291f38640 1 --2- 172.21.15.94:0/4082254465 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fb278068380 0x7fb27806a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb27c0ad000 tx=0x7fb27c0a6000 comp rx=0 tx=0).stop 2024-04-25T12:24:31.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.414+0000 7fb291f38640 1 -- 172.21.15.94:0/4082254465 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb28c15ee20 msgr2=0x7fb28c0724d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:31.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.414+0000 7fb291f38640 1 --2- 172.21.15.94:0/4082254465 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb28c15ee20 0x7fb28c0724d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb28400c780 tx=0x7fb28400cc40 comp rx=0 tx=0).stop 2024-04-25T12:24:31.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.414+0000 7fb291f38640 1 -- 172.21.15.94:0/4082254465 shutdown_connections 2024-04-25T12:24:31.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.414+0000 7fb291f38640 1 --2- 172.21.15.94:0/4082254465 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fb278068380 0x7fb27806a840 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:31.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.414+0000 7fb291f38640 1 --2- 172.21.15.94:0/4082254465 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb28c15ee20 0x7fb28c0724d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:31.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.414+0000 7fb291f38640 1 --2- 172.21.15.94:0/4082254465 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb28c155300 0x7fb28c1561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:31.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.414+0000 7fb291f38640 1 --2- 172.21.15.94:0/4082254465 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb28c06f700 0x7fb28c155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:31.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.414+0000 7fb291f38640 1 -- 172.21.15.94:0/4082254465 >> 172.21.15.94:0/4082254465 conn(0x7fb28c06b9d0 msgr2=0x7fb28c1535a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:31.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.414+0000 7fb291f38640 1 -- 172.21.15.94:0/4082254465 shutdown_connections 2024-04-25T12:24:31.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:31.414+0000 7fb291f38640 1 -- 172.21.15.94:0/4082254465 wait complete. 2024-04-25T12:24:33.061 INFO:tasks.ceph.mds.b.smithi111.stderr:2024-04-25T12:24:33.056+0000 7fc186a0f640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-25T12:24:34.435 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T12:24:34.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.558+0000 7f2c4a176640 1 Processor -- start 2024-04-25T12:24:34.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.558+0000 7f2c4a176640 1 -- start start 2024-04-25T12:24:34.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.562+0000 7f2c4a176640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c4414ffa0 0x7f2c4406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:34.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.562+0000 7f2c4a176640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f2c44074100 0x7f2c440c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:34.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.562+0000 7f2c4a176640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c440c5d70 con 0x7f2c4414fbc0 2024-04-25T12:24:34.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.562+0000 7f2c4a176640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f2c440c6050 con 0x7f2c44074100 2024-04-25T12:24:34.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.562+0000 7f2c4a176640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2c440c6330 con 0x7f2c4414ffa0 2024-04-25T12:24:34.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.562+0000 7f2c3bfff640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c4414ffa0 0x7f2c4406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:34.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.562+0000 7f2c3bfff640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c4414ffa0 0x7f2c4406f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.94:50372/0 (socket says 172.21.15.94:50372) 2024-04-25T12:24:34.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.562+0000 7f2c3bfff640 1 -- 172.21.15.94:0/2665072555 learned_addr learned my addr 172.21.15.94:0/2665072555 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:34.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.562+0000 7f2c43fff640 1 --2- 172.21.15.94:0/2665072555 >> v2:172.21.15.111:3300/0 conn(0x7f2c44074100 0x7f2c440c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:34.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.562+0000 7f2c3bfff640 1 -- 172.21.15.94:0/2665072555 >> v2:172.21.15.111:3300/0 conn(0x7f2c44074100 msgr2=0x7f2c440c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:34.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.562+0000 7f2c3bfff640 1 --2- 172.21.15.94:0/2665072555 >> v2:172.21.15.111:3300/0 conn(0x7f2c44074100 0x7f2c440c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:34.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.562+0000 7f2c3bfff640 1 -- 172.21.15.94:0/2665072555 >> v1:172.21.15.111:6789/0 conn(0x7f2c4414fbc0 legacy=0x7f2c440c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:34.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.562+0000 7f2c3bfff640 1 -- 172.21.15.94:0/2665072555 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c440c6610 con 0x7f2c4414ffa0 2024-04-25T12:24:34.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.562+0000 7f2c3bfff640 1 --2- 172.21.15.94:0/2665072555 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c4414ffa0 0x7f2c4406f700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c009870 tx=0x7f2c2c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=727db248ea92a1c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:34.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c42ffd640 1 -- 172.21.15.94:0/2665072555 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c0a9640 con 0x7f2c4414ffa0 2024-04-25T12:24:34.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c42ffd640 1 -- 172.21.15.94:0/2665072555 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c2c0a97e0 con 0x7f2c4414ffa0 2024-04-25T12:24:34.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c42ffd640 1 -- 172.21.15.94:0/2665072555 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c0a9bb0 con 0x7f2c4414ffa0 2024-04-25T12:24:34.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c4a176640 1 -- 172.21.15.94:0/2665072555 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c4414ffa0 msgr2=0x7f2c4406f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:34.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c4a176640 1 --2- 172.21.15.94:0/2665072555 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c4414ffa0 0x7f2c4406f700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c009870 tx=0x7f2c2c01c560 comp rx=0 tx=0).stop 2024-04-25T12:24:34.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c4a176640 1 -- 172.21.15.94:0/2665072555 shutdown_connections 2024-04-25T12:24:34.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c4a176640 1 --2- 172.21.15.94:0/2665072555 >> v2:172.21.15.111:3300/0 conn(0x7f2c44074100 0x7f2c440c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:34.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c4a176640 1 --2- 172.21.15.94:0/2665072555 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c4414ffa0 0x7f2c4406f700 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:34.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c4a176640 1 -- 172.21.15.94:0/2665072555 >> 172.21.15.94:0/2665072555 conn(0x7f2c4406b9d0 msgr2=0x7f2c4406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:34.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c4a176640 1 -- 172.21.15.94:0/2665072555 shutdown_connections 2024-04-25T12:24:34.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c4a176640 1 -- 172.21.15.94:0/2665072555 wait complete. 2024-04-25T12:24:34.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c4a176640 1 Processor -- start 2024-04-25T12:24:34.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c4a176640 1 -- start start 2024-04-25T12:24:34.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c4a176640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c44074100 0x7f2c44142d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:34.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c4a176640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c4414fbc0 0x7f2c4414b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:34.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c4a176640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2c4414ffa0 0x7f2c4414b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:34.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c4a176640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2c440c8ab0 con 0x7f2c44074100 2024-04-25T12:24:34.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c4a176640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2c440c8930 con 0x7f2c4414ffa0 2024-04-25T12:24:34.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c4a176640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2c44166090 con 0x7f2c4414fbc0 2024-04-25T12:24:34.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c437fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c44074100 0x7f2c44142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:34.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c437fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c44074100 0x7f2c44142d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59418/0 (socket says 172.21.15.94:59418) 2024-04-25T12:24:34.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c437fe640 1 -- 172.21.15.94:0/2276941433 learned_addr learned my addr 172.21.15.94:0/2276941433 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:34.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c3bfff640 1 --2- 172.21.15.94:0/2276941433 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c4414fbc0 0x7f2c4414b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:34.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c43fff640 1 --2- 172.21.15.94:0/2276941433 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2c4414ffa0 0x7f2c4414b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:34.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c437fe640 1 -- 172.21.15.94:0/2276941433 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c4414fbc0 msgr2=0x7f2c4414b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:34.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c437fe640 1 --2- 172.21.15.94:0/2276941433 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c4414fbc0 0x7f2c4414b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:34.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c437fe640 1 -- 172.21.15.94:0/2276941433 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2c4414ffa0 msgr2=0x7f2c4414b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:34.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c437fe640 1 --2- 172.21.15.94:0/2276941433 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2c4414ffa0 0x7f2c4414b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:34.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c437fe640 1 -- 172.21.15.94:0/2276941433 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c441489f0 con 0x7f2c44074100 2024-04-25T12:24:34.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c437fe640 1 --2- 172.21.15.94:0/2276941433 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c44074100 0x7f2c44142d20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400c420 tx=0x7f2c3400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:34.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c40ff9640 1 -- 172.21.15.94:0/2276941433 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c340052d0 con 0x7f2c44074100 2024-04-25T12:24:34.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c40ff9640 1 -- 172.21.15.94:0/2276941433 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c34005470 con 0x7f2c44074100 2024-04-25T12:24:34.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c40ff9640 1 -- 172.21.15.94:0/2276941433 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c34007260 con 0x7f2c44074100 2024-04-25T12:24:34.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c4a176640 1 -- 172.21.15.94:0/2276941433 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c44148c90 con 0x7f2c44074100 2024-04-25T12:24:34.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.566+0000 7f2c4a176640 1 -- 172.21.15.94:0/2276941433 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c4414a6f0 con 0x7f2c44074100 2024-04-25T12:24:34.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.570+0000 7f2c4a176640 1 -- 172.21.15.94:0/2276941433 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c44075df0 con 0x7f2c44074100 2024-04-25T12:24:34.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.570+0000 7f2c40ff9640 1 -- 172.21.15.94:0/2276941433 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2c34007400 con 0x7f2c44074100 2024-04-25T12:24:34.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.570+0000 7f2c40ff9640 1 --2- 172.21.15.94:0/2276941433 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2c24068380 0x7f2c2406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:34.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.570+0000 7f2c3bfff640 1 --2- 172.21.15.94:0/2276941433 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2c24068380 0x7f2c2406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:34.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.570+0000 7f2c40ff9640 1 -- 172.21.15.94:0/2276941433 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f2c34086320 con 0x7f2c44074100 2024-04-25T12:24:34.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.570+0000 7f2c3bfff640 1 --2- 172.21.15.94:0/2276941433 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2c24068380 0x7f2c2406a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c0ae000 tx=0x7f2c2c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:34.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.574+0000 7f2c40ff9640 1 -- 172.21.15.94:0/2276941433 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2c34056470 con 0x7f2c44074100 2024-04-25T12:24:34.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.774+0000 7f2c4a176640 1 -- 172.21.15.94:0/2276941433 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2c44149c50 con 0x7f2c44074100 2024-04-25T12:24:34.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.774+0000 7f2c40ff9640 1 -- 172.21.15.94:0/2276941433 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f2c34055d70 con 0x7f2c44074100 2024-04-25T12:24:34.778 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:34.779 INFO:teuthology.orchestra.run.smithi094.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-25T12:24:34.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.774+0000 7f2c4a176640 1 -- 172.21.15.94:0/2276941433 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2c24068380 msgr2=0x7f2c2406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:34.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.774+0000 7f2c4a176640 1 --2- 172.21.15.94:0/2276941433 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2c24068380 0x7f2c2406a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c0ae000 tx=0x7f2c2c009040 comp rx=0 tx=0).stop 2024-04-25T12:24:34.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.774+0000 7f2c4a176640 1 -- 172.21.15.94:0/2276941433 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c44074100 msgr2=0x7f2c44142d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:34.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.774+0000 7f2c4a176640 1 --2- 172.21.15.94:0/2276941433 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c44074100 0x7f2c44142d20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400c420 tx=0x7f2c3400c8e0 comp rx=0 tx=0).stop 2024-04-25T12:24:34.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.774+0000 7f2c4a176640 1 -- 172.21.15.94:0/2276941433 shutdown_connections 2024-04-25T12:24:34.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.774+0000 7f2c4a176640 1 --2- 172.21.15.94:0/2276941433 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2c24068380 0x7f2c2406a840 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:34.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.774+0000 7f2c4a176640 1 --2- 172.21.15.94:0/2276941433 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c4414fbc0 0x7f2c4414b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:34.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.774+0000 7f2c4a176640 1 --2- 172.21.15.94:0/2276941433 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2c4414ffa0 0x7f2c4414b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:34.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.774+0000 7f2c4a176640 1 --2- 172.21.15.94:0/2276941433 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c44074100 0x7f2c44142d20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:34.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.774+0000 7f2c4a176640 1 -- 172.21.15.94:0/2276941433 >> 172.21.15.94:0/2276941433 conn(0x7f2c4406b9d0 msgr2=0x7f2c440ca3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:34.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.774+0000 7f2c4a176640 1 -- 172.21.15.94:0/2276941433 shutdown_connections 2024-04-25T12:24:34.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:34.774+0000 7f2c4a176640 1 -- 172.21.15.94:0/2276941433 wait complete. 2024-04-25T12:24:37.799 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T12:24:37.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.926+0000 7f62799ae640 1 Processor -- start 2024-04-25T12:24:37.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.926+0000 7f62799ae640 1 -- start start 2024-04-25T12:24:37.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.926+0000 7f62799ae640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6274155350 0x7f62740c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:37.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.926+0000 7f62799ae640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62740cda50 0x7f62740cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:37.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.926+0000 7f62799ae640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f627415beb0 con 0x7f62740cbcf0 2024-04-25T12:24:37.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.926+0000 7f62799ae640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f62740cca40 con 0x7f6274155350 2024-04-25T12:24:37.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.926+0000 7f62799ae640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f62740ccc90 con 0x7f62740cda50 2024-04-25T12:24:37.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.926+0000 7f6272ffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6274155350 0x7f62740c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:37.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.926+0000 7f62737fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f62740cbcf0 0x7f627415b0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:54290/0 (socket says 172.21.15.94:54290) 2024-04-25T12:24:37.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.926+0000 7f62737fe640 1 -- 172.21.15.94:0/3723215921 learned_addr learned my addr 172.21.15.94:0/3723215921 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:37.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.926+0000 7f62727fc640 1 --2- 172.21.15.94:0/3723215921 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62740cda50 0x7f62740cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:37.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.926+0000 7f6272ffd640 1 -- 172.21.15.94:0/3723215921 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62740cda50 msgr2=0x7f62740cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:37.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.926+0000 7f6272ffd640 1 --2- 172.21.15.94:0/3723215921 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62740cda50 0x7f62740cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:37.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.926+0000 7f6272ffd640 1 -- 172.21.15.94:0/3723215921 >> v1:172.21.15.94:6789/0 conn(0x7f62740cbcf0 legacy=0x7f627415b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:37.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.926+0000 7f6272ffd640 1 -- 172.21.15.94:0/3723215921 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62740ccf70 con 0x7f6274155350 2024-04-25T12:24:37.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.926+0000 7f6271ffb640 1 -- 172.21.15.94:0/3723215921 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 86605177 0 0) 0x7f627415beb0 con 0x7f62740cbcf0 2024-04-25T12:24:37.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.930+0000 7f6272ffd640 1 --2- 172.21.15.94:0/3723215921 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6274155350 0x7f62740c59c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f62640097c0 tx=0x7f626401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5730ec433d3478e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:37.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.930+0000 7f6271ffb640 1 -- 172.21.15.94:0/3723215921 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62640b5070 con 0x7f6274155350 2024-04-25T12:24:37.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.930+0000 7f6271ffb640 1 -- 172.21.15.94:0/3723215921 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62640a8990 con 0x7f6274155350 2024-04-25T12:24:37.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.930+0000 7f6271ffb640 1 -- 172.21.15.94:0/3723215921 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62640a8d60 con 0x7f6274155350 2024-04-25T12:24:37.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.930+0000 7f62799ae640 1 -- 172.21.15.94:0/3723215921 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6274155350 msgr2=0x7f62740c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:37.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.930+0000 7f62799ae640 1 --2- 172.21.15.94:0/3723215921 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6274155350 0x7f62740c59c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f62640097c0 tx=0x7f626401ec90 comp rx=0 tx=0).stop 2024-04-25T12:24:37.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.930+0000 7f62799ae640 1 -- 172.21.15.94:0/3723215921 shutdown_connections 2024-04-25T12:24:37.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.930+0000 7f62799ae640 1 --2- 172.21.15.94:0/3723215921 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62740cda50 0x7f62740cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:37.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.930+0000 7f62799ae640 1 --2- 172.21.15.94:0/3723215921 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6274155350 0x7f62740c59c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:37.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.930+0000 7f62799ae640 1 -- 172.21.15.94:0/3723215921 >> 172.21.15.94:0/3723215921 conn(0x7f627406cc30 msgr2=0x7f627406d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:37.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.930+0000 7f62799ae640 1 -- 172.21.15.94:0/3723215921 shutdown_connections 2024-04-25T12:24:37.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.930+0000 7f62799ae640 1 -- 172.21.15.94:0/3723215921 wait complete. 2024-04-25T12:24:37.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.930+0000 7f62799ae640 1 Processor -- start 2024-04-25T12:24:37.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.930+0000 7f62799ae640 1 -- start start 2024-04-25T12:24:37.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f62799ae640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62740cbcf0 0x7f62740b5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:37.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f62799ae640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62740cda50 0x7f62740b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:37.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f62799ae640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6274155350 0x7f6274143180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:37.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f62799ae640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6274155730 con 0x7f6274155350 2024-04-25T12:24:37.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f62799ae640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f62740cd530 con 0x7f62740cda50 2024-04-25T12:24:37.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f62799ae640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f627415e860 con 0x7f62740cbcf0 2024-04-25T12:24:37.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f62737fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6274155350 0x7f6274143180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:37.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f62737fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6274155350 0x7f6274143180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59436/0 (socket says 172.21.15.94:59436) 2024-04-25T12:24:37.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f62737fe640 1 -- 172.21.15.94:0/1168316590 learned_addr learned my addr 172.21.15.94:0/1168316590 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:37.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f6272ffd640 1 --2- 172.21.15.94:0/1168316590 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62740cbcf0 0x7f62740b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:37.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f62727fc640 1 --2- 172.21.15.94:0/1168316590 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62740cda50 0x7f62740b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:37.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f62737fe640 1 -- 172.21.15.94:0/1168316590 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62740cbcf0 msgr2=0x7f62740b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:37.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f62737fe640 1 --2- 172.21.15.94:0/1168316590 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62740cbcf0 0x7f62740b5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:37.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f62737fe640 1 -- 172.21.15.94:0/1168316590 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62740cda50 msgr2=0x7f62740b5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:37.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f62737fe640 1 --2- 172.21.15.94:0/1168316590 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62740cda50 0x7f62740b5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:37.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f62737fe640 1 -- 172.21.15.94:0/1168316590 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f627415d1b0 con 0x7f6274155350 2024-04-25T12:24:37.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f62737fe640 1 --2- 172.21.15.94:0/1168316590 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6274155350 0x7f6274143180 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f626c00c7b0 tx=0x7f626c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:37.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f626bfff640 1 -- 172.21.15.94:0/1168316590 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f626c018070 con 0x7f6274155350 2024-04-25T12:24:37.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f626bfff640 1 -- 172.21.15.94:0/1168316590 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f626c00a640 con 0x7f6274155350 2024-04-25T12:24:37.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f62799ae640 1 -- 172.21.15.94:0/1168316590 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f627415d490 con 0x7f6274155350 2024-04-25T12:24:37.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f626bfff640 1 -- 172.21.15.94:0/1168316590 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f626c00ce60 con 0x7f6274155350 2024-04-25T12:24:37.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f62799ae640 1 -- 172.21.15.94:0/1168316590 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62740b4d10 con 0x7f6274155350 2024-04-25T12:24:37.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f62799ae640 1 -- 172.21.15.94:0/1168316590 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6274075df0 con 0x7f6274155350 2024-04-25T12:24:37.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f626bfff640 1 -- 172.21.15.94:0/1168316590 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f626c01b070 con 0x7f6274155350 2024-04-25T12:24:37.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f626bfff640 1 --2- 172.21.15.94:0/1168316590 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6254068380 0x7f625406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:37.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f6272ffd640 1 --2- 172.21.15.94:0/1168316590 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6254068380 0x7f625406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:37.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.934+0000 7f626bfff640 1 -- 172.21.15.94:0/1168316590 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f626c0869a0 con 0x7f6274155350 2024-04-25T12:24:37.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.938+0000 7f6272ffd640 1 --2- 172.21.15.94:0/1168316590 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6254068380 0x7f625406a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f62640b2000 tx=0x7f6264008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:37.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:37.938+0000 7f626bfff640 1 -- 172.21.15.94:0/1168316590 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f626c022020 con 0x7f6274155350 2024-04-25T12:24:38.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:38.134+0000 7f62799ae640 1 -- 172.21.15.94:0/1168316590 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f62740cc610 con 0x7f6274155350 2024-04-25T12:24:38.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:38.134+0000 7f626bfff640 1 -- 172.21.15.94:0/1168316590 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f626c056ac0 con 0x7f6274155350 2024-04-25T12:24:38.140 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:38.140 INFO:teuthology.orchestra.run.smithi094.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-25T12:24:38.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:38.138+0000 7f62799ae640 1 -- 172.21.15.94:0/1168316590 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6254068380 msgr2=0x7f625406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:38.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:38.138+0000 7f62799ae640 1 --2- 172.21.15.94:0/1168316590 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6254068380 0x7f625406a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f62640b2000 tx=0x7f6264008040 comp rx=0 tx=0).stop 2024-04-25T12:24:38.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:38.138+0000 7f62799ae640 1 -- 172.21.15.94:0/1168316590 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6274155350 msgr2=0x7f6274143180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:38.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:38.138+0000 7f62799ae640 1 --2- 172.21.15.94:0/1168316590 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6274155350 0x7f6274143180 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f626c00c7b0 tx=0x7f626c00cc70 comp rx=0 tx=0).stop 2024-04-25T12:24:38.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:38.138+0000 7f62799ae640 1 -- 172.21.15.94:0/1168316590 shutdown_connections 2024-04-25T12:24:38.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:38.138+0000 7f62799ae640 1 --2- 172.21.15.94:0/1168316590 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6254068380 0x7f625406a840 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:38.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:38.138+0000 7f62799ae640 1 --2- 172.21.15.94:0/1168316590 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6274155350 0x7f6274143180 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:38.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:38.138+0000 7f62799ae640 1 --2- 172.21.15.94:0/1168316590 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62740cda50 0x7f62740b5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:38.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:38.138+0000 7f62799ae640 1 --2- 172.21.15.94:0/1168316590 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62740cbcf0 0x7f62740b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:38.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:38.138+0000 7f62799ae640 1 -- 172.21.15.94:0/1168316590 >> 172.21.15.94:0/1168316590 conn(0x7f627406cc30 msgr2=0x7f62740c7020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:38.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:38.138+0000 7f62799ae640 1 -- 172.21.15.94:0/1168316590 shutdown_connections 2024-04-25T12:24:38.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:38.138+0000 7f62799ae640 1 -- 172.21.15.94:0/1168316590 wait complete. 2024-04-25T12:24:41.159 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T12:24:41.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.286+0000 7fbfe548b640 1 Processor -- start 2024-04-25T12:24:41.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.286+0000 7fbfe548b640 1 -- start start 2024-04-25T12:24:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.286+0000 7fbfe548b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbfe014fbc0 0x7fbfe006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.286+0000 7fbfe548b640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbfe0074100 0x7fbfe00c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.286+0000 7fbfe548b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfe00c5d70 con 0x7fbfe014ffa0 2024-04-25T12:24:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.286+0000 7fbfe548b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fbfe00c6050 con 0x7fbfe014fbc0 2024-04-25T12:24:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.286+0000 7fbfe548b640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe00c6330 con 0x7fbfe0074100 2024-04-25T12:24:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.286+0000 7fbfdeffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbfe014fbc0 0x7fbfe006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.286+0000 7fbfdeffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbfe014fbc0 0x7fbfe006f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59442/0 (socket says 172.21.15.94:59442) 2024-04-25T12:24:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.286+0000 7fbfdeffd640 1 -- 172.21.15.94:0/2456180634 learned_addr learned my addr 172.21.15.94:0/2456180634 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:41.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.286+0000 7fbfde7fc640 1 --1- 172.21.15.94:0/2456180634 >> v1:172.21.15.94:6789/0 conn(0x7fbfe014ffa0 0x7fbfe00c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:54294/0 (socket says 172.21.15.94:54294) 2024-04-25T12:24:41.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.286+0000 7fbfdf7fe640 1 --2- 172.21.15.94:0/2456180634 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbfe0074100 0x7fbfe00c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:41.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.286+0000 7fbfdeffd640 1 -- 172.21.15.94:0/2456180634 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbfe0074100 msgr2=0x7fbfe00c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:41.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.286+0000 7fbfdeffd640 1 --2- 172.21.15.94:0/2456180634 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbfe0074100 0x7fbfe00c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.286+0000 7fbfdeffd640 1 -- 172.21.15.94:0/2456180634 >> v1:172.21.15.94:6789/0 conn(0x7fbfe014ffa0 legacy=0x7fbfe00c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:41.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.286+0000 7fbfdeffd640 1 -- 172.21.15.94:0/2456180634 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe00c6610 con 0x7fbfe014fbc0 2024-04-25T12:24:41.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.286+0000 7fbfddffb640 1 -- 172.21.15.94:0/2456180634 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2553267345 0 0) 0x7fbfe00c5d70 con 0x7fbfe014ffa0 2024-04-25T12:24:41.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.286+0000 7fbfdf7fe640 1 --2- 172.21.15.94:0/2456180634 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbfe0074100 0x7fbfe00c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:24:41.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.290+0000 7fbfdeffd640 1 --2- 172.21.15.94:0/2456180634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfe014fbc0 0x7fbfe006f700 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4009870 tx=0x7fbfd401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4320228dd8f9b0da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:41.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.290+0000 7fbfddffb640 1 -- 172.21.15.94:0/2456180634 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd40a9640 con 0x7fbfe014fbc0 2024-04-25T12:24:41.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.290+0000 7fbfddffb640 1 -- 172.21.15.94:0/2456180634 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd40a97e0 con 0x7fbfe014fbc0 2024-04-25T12:24:41.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.290+0000 7fbfddffb640 1 -- 172.21.15.94:0/2456180634 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd40a9bb0 con 0x7fbfe014fbc0 2024-04-25T12:24:41.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.290+0000 7fbfe548b640 1 -- 172.21.15.94:0/2456180634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfe014fbc0 msgr2=0x7fbfe006f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:41.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.290+0000 7fbfe548b640 1 --2- 172.21.15.94:0/2456180634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfe014fbc0 0x7fbfe006f700 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4009870 tx=0x7fbfd401c560 comp rx=0 tx=0).stop 2024-04-25T12:24:41.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.290+0000 7fbfe548b640 1 -- 172.21.15.94:0/2456180634 shutdown_connections 2024-04-25T12:24:41.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.290+0000 7fbfe548b640 1 --2- 172.21.15.94:0/2456180634 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbfe0074100 0x7fbfe00c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.290+0000 7fbfe548b640 1 --2- 172.21.15.94:0/2456180634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfe014fbc0 0x7fbfe006f700 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.290+0000 7fbfe548b640 1 -- 172.21.15.94:0/2456180634 >> 172.21.15.94:0/2456180634 conn(0x7fbfe006b9d0 msgr2=0x7fbfe006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:41.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.290+0000 7fbfe548b640 1 -- 172.21.15.94:0/2456180634 shutdown_connections 2024-04-25T12:24:41.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.290+0000 7fbfe548b640 1 -- 172.21.15.94:0/2456180634 wait complete. 2024-04-25T12:24:41.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfe548b640 1 Processor -- start 2024-04-25T12:24:41.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfe548b640 1 -- start start 2024-04-25T12:24:41.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfe548b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfe0074100 0x7fbfe00cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:41.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfe548b640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbfe014fbc0 0x7fbfe013fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:41.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfe548b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfe014ffa0 0x7fbfe0140830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:41.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfe548b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe00c8ab0 con 0x7fbfe014ffa0 2024-04-25T12:24:41.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfe548b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe00c8930 con 0x7fbfe0074100 2024-04-25T12:24:41.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfe548b640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe0166090 con 0x7fbfe014fbc0 2024-04-25T12:24:41.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfdf7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfe014ffa0 0x7fbfe0140830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:41.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfdf7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfe014ffa0 0x7fbfe0140830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:59456/0 (socket says 172.21.15.94:59456) 2024-04-25T12:24:41.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfdf7fe640 1 -- 172.21.15.94:0/1079559342 learned_addr learned my addr 172.21.15.94:0/1079559342 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:41.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfde7fc640 1 --2- 172.21.15.94:0/1079559342 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbfe014fbc0 0x7fbfe013fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:41.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfdeffd640 1 --2- 172.21.15.94:0/1079559342 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfe0074100 0x7fbfe00cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:41.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfdf7fe640 1 -- 172.21.15.94:0/1079559342 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbfe014fbc0 msgr2=0x7fbfe013fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:41.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfdf7fe640 1 --2- 172.21.15.94:0/1079559342 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbfe014fbc0 0x7fbfe013fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfdf7fe640 1 -- 172.21.15.94:0/1079559342 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfe0074100 msgr2=0x7fbfe00cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:41.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfdf7fe640 1 --2- 172.21.15.94:0/1079559342 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfe0074100 0x7fbfe00cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfdf7fe640 1 -- 172.21.15.94:0/1079559342 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe01f2000 con 0x7fbfe014ffa0 2024-04-25T12:24:41.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfde7fc640 1 --2- 172.21.15.94:0/1079559342 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbfe014fbc0 0x7fbfe013fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:24:41.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfdf7fe640 1 --2- 172.21.15.94:0/1079559342 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfe014ffa0 0x7fbfe0140830 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8007e40 tx=0x7fbfd800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:41.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfc77fe640 1 -- 172.21.15.94:0/1079559342 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd801a070 con 0x7fbfe014ffa0 2024-04-25T12:24:41.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfc77fe640 1 -- 172.21.15.94:0/1079559342 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd8015600 con 0x7fbfe014ffa0 2024-04-25T12:24:41.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfe548b640 1 -- 172.21.15.94:0/1079559342 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe00cc190 con 0x7fbfe014ffa0 2024-04-25T12:24:41.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfc77fe640 1 -- 172.21.15.94:0/1079559342 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd80159f0 con 0x7fbfe014ffa0 2024-04-25T12:24:41.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfe548b640 1 -- 172.21.15.94:0/1079559342 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe01f25a0 con 0x7fbfe014ffa0 2024-04-25T12:24:41.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfe548b640 1 -- 172.21.15.94:0/1079559342 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfe0075df0 con 0x7fbfe014ffa0 2024-04-25T12:24:41.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.294+0000 7fbfc77fe640 1 -- 172.21.15.94:0/1079559342 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbfd801d070 con 0x7fbfe014ffa0 2024-04-25T12:24:41.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.298+0000 7fbfc77fe640 1 --2- 172.21.15.94:0/1079559342 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fbfcc0683b0 0x7fbfcc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:41.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.298+0000 7fbfc77fe640 1 -- 172.21.15.94:0/1079559342 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fbfd8086f60 con 0x7fbfe014ffa0 2024-04-25T12:24:41.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.298+0000 7fbfdeffd640 1 --2- 172.21.15.94:0/1079559342 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fbfcc0683b0 0x7fbfcc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:41.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.298+0000 7fbfdeffd640 1 --2- 172.21.15.94:0/1079559342 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fbfcc0683b0 0x7fbfcc06a870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40ae000 tx=0x7fbfd40b3040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:41.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.302+0000 7fbfc77fe640 1 -- 172.21.15.94:0/1079559342 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbfd8010070 con 0x7fbfe014ffa0 2024-04-25T12:24:41.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.498+0000 7fbfe548b640 1 -- 172.21.15.94:0/1079559342 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbfe0149c50 con 0x7fbfe014ffa0 2024-04-25T12:24:41.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.498+0000 7fbfc77fe640 1 -- 172.21.15.94:0/1079559342 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fbfd80571c0 con 0x7fbfe014ffa0 2024-04-25T12:24:41.503 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:41.503 INFO:teuthology.orchestra.run.smithi094.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T12:24:41.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.498+0000 7fbfe548b640 1 -- 172.21.15.94:0/1079559342 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fbfcc0683b0 msgr2=0x7fbfcc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:41.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.498+0000 7fbfe548b640 1 --2- 172.21.15.94:0/1079559342 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fbfcc0683b0 0x7fbfcc06a870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40ae000 tx=0x7fbfd40b3040 comp rx=0 tx=0).stop 2024-04-25T12:24:41.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.498+0000 7fbfe548b640 1 -- 172.21.15.94:0/1079559342 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfe014ffa0 msgr2=0x7fbfe0140830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:41.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.498+0000 7fbfe548b640 1 --2- 172.21.15.94:0/1079559342 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfe014ffa0 0x7fbfe0140830 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8007e40 tx=0x7fbfd800d4a0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.498+0000 7fbfe548b640 1 -- 172.21.15.94:0/1079559342 shutdown_connections 2024-04-25T12:24:41.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.498+0000 7fbfe548b640 1 --2- 172.21.15.94:0/1079559342 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fbfcc0683b0 0x7fbfcc06a870 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.498+0000 7fbfe548b640 1 --2- 172.21.15.94:0/1079559342 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbfe014fbc0 0x7fbfe013fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.498+0000 7fbfe548b640 1 --2- 172.21.15.94:0/1079559342 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfe014ffa0 0x7fbfe0140830 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.498+0000 7fbfe548b640 1 --2- 172.21.15.94:0/1079559342 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfe0074100 0x7fbfe00cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.498+0000 7fbfe548b640 1 -- 172.21.15.94:0/1079559342 >> 172.21.15.94:0/1079559342 conn(0x7fbfe006b9d0 msgr2=0x7fbfe014aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:41.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.498+0000 7fbfe548b640 1 -- 172.21.15.94:0/1079559342 shutdown_connections 2024-04-25T12:24:41.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.498+0000 7fbfe548b640 1 -- 172.21.15.94:0/1079559342 wait complete. 2024-04-25T12:24:41.522 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T12:24:41.522 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:24:41.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.630+0000 7fa8ed857640 1 Processor -- start 2024-04-25T12:24:41.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.630+0000 7fa8ed857640 1 -- start start 2024-04-25T12:24:41.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8ed857640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa8e814fbc0 0x7fa8e806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:41.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8ed857640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8e80c5d70 con 0x7fa8e814ffa0 2024-04-25T12:24:41.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8ed857640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8e80c6050 con 0x7fa8e8074100 2024-04-25T12:24:41.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8ed857640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fa8e80c6330 con 0x7fa8e814fbc0 2024-04-25T12:24:41.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e67fc640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fa8e814ffa0 0x7fa8e80c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50150/0 (socket says 172.21.15.94:50150) 2024-04-25T12:24:41.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e67fc640 1 -- 172.21.15.94:0/432956451 learned_addr learned my addr 172.21.15.94:0/432956451 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:41.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e6ffd640 1 --2- 172.21.15.94:0/432956451 >> v2:172.21.15.111:3300/0 conn(0x7fa8e814fbc0 0x7fa8e806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:41.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e5ffb640 1 -- 172.21.15.94:0/432956451 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 89220631 0 0) 0x7fa8e80c5d70 con 0x7fa8e814ffa0 2024-04-25T12:24:41.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e5ffb640 1 -- 172.21.15.94:0/432956451 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8d0003530 con 0x7fa8e814ffa0 2024-04-25T12:24:41.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e5ffb640 1 -- 172.21.15.94:0/432956451 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3670138632 0 0) 0x7fa8d0003530 con 0x7fa8e814ffa0 2024-04-25T12:24:41.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e5ffb640 1 -- 172.21.15.94:0/432956451 >> v2:172.21.15.111:3300/0 conn(0x7fa8e814fbc0 msgr2=0x7fa8e806f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:41.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e5ffb640 1 --2- 172.21.15.94:0/432956451 >> v2:172.21.15.111:3300/0 conn(0x7fa8e814fbc0 0x7fa8e806f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e5ffb640 1 -- 172.21.15.94:0/432956451 >> v1:172.21.15.111:6789/0 conn(0x7fa8e8074100 legacy=0x7fa8e80c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:41.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e5ffb640 1 -- 172.21.15.94:0/432956451 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e80c6610 con 0x7fa8e814ffa0 2024-04-25T12:24:41.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e5ffb640 1 -- 172.21.15.94:0/432956451 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7fa8dc001680 con 0x7fa8e814ffa0 2024-04-25T12:24:41.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e5ffb640 1 -- 172.21.15.94:0/432956451 >> v1:172.21.15.94:6789/0 conn(0x7fa8e814ffa0 legacy=0x7fa8e80c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:41.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e5ffb640 1 --2- 172.21.15.94:0/432956451 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8d00039c0 0x7fa8d0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:41.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e5ffb640 1 --2- 172.21.15.94:0/432956451 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa8d0004810 0x7fa8d0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:41.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e5ffb640 1 --2- 172.21.15.94:0/432956451 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa8d00051d0 0x7fa8d000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:41.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e5ffb640 1 -- 172.21.15.94:0/432956451 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e80c6330 con 0x7fa8d00039c0 2024-04-25T12:24:41.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e5ffb640 1 -- 172.21.15.94:0/432956451 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d000c070 con 0x7fa8d00051d0 2024-04-25T12:24:41.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e5ffb640 1 -- 172.21.15.94:0/432956451 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa8d000c270 con 0x7fa8d0004810 2024-04-25T12:24:41.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e6ffd640 1 --2- 172.21.15.94:0/432956451 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8d00039c0 0x7fa8d0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:41.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e67fc640 1 --2- 172.21.15.94:0/432956451 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa8d0004810 0x7fa8d0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:41.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e77fe640 1 --2- 172.21.15.94:0/432956451 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa8d00051d0 0x7fa8d000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:41.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e6ffd640 1 -- 172.21.15.94:0/432956451 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa8d0004810 msgr2=0x7fa8d0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:41.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e6ffd640 1 --2- 172.21.15.94:0/432956451 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa8d0004810 0x7fa8d0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e6ffd640 1 -- 172.21.15.94:0/432956451 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa8d00051d0 msgr2=0x7fa8d000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:41.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e6ffd640 1 --2- 172.21.15.94:0/432956451 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa8d00051d0 0x7fa8d000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e77fe640 1 -- 172.21.15.94:0/432956451 reap_dead start 2024-04-25T12:24:41.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.634+0000 7fa8e6ffd640 1 -- 172.21.15.94:0/432956451 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d0003530 con 0x7fa8d00039c0 2024-04-25T12:24:41.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.638+0000 7fa8e6ffd640 1 --2- 172.21.15.94:0/432956451 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8d00039c0 0x7fa8d0003de0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8009ae0 tx=0x7fa8d801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85003c771104b35e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:41.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.638+0000 7fa8e5ffb640 1 -- 172.21.15.94:0/432956451 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d80b2070 con 0x7fa8d00039c0 2024-04-25T12:24:41.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.638+0000 7fa8e5ffb640 1 -- 172.21.15.94:0/432956451 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8d80a5660 con 0x7fa8d00039c0 2024-04-25T12:24:41.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.638+0000 7fa8e5ffb640 1 -- 172.21.15.94:0/432956451 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d80096b0 con 0x7fa8d00039c0 2024-04-25T12:24:41.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.638+0000 7fa8ed857640 1 -- 172.21.15.94:0/432956451 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8d00039c0 msgr2=0x7fa8d0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:41.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.638+0000 7fa8ed857640 1 --2- 172.21.15.94:0/432956451 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8d00039c0 0x7fa8d0003de0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8009ae0 tx=0x7fa8d801ca70 comp rx=0 tx=0).stop 2024-04-25T12:24:41.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.638+0000 7fa8ed857640 1 -- 172.21.15.94:0/432956451 shutdown_connections 2024-04-25T12:24:41.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.638+0000 7fa8ed857640 1 --2- 172.21.15.94:0/432956451 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8d00039c0 0x7fa8d0003de0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.638+0000 7fa8ed857640 1 -- 172.21.15.94:0/432956451 >> 172.21.15.94:0/432956451 conn(0x7fa8e806b9d0 msgr2=0x7fa8e806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:41.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.638+0000 7fa8ed857640 1 -- 172.21.15.94:0/432956451 shutdown_connections 2024-04-25T12:24:41.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.638+0000 7fa8ed857640 1 -- 172.21.15.94:0/432956451 wait complete. 2024-04-25T12:24:41.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.638+0000 7fa8ed857640 1 Processor -- start 2024-04-25T12:24:41.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8ed857640 1 -- start start 2024-04-25T12:24:41.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8ed857640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa8d00039c0 0x7fa8e81e9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:41.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8ed857640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8e81e66f0 0x7fa8e81f1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:41.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8ed857640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa8e81f21e0 0x7fa8e81f5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:41.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8ed857640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e80c75c0 con 0x7fa8e81e66f0 2024-04-25T12:24:41.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8ed857640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e80c7440 con 0x7fa8e81f21e0 2024-04-25T12:24:41.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8ed857640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa8e80c7740 con 0x7fa8d00039c0 2024-04-25T12:24:41.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8e67fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8e81e66f0 0x7fa8e81f1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:41.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8e67fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8e81e66f0 0x7fa8e81f1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56788/0 (socket says 172.21.15.94:56788) 2024-04-25T12:24:41.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8e67fc640 1 -- 172.21.15.94:0/210925629 learned_addr learned my addr 172.21.15.94:0/210925629 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:41.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8e6ffd640 1 --2- 172.21.15.94:0/210925629 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa8d00039c0 0x7fa8e81e9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:41.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8e77fe640 1 --2- 172.21.15.94:0/210925629 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa8e81f21e0 0x7fa8e81f5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:41.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8e67fc640 1 -- 172.21.15.94:0/210925629 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa8d00039c0 msgr2=0x7fa8e81e9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:41.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8e67fc640 1 --2- 172.21.15.94:0/210925629 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa8d00039c0 0x7fa8e81e9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8e67fc640 1 -- 172.21.15.94:0/210925629 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa8e81f21e0 msgr2=0x7fa8e81f5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:41.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8e67fc640 1 --2- 172.21.15.94:0/210925629 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa8e81f21e0 0x7fa8e81f5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8e67fc640 1 -- 172.21.15.94:0/210925629 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e81e7290 con 0x7fa8e81e66f0 2024-04-25T12:24:41.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8e67fc640 1 --2- 172.21.15.94:0/210925629 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8e81e66f0 0x7fa8e81f1ca0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc00e7d0 tx=0x7fa8dc00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:41.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8cffff640 1 -- 172.21.15.94:0/210925629 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc00c8d0 con 0x7fa8e81e66f0 2024-04-25T12:24:41.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8cffff640 1 -- 172.21.15.94:0/210925629 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8dc018070 con 0x7fa8e81e66f0 2024-04-25T12:24:41.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8ed857640 1 -- 172.21.15.94:0/210925629 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8e81e7570 con 0x7fa8e81e66f0 2024-04-25T12:24:41.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8cffff640 1 -- 172.21.15.94:0/210925629 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc00ccd0 con 0x7fa8e81e66f0 2024-04-25T12:24:41.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8ed857640 1 -- 172.21.15.94:0/210925629 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8e8152460 con 0x7fa8e81e66f0 2024-04-25T12:24:41.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8ed857640 1 -- 172.21.15.94:0/210925629 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8e81e7a90 con 0x7fa8e81e66f0 2024-04-25T12:24:41.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8cffff640 1 -- 172.21.15.94:0/210925629 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa8dc01d460 con 0x7fa8e81e66f0 2024-04-25T12:24:41.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8cffff640 1 --2- 172.21.15.94:0/210925629 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa8d4068380 0x7fa8d406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:41.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8cffff640 1 -- 172.21.15.94:0/210925629 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fa8dc086d30 con 0x7fa8e81e66f0 2024-04-25T12:24:41.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.642+0000 7fa8e6ffd640 1 --2- 172.21.15.94:0/210925629 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa8d4068380 0x7fa8d406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:41.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.646+0000 7fa8e6ffd640 1 --2- 172.21.15.94:0/210925629 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa8d4068380 0x7fa8d406a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa8d80af000 tx=0x7fa8d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:41.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.646+0000 7fa8cffff640 1 -- 172.21.15.94:0/210925629 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa8dc056e70 con 0x7fa8e81e66f0 2024-04-25T12:24:41.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.802+0000 7fa8ed857640 1 -- 172.21.15.94:0/210925629 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8e8075df0 con 0x7fa8e81e66f0 2024-04-25T12:24:41.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.802+0000 7fa8cffff640 1 -- 172.21.15.94:0/210925629 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18873 (secure 0 0 0) 0x7fa8dc056770 con 0x7fa8e81e66f0 2024-04-25T12:24:41.809 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:41.809 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"7059a9e2-aec4-4b84-b942-caf531e15da3","created":"2024-04-25T12:21:29.118508+0000","modified":"2024-04-25T12:22:34.871807+0000","last_up_change":"2024-04-25T12:21:40.912605+0000","last_in_change":"2024-04-25T12:21:31.372905+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:39.781011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:51.465886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:52.470540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:56.209936+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"640a65ef-0734-468a-a8f5-9ed70cf75c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6809","nonce":2553247564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6811","nonce":2553247564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6815","nonce":2553247564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6813","nonce":2553247564}]},"public_addr":"172.21.15.94:6809/2553247564","cluster_addr":"172.21.15.94:6811/2553247564","heartbeat_back_addr":"172.21.15.94:6815/2553247564","heartbeat_front_addr":"172.21.15.94:6813/2553247564","state":["exists","up"]},{"osd":1,"uuid":"d6e886e6-c8c1-4761-9a4c-abc6961c7c81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6818","nonce":2492806478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6822","nonce":2492806478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6830","nonce":2492806478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6826","nonce":2492806478}]},"public_addr":"172.21.15.94:6818/2492806478","cluster_addr":"172.21.15.94:6822/2492806478","heartbeat_back_addr":"172.21.15.94:6830/2492806478","heartbeat_front_addr":"172.21.15.94:6826/2492806478","state":["exists","up"]},{"osd":2,"uuid":"ba20f409-ed46-43b6-b16d-43dc4622c042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6801","nonce":1485061290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6803","nonce":1485061290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6807","nonce":1485061290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6805","nonce":1485061290}]},"public_addr":"172.21.15.94:6801/1485061290","cluster_addr":"172.21.15.94:6803/1485061290","heartbeat_back_addr":"172.21.15.94:6807/1485061290","heartbeat_front_addr":"172.21.15.94:6805/1485061290","state":["exists","up"]},{"osd":3,"uuid":"85816a2b-3a3f-4ec8-8373-8230d948396f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6819","nonce":1548488434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6823","nonce":1548488434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6829","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6831","nonce":1548488434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6827","nonce":1548488434}]},"public_addr":"172.21.15.94:6819/1548488434","cluster_addr":"172.21.15.94:6823/1548488434","heartbeat_back_addr":"172.21.15.94:6831/1548488434","heartbeat_front_addr":"172.21.15.94:6827/1548488434","state":["exists","up"]},{"osd":4,"uuid":"b4a953b7-01d6-4623-9324-63135fdaf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6811","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6814","nonce":4070977083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6817","nonce":4070977083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6823","nonce":4070977083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6819","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6821","nonce":4070977083}]},"public_addr":"172.21.15.111:6814/4070977083","cluster_addr":"172.21.15.111:6817/4070977083","heartbeat_back_addr":"172.21.15.111:6823/4070977083","heartbeat_front_addr":"172.21.15.111:6821/4070977083","state":["exists","up"]},{"osd":5,"uuid":"c0acc514-427d-41bf-a965-b8463cebf045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6803","nonce":1054925605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6809","nonce":1054925605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6820","nonce":1054925605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6815","nonce":1054925605}]},"public_addr":"172.21.15.111:6803/1054925605","cluster_addr":"172.21.15.111:6809/1054925605","heartbeat_back_addr":"172.21.15.111:6820/1054925605","heartbeat_front_addr":"172.21.15.111:6815/1054925605","state":["exists","up"]},{"osd":6,"uuid":"26ff742f-5a57-44a7-a095-f04d6e87f885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6825","nonce":3619235078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6827","nonce":3619235078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6831","nonce":3619235078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6829","nonce":3619235078}]},"public_addr":"172.21.15.111:6825/3619235078","cluster_addr":"172.21.15.111:6827/3619235078","heartbeat_back_addr":"172.21.15.111:6831/3619235078","heartbeat_front_addr":"172.21.15.111:6829/3619235078","state":["exists","up"]},{"osd":7,"uuid":"9c214cba-693a-4b25-aad7-05a5b0006e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6801","nonce":558758517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6805","nonce":558758517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6813","nonce":558758517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6807","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6808","nonce":558758517}]},"public_addr":"172.21.15.111:6801/558758517","cluster_addr":"172.21.15.111:6805/558758517","heartbeat_back_addr":"172.21.15.111:6813/558758517","heartbeat_front_addr":"172.21.15.111:6808/558758517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.664958+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.853375+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.654455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:37.033852+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.968691+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.856013+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.913496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.848565+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:24:41.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.806+0000 7fa8ed857640 1 -- 172.21.15.94:0/210925629 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa8d4068380 msgr2=0x7fa8d406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:41.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.806+0000 7fa8ed857640 1 --2- 172.21.15.94:0/210925629 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa8d4068380 0x7fa8d406a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa8d80af000 tx=0x7fa8d8008040 comp rx=0 tx=0).stop 2024-04-25T12:24:41.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.806+0000 7fa8ed857640 1 -- 172.21.15.94:0/210925629 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8e81e66f0 msgr2=0x7fa8e81f1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:41.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.806+0000 7fa8ed857640 1 --2- 172.21.15.94:0/210925629 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8e81e66f0 0x7fa8e81f1ca0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc00e7d0 tx=0x7fa8dc00ec90 comp rx=0 tx=0).stop 2024-04-25T12:24:41.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.806+0000 7fa8ed857640 1 -- 172.21.15.94:0/210925629 shutdown_connections 2024-04-25T12:24:41.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.806+0000 7fa8ed857640 1 --2- 172.21.15.94:0/210925629 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa8d4068380 0x7fa8d406a840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.806+0000 7fa8ed857640 1 --2- 172.21.15.94:0/210925629 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa8e81f21e0 0x7fa8e81f5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.806+0000 7fa8ed857640 1 --2- 172.21.15.94:0/210925629 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8e81e66f0 0x7fa8e81f1ca0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.806+0000 7fa8ed857640 1 --2- 172.21.15.94:0/210925629 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa8d00039c0 0x7fa8e81e9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.806+0000 7fa8ed857640 1 -- 172.21.15.94:0/210925629 >> 172.21.15.94:0/210925629 conn(0x7fa8e806b9d0 msgr2=0x7fa8e814ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:41.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.806+0000 7fa8ed857640 1 -- 172.21.15.94:0/210925629 shutdown_connections 2024-04-25T12:24:41.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.806+0000 7fa8ed857640 1 -- 172.21.15.94:0/210925629 wait complete. 2024-04-25T12:24:41.826 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T12:21:39.781011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T12:21:51.465886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T12:21:52.470540+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T12:21:56.209936+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T12:24:41.827 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T12:24:41.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.930+0000 7f5d026d5640 1 Processor -- start 2024-04-25T12:24:41.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.930+0000 7f5d026d5640 1 -- start start 2024-04-25T12:24:41.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5d026d5640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f5cfc152ff0 0x7f5cfc0c5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:41.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5d026d5640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5cfc0c7eb0 0x7f5cfc0c6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:41.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5d026d5640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cfc0cada0 con 0x7f5cfc0ca550 2024-04-25T12:24:41.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5d026d5640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f5cfc0cb080 con 0x7f5cfc152ff0 2024-04-25T12:24:41.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5d026d5640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f5cfc0c9360 con 0x7f5cfc0c7eb0 2024-04-25T12:24:41.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5d00c72640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f5cfc0ca550 0x7f5cfc0cb350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50158/0 (socket says 172.21.15.94:50158) 2024-04-25T12:24:41.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5d00c72640 1 -- 172.21.15.94:0/3555634118 learned_addr learned my addr 172.21.15.94:0/3555634118 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:41.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cfbfff640 1 --2- 172.21.15.94:0/3555634118 >> v2:172.21.15.111:3300/0 conn(0x7f5cfc152ff0 0x7f5cfc0c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:41.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cf3fff640 1 --2- 172.21.15.94:0/3555634118 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5cfc0c7eb0 0x7f5cfc0c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:41.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cfb7fe640 1 -- 172.21.15.94:0/3555634118 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 672572987 0 0) 0x7f5cfc0cada0 con 0x7f5cfc0ca550 2024-04-25T12:24:41.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cfb7fe640 1 -- 172.21.15.94:0/3555634118 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ce8003530 con 0x7f5cfc0ca550 2024-04-25T12:24:41.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cfb7fe640 1 -- 172.21.15.94:0/3555634118 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3625869991 0 0) 0x7f5ce8003530 con 0x7f5cfc0ca550 2024-04-25T12:24:41.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cfb7fe640 1 -- 172.21.15.94:0/3555634118 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5cfc0c7eb0 msgr2=0x7f5cfc0c6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:41.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cfb7fe640 1 --2- 172.21.15.94:0/3555634118 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5cfc0c7eb0 0x7f5cfc0c6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cfb7fe640 1 -- 172.21.15.94:0/3555634118 >> v2:172.21.15.111:3300/0 conn(0x7f5cfc152ff0 msgr2=0x7f5cfc0c5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:41.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cfb7fe640 1 --2- 172.21.15.94:0/3555634118 >> v2:172.21.15.111:3300/0 conn(0x7f5cfc152ff0 0x7f5cfc0c5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cfb7fe640 1 -- 172.21.15.94:0/3555634118 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cfc0c9640 con 0x7f5cfc0ca550 2024-04-25T12:24:41.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cfb7fe640 1 -- 172.21.15.94:0/3555634118 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7f5cf4001a00 con 0x7f5cfc0ca550 2024-04-25T12:24:41.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cfb7fe640 1 -- 172.21.15.94:0/3555634118 >> v1:172.21.15.94:6789/0 conn(0x7f5cfc0ca550 legacy=0x7f5cfc0cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:41.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cfb7fe640 1 --2- 172.21.15.94:0/3555634118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ce80039c0 0x7f5ce8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:41.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cfb7fe640 1 --2- 172.21.15.94:0/3555634118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ce8004810 0x7f5ce8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:41.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cfb7fe640 1 --2- 172.21.15.94:0/3555634118 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5cfc0c7eb0 0x7f5ce80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:41.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cfb7fe640 1 -- 172.21.15.94:0/3555634118 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5cfc0cb080 con 0x7f5ce80039c0 2024-04-25T12:24:41.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cfb7fe640 1 -- 172.21.15.94:0/3555634118 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5cfc0c9360 con 0x7f5ce8004810 2024-04-25T12:24:41.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cfb7fe640 1 -- 172.21.15.94:0/3555634118 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f5ce800b9d0 con 0x7f5cfc0c7eb0 2024-04-25T12:24:41.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cfbfff640 1 --2- 172.21.15.94:0/3555634118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ce80039c0 0x7f5ce8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:41.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5d00c72640 1 --2- 172.21.15.94:0/3555634118 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5cfc0c7eb0 0x7f5ce80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:41.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cf3fff640 1 --2- 172.21.15.94:0/3555634118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ce8004810 0x7f5ce8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:41.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cfbfff640 1 -- 172.21.15.94:0/3555634118 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5cfc0c7eb0 msgr2=0x7f5ce80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:41.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cfbfff640 1 --2- 172.21.15.94:0/3555634118 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5cfc0c7eb0 0x7f5ce80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cfbfff640 1 -- 172.21.15.94:0/3555634118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ce8004810 msgr2=0x7f5ce8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:41.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cfbfff640 1 --2- 172.21.15.94:0/3555634118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ce8004810 0x7f5ce8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cfbfff640 1 -- 172.21.15.94:0/3555634118 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce8003530 con 0x7f5ce80039c0 2024-04-25T12:24:41.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cf3fff640 1 --2- 172.21.15.94:0/3555634118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ce8004810 0x7f5ce8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:41.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.934+0000 7f5cfbfff640 1 --2- 172.21.15.94:0/3555634118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ce80039c0 0x7f5ce8003de0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009ae0 tx=0x7f5cec01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d034f8a34a8eefd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:41.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5cfb7fe640 1 -- 172.21.15.94:0/3555634118 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cec0096b0 con 0x7f5ce80039c0 2024-04-25T12:24:41.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5cfb7fe640 1 -- 172.21.15.94:0/3555634118 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cec0a64c0 con 0x7f5ce80039c0 2024-04-25T12:24:41.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5cfb7fe640 1 -- 172.21.15.94:0/3555634118 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cec0a68b0 con 0x7f5ce80039c0 2024-04-25T12:24:41.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5d026d5640 1 -- 172.21.15.94:0/3555634118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ce80039c0 msgr2=0x7f5ce8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:41.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5d026d5640 1 --2- 172.21.15.94:0/3555634118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ce80039c0 0x7f5ce8003de0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009ae0 tx=0x7f5cec01cab0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5d00c72640 1 -- 172.21.15.94:0/3555634118 reap_dead start 2024-04-25T12:24:41.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5d026d5640 1 -- 172.21.15.94:0/3555634118 shutdown_connections 2024-04-25T12:24:41.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5d026d5640 1 -- 172.21.15.94:0/3555634118 >> 172.21.15.94:0/3555634118 conn(0x7f5cfc0676a0 msgr2=0x7f5cfc067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:41.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5d026d5640 1 -- 172.21.15.94:0/3555634118 shutdown_connections 2024-04-25T12:24:41.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5d026d5640 1 -- 172.21.15.94:0/3555634118 wait complete. 2024-04-25T12:24:41.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5d026d5640 1 Processor -- start 2024-04-25T12:24:41.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5d026d5640 1 -- start start 2024-04-25T12:24:41.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5d026d5640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5ce80039c0 0x7f5cfc1f2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:41.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5d026d5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cfc1f2990 0x7f5cfc14c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:41.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5d026d5640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5cfc0ce1a0 0x7f5cfc14c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:41.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5d026d5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5cfc0caaa0 con 0x7f5cfc1f2990 2024-04-25T12:24:41.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5d026d5640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5cfc0c5e60 con 0x7f5cfc0ce1a0 2024-04-25T12:24:41.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5d026d5640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f5cfc1533d0 con 0x7f5ce80039c0 2024-04-25T12:24:41.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5cf3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cfc1f2990 0x7f5cfc14c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:41.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5cf3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cfc1f2990 0x7f5cfc14c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56800/0 (socket says 172.21.15.94:56800) 2024-04-25T12:24:41.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5cf3fff640 1 -- 172.21.15.94:0/1215356022 learned_addr learned my addr 172.21.15.94:0/1215356022 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:41.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5cfbfff640 1 --2- 172.21.15.94:0/1215356022 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5ce80039c0 0x7f5cfc1f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:41.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5d00c72640 1 --2- 172.21.15.94:0/1215356022 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5cfc0ce1a0 0x7f5cfc14c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:41.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5cf3fff640 1 -- 172.21.15.94:0/1215356022 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5ce80039c0 msgr2=0x7f5cfc1f2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:41.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5cf3fff640 1 --2- 172.21.15.94:0/1215356022 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5ce80039c0 0x7f5cfc1f2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5cf3fff640 1 -- 172.21.15.94:0/1215356022 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5cfc0ce1a0 msgr2=0x7f5cfc14c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:41.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5cf3fff640 1 --2- 172.21.15.94:0/1215356022 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5cfc0ce1a0 0x7f5cfc14c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:41.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5cf3fff640 1 -- 172.21.15.94:0/1215356022 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cfc0cd7c0 con 0x7f5cfc1f2990 2024-04-25T12:24:41.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5cfbfff640 1 --2- 172.21.15.94:0/1215356022 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5ce80039c0 0x7f5cfc1f2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:24:41.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5cf3fff640 1 --2- 172.21.15.94:0/1215356022 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cfc1f2990 0x7f5cfc14c230 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4010890 tx=0x7f5ce4010c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:41.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5cf97fa640 1 -- 172.21.15.94:0/1215356022 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce400f040 con 0x7f5cfc1f2990 2024-04-25T12:24:41.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5cf97fa640 1 -- 172.21.15.94:0/1215356022 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce400eb60 con 0x7f5cfc1f2990 2024-04-25T12:24:41.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5d026d5640 1 -- 172.21.15.94:0/1215356022 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cfc0c8b20 con 0x7f5cfc1f2990 2024-04-25T12:24:41.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5cf97fa640 1 -- 172.21.15.94:0/1215356022 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4010e80 con 0x7f5cfc1f2990 2024-04-25T12:24:41.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.938+0000 7f5d026d5640 1 -- 172.21.15.94:0/1215356022 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cfc0cda80 con 0x7f5cfc1f2990 2024-04-25T12:24:41.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.942+0000 7f5d026d5640 1 -- 172.21.15.94:0/1215356022 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cfc075df0 con 0x7f5cfc1f2990 2024-04-25T12:24:41.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.942+0000 7f5cf97fa640 1 -- 172.21.15.94:0/1215356022 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5ce401c400 con 0x7f5cfc1f2990 2024-04-25T12:24:41.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.942+0000 7f5cf97fa640 1 --2- 172.21.15.94:0/1215356022 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5cdc0683b0 0x7f5cdc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:41.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.942+0000 7f5cf97fa640 1 -- 172.21.15.94:0/1215356022 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f5ce40873d0 con 0x7f5cfc1f2990 2024-04-25T12:24:41.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.942+0000 7f5cfbfff640 1 --2- 172.21.15.94:0/1215356022 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5cdc0683b0 0x7f5cdc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:41.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.942+0000 7f5cfbfff640 1 --2- 172.21.15.94:0/1215356022 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5cdc0683b0 0x7f5cdc06a870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5cec0af000 tx=0x7f5cec0046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:41.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:41.946+0000 7f5cf97fa640 1 -- 172.21.15.94:0/1215356022 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5ce4018030 con 0x7f5cfc1f2990 2024-04-25T12:24:42.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.094+0000 7f5d026d5640 1 -- 172.21.15.94:0/1215356022 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5cfc074550 con 0x7f5cfc1f2990 2024-04-25T12:24:42.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.094+0000 7f5cf97fa640 1 -- 172.21.15.94:0/1215356022 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7f5ce4057500 con 0x7f5cfc1f2990 2024-04-25T12:24:42.100 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2024-04-25T12:24:42.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.094+0000 7f5d026d5640 1 -- 172.21.15.94:0/1215356022 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5cdc0683b0 msgr2=0x7f5cdc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:42.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.094+0000 7f5d026d5640 1 --2- 172.21.15.94:0/1215356022 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5cdc0683b0 0x7f5cdc06a870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5cec0af000 tx=0x7f5cec0046d0 comp rx=0 tx=0).stop 2024-04-25T12:24:42.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.094+0000 7f5d026d5640 1 -- 172.21.15.94:0/1215356022 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cfc1f2990 msgr2=0x7f5cfc14c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:42.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.094+0000 7f5d026d5640 1 --2- 172.21.15.94:0/1215356022 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cfc1f2990 0x7f5cfc14c230 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4010890 tx=0x7f5ce4010c90 comp rx=0 tx=0).stop 2024-04-25T12:24:42.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.094+0000 7f5d026d5640 1 -- 172.21.15.94:0/1215356022 shutdown_connections 2024-04-25T12:24:42.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.094+0000 7f5d026d5640 1 --2- 172.21.15.94:0/1215356022 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5cdc0683b0 0x7f5cdc06a870 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:42.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.094+0000 7f5d026d5640 1 --2- 172.21.15.94:0/1215356022 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5cfc0ce1a0 0x7f5cfc14c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:42.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.094+0000 7f5d026d5640 1 --2- 172.21.15.94:0/1215356022 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5cfc1f2990 0x7f5cfc14c230 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:42.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.094+0000 7f5d026d5640 1 --2- 172.21.15.94:0/1215356022 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5ce80039c0 0x7f5cfc1f2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:42.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.094+0000 7f5d026d5640 1 -- 172.21.15.94:0/1215356022 >> 172.21.15.94:0/1215356022 conn(0x7f5cfc0676a0 msgr2=0x7f5cfc0c6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:42.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.094+0000 7f5d026d5640 1 -- 172.21.15.94:0/1215356022 shutdown_connections 2024-04-25T12:24:42.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.094+0000 7f5d026d5640 1 -- 172.21.15.94:0/1215356022 wait complete. 2024-04-25T12:24:42.117 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T12:24:42.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.238+0000 7f84ebce5640 1 Processor -- start 2024-04-25T12:24:42.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.238+0000 7f84ebce5640 1 -- start start 2024-04-25T12:24:42.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.238+0000 7f84ebce5640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f84e415b7c0 0x7f84e40c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:42.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.238+0000 7f84ebce5640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84e415bc10 con 0x7f84e40cda50 2024-04-25T12:24:42.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.238+0000 7f84ebce5640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84e415beb0 con 0x7f84e4155350 2024-04-25T12:24:42.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.238+0000 7f84ebce5640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f84e40cca40 con 0x7f84e415b7c0 2024-04-25T12:24:42.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.238+0000 7f84ea282640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f84e415b7c0 0x7f84e40c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:42.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.238+0000 7f84e9280640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f84e40cda50 0x7f84e415b0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50162/0 (socket says 172.21.15.94:50162) 2024-04-25T12:24:42.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.238+0000 7f84e9280640 1 -- 172.21.15.94:0/2518083525 learned_addr learned my addr 172.21.15.94:0/2518083525 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:42.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.238+0000 7f84ea282640 1 -- 172.21.15.94:0/2518083525 >> v1:172.21.15.111:6789/0 conn(0x7f84e4155350 legacy=0x7f84e40cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:42.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.238+0000 7f84ea282640 1 -- 172.21.15.94:0/2518083525 >> v1:172.21.15.94:6789/0 conn(0x7f84e40cda50 legacy=0x7f84e415b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:42.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.238+0000 7f84ea282640 1 -- 172.21.15.94:0/2518083525 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e40ccc90 con 0x7f84e415b7c0 2024-04-25T12:24:42.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.238+0000 7f84e8a7f640 1 -- 172.21.15.94:0/2518083525 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4239526033 0 0) 0x7f84e415bc10 con 0x7f84e40cda50 2024-04-25T12:24:42.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ea282640 1 --2- 172.21.15.94:0/2518083525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84e415b7c0 0x7f84e40c59c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009d90 tx=0x7f84dc01f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15fb31e965274232 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:42.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84e8a7f640 1 -- 172.21.15.94:0/2518083525 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc0b4070 con 0x7f84e415b7c0 2024-04-25T12:24:42.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84e8a7f640 1 -- 172.21.15.94:0/2518083525 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84dc0af600 con 0x7f84e415b7c0 2024-04-25T12:24:42.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84e8a7f640 1 -- 172.21.15.94:0/2518083525 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc0af9d0 con 0x7f84e415b7c0 2024-04-25T12:24:42.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ebce5640 1 -- 172.21.15.94:0/2518083525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84e415b7c0 msgr2=0x7f84e40c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:42.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ebce5640 1 --2- 172.21.15.94:0/2518083525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84e415b7c0 0x7f84e40c59c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009d90 tx=0x7f84dc01f150 comp rx=0 tx=0).stop 2024-04-25T12:24:42.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ebce5640 1 -- 172.21.15.94:0/2518083525 shutdown_connections 2024-04-25T12:24:42.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ebce5640 1 --2- 172.21.15.94:0/2518083525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84e415b7c0 0x7f84e40c59c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:42.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ebce5640 1 -- 172.21.15.94:0/2518083525 >> 172.21.15.94:0/2518083525 conn(0x7f84e406cc30 msgr2=0x7f84e406d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:42.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ebce5640 1 -- 172.21.15.94:0/2518083525 shutdown_connections 2024-04-25T12:24:42.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ebce5640 1 -- 172.21.15.94:0/2518083525 wait complete. 2024-04-25T12:24:42.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ebce5640 1 Processor -- start 2024-04-25T12:24:42.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ebce5640 1 -- start start 2024-04-25T12:24:42.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ebce5640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f84e40cda50 0x7f84e41f18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:42.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ebce5640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84e4155350 0x7f84e414ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:42.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ebce5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84e415b7c0 0x7f84e414c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:42.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ebce5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f84e40cd530 con 0x7f84e415b7c0 2024-04-25T12:24:42.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ebce5640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f84e40cd250 con 0x7f84e4155350 2024-04-25T12:24:42.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ebce5640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f84e4155730 con 0x7f84e40cda50 2024-04-25T12:24:42.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ea282640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84e415b7c0 0x7f84e414c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:42.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ea282640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84e415b7c0 0x7f84e414c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56810/0 (socket says 172.21.15.94:56810) 2024-04-25T12:24:42.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ea282640 1 -- 172.21.15.94:0/4149781836 learned_addr learned my addr 172.21.15.94:0/4149781836 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:42.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84e9280640 1 --2- 172.21.15.94:0/4149781836 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84e4155350 0x7f84e414ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:42.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84e9a81640 1 --2- 172.21.15.94:0/4149781836 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f84e40cda50 0x7f84e41f18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:42.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ea282640 1 -- 172.21.15.94:0/4149781836 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f84e40cda50 msgr2=0x7f84e41f18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:42.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ea282640 1 --2- 172.21.15.94:0/4149781836 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f84e40cda50 0x7f84e41f18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:42.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ea282640 1 -- 172.21.15.94:0/4149781836 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84e4155350 msgr2=0x7f84e414ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:42.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ea282640 1 --2- 172.21.15.94:0/4149781836 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84e4155350 0x7f84e414ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:42.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ea282640 1 -- 172.21.15.94:0/4149781836 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e41f1e30 con 0x7f84e415b7c0 2024-04-25T12:24:42.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84e9a81640 1 --2- 172.21.15.94:0/4149781836 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f84e40cda50 0x7f84e41f18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:42.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ea282640 1 --2- 172.21.15.94:0/4149781836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84e415b7c0 0x7f84e414c3d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0b2040 tx=0x7f84dc01bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:42.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84da7fc640 1 -- 172.21.15.94:0/4149781836 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc0bf020 con 0x7f84e415b7c0 2024-04-25T12:24:42.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84da7fc640 1 -- 172.21.15.94:0/4149781836 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84dc0ba470 con 0x7f84e415b7c0 2024-04-25T12:24:42.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ebce5640 1 -- 172.21.15.94:0/4149781836 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e4150fe0 con 0x7f84e415b7c0 2024-04-25T12:24:42.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84da7fc640 1 -- 172.21.15.94:0/4149781836 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc0b4040 con 0x7f84e415b7c0 2024-04-25T12:24:42.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.242+0000 7f84ebce5640 1 -- 172.21.15.94:0/4149781836 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e41515a0 con 0x7f84e415b7c0 2024-04-25T12:24:42.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.246+0000 7f84ebce5640 1 -- 172.21.15.94:0/4149781836 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84e4075df0 con 0x7f84e415b7c0 2024-04-25T12:24:42.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.246+0000 7f84da7fc640 1 -- 172.21.15.94:0/4149781836 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f84dc0c2020 con 0x7f84e415b7c0 2024-04-25T12:24:42.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.246+0000 7f84da7fc640 1 --2- 172.21.15.94:0/4149781836 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f84c8068380 0x7f84c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:42.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.246+0000 7f84da7fc640 1 -- 172.21.15.94:0/4149781836 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f84dc125aa0 con 0x7f84e415b7c0 2024-04-25T12:24:42.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.246+0000 7f84e9a81640 1 --2- 172.21.15.94:0/4149781836 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f84c8068380 0x7f84c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:42.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.246+0000 7f84e9a81640 1 --2- 172.21.15.94:0/4149781836 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f84c8068380 0x7f84c806a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f84e0000f70 tx=0x7f84e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:42.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.250+0000 7f84da7fc640 1 -- 172.21.15.94:0/4149781836 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f84dc0c9030 con 0x7f84e415b7c0 2024-04-25T12:24:42.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.410+0000 7f84ebce5640 1 -- 172.21.15.94:0/4149781836 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f84e40cc610 con 0x7f84e415b7c0 2024-04-25T12:24:42.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.410+0000 7f84da7fc640 1 -- 172.21.15.94:0/4149781836 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7f84dc018cb0 con 0x7f84e415b7c0 2024-04-25T12:24:42.417 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2024-04-25T12:24:42.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.414+0000 7f84ebce5640 1 -- 172.21.15.94:0/4149781836 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f84c8068380 msgr2=0x7f84c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:42.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.414+0000 7f84ebce5640 1 --2- 172.21.15.94:0/4149781836 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f84c8068380 0x7f84c806a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f84e0000f70 tx=0x7f84e0009040 comp rx=0 tx=0).stop 2024-04-25T12:24:42.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.414+0000 7f84ebce5640 1 -- 172.21.15.94:0/4149781836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84e415b7c0 msgr2=0x7f84e414c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:42.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.414+0000 7f84ebce5640 1 --2- 172.21.15.94:0/4149781836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84e415b7c0 0x7f84e414c3d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0b2040 tx=0x7f84dc01bef0 comp rx=0 tx=0).stop 2024-04-25T12:24:42.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.414+0000 7f84ebce5640 1 -- 172.21.15.94:0/4149781836 shutdown_connections 2024-04-25T12:24:42.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.414+0000 7f84ebce5640 1 --2- 172.21.15.94:0/4149781836 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f84c8068380 0x7f84c806a840 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:42.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.414+0000 7f84ebce5640 1 --2- 172.21.15.94:0/4149781836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84e415b7c0 0x7f84e414c3d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:42.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.414+0000 7f84ebce5640 1 --2- 172.21.15.94:0/4149781836 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84e4155350 0x7f84e414ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:42.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.414+0000 7f84ebce5640 1 --2- 172.21.15.94:0/4149781836 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f84e40cda50 0x7f84e41f18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:42.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.414+0000 7f84ebce5640 1 -- 172.21.15.94:0/4149781836 >> 172.21.15.94:0/4149781836 conn(0x7f84e406cc30 msgr2=0x7f84e40cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:42.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.414+0000 7f84ebce5640 1 -- 172.21.15.94:0/4149781836 shutdown_connections 2024-04-25T12:24:42.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.414+0000 7f84ebce5640 1 -- 172.21.15.94:0/4149781836 wait complete. 2024-04-25T12:24:42.436 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T12:24:42.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.590+0000 7f807129e640 1 Processor -- start 2024-04-25T12:24:42.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.590+0000 7f807129e640 1 -- start start 2024-04-25T12:24:42.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.594+0000 7f807129e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f806c155280 0x7f806c15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:42.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.594+0000 7f807129e640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f806c0cb590 0x7f806c06c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:42.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.594+0000 7f807129e640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f806c15b730 con 0x7f806c06c7b0 2024-04-25T12:24:42.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.594+0000 7f807129e640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f806c06bde0 con 0x7f806c155280 2024-04-25T12:24:42.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.594+0000 7f807129e640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f806c15ba10 con 0x7f806c0cb590 2024-04-25T12:24:42.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.594+0000 7f806affd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f806c155280 0x7f806c15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:42.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.594+0000 7f806affd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f806c155280 0x7f806c15b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56814/0 (socket says 172.21.15.94:56814) 2024-04-25T12:24:42.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.594+0000 7f806b7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f806c06c7b0 0x7f806c0cd8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50166/0 (socket says 172.21.15.94:50166) 2024-04-25T12:24:42.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.594+0000 7f806affd640 1 -- 172.21.15.94:0/2916591170 learned_addr learned my addr 172.21.15.94:0/2916591170 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:42.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.594+0000 7f806a7fc640 1 --2- 172.21.15.94:0/2916591170 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f806c0cb590 0x7f806c06c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:42.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.594+0000 7f806affd640 1 -- 172.21.15.94:0/2916591170 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f806c0cb590 msgr2=0x7f806c06c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:42.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.594+0000 7f806affd640 1 --2- 172.21.15.94:0/2916591170 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f806c0cb590 0x7f806c06c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:42.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.594+0000 7f806affd640 1 -- 172.21.15.94:0/2916591170 >> v1:172.21.15.94:6789/0 conn(0x7f806c06c7b0 legacy=0x7f806c0cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:42.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.594+0000 7f806affd640 1 -- 172.21.15.94:0/2916591170 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f806c15bcf0 con 0x7f806c155280 2024-04-25T12:24:42.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.594+0000 7f8069ffb640 1 -- 172.21.15.94:0/2916591170 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4064778085 0 0) 0x7f806c15b730 con 0x7f806c06c7b0 2024-04-25T12:24:42.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.594+0000 7f806affd640 1 --2- 172.21.15.94:0/2916591170 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f806c155280 0x7f806c15b0e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f805c009870 tx=0x7f805c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f40a88e3ef31d68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:42.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.594+0000 7f8069ffb640 1 -- 172.21.15.94:0/2916591170 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c0b5070 con 0x7f806c155280 2024-04-25T12:24:42.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.594+0000 7f8069ffb640 1 -- 172.21.15.94:0/2916591170 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f805c0a8a50 con 0x7f806c155280 2024-04-25T12:24:42.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.594+0000 7f8069ffb640 1 -- 172.21.15.94:0/2916591170 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c0a8e20 con 0x7f806c155280 2024-04-25T12:24:42.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f807129e640 1 -- 172.21.15.94:0/2916591170 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f806c155280 msgr2=0x7f806c15b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:42.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f807129e640 1 --2- 172.21.15.94:0/2916591170 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f806c155280 0x7f806c15b0e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f805c009870 tx=0x7f805c01ed50 comp rx=0 tx=0).stop 2024-04-25T12:24:42.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f807129e640 1 -- 172.21.15.94:0/2916591170 shutdown_connections 2024-04-25T12:24:42.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f807129e640 1 --2- 172.21.15.94:0/2916591170 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f806c0cb590 0x7f806c06c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:42.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f807129e640 1 --2- 172.21.15.94:0/2916591170 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f806c155280 0x7f806c15b0e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:42.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f807129e640 1 -- 172.21.15.94:0/2916591170 >> 172.21.15.94:0/2916591170 conn(0x7f806c06d920 msgr2=0x7f806c06dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:42.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f807129e640 1 -- 172.21.15.94:0/2916591170 shutdown_connections 2024-04-25T12:24:42.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f807129e640 1 -- 172.21.15.94:0/2916591170 wait complete. 2024-04-25T12:24:42.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f807129e640 1 Processor -- start 2024-04-25T12:24:42.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f807129e640 1 -- start start 2024-04-25T12:24:42.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f807129e640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f806c06c7b0 0x7f806c1f4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:42.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f807129e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f806c0cb590 0x7f806c15eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:42.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f807129e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f806c155280 0x7f806c155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:42.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f807129e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f806c0cc620 con 0x7f806c155280 2024-04-25T12:24:42.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f807129e640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f806c15bfd0 con 0x7f806c0cb590 2024-04-25T12:24:42.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f807129e640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f806c0cc7a0 con 0x7f806c06c7b0 2024-04-25T12:24:42.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f806b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f806c155280 0x7f806c155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:42.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f806b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f806c155280 0x7f806c155a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56826/0 (socket says 172.21.15.94:56826) 2024-04-25T12:24:42.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f806b7fe640 1 -- 172.21.15.94:0/922992077 learned_addr learned my addr 172.21.15.94:0/922992077 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:42.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f806affd640 1 --2- 172.21.15.94:0/922992077 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f806c06c7b0 0x7f806c1f4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:42.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f806a7fc640 1 --2- 172.21.15.94:0/922992077 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f806c0cb590 0x7f806c15eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:42.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f806b7fe640 1 -- 172.21.15.94:0/922992077 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f806c06c7b0 msgr2=0x7f806c1f4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:42.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f806b7fe640 1 --2- 172.21.15.94:0/922992077 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f806c06c7b0 0x7f806c1f4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:42.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f806b7fe640 1 -- 172.21.15.94:0/922992077 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f806c0cb590 msgr2=0x7f806c15eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:42.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f806b7fe640 1 --2- 172.21.15.94:0/922992077 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f806c0cb590 0x7f806c15eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:42.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f806b7fe640 1 -- 172.21.15.94:0/922992077 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f806c1576b0 con 0x7f806c155280 2024-04-25T12:24:42.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f806a7fc640 1 --2- 172.21.15.94:0/922992077 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f806c0cb590 0x7f806c15eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:42.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f806b7fe640 1 --2- 172.21.15.94:0/922992077 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f806c155280 0x7f806c155a10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f806400c730 tx=0x7f806400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:42.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f80537fe640 1 -- 172.21.15.94:0/922992077 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8064018070 con 0x7f806c155280 2024-04-25T12:24:42.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f80537fe640 1 -- 172.21.15.94:0/922992077 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f806400ce40 con 0x7f806c155280 2024-04-25T12:24:42.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f807129e640 1 -- 172.21.15.94:0/922992077 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f806c1f4a90 con 0x7f806c155280 2024-04-25T12:24:42.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f80537fe640 1 -- 172.21.15.94:0/922992077 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806400a860 con 0x7f806c155280 2024-04-25T12:24:42.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f807129e640 1 -- 172.21.15.94:0/922992077 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f806c157c10 con 0x7f806c155280 2024-04-25T12:24:42.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.598+0000 7f807129e640 1 -- 172.21.15.94:0/922992077 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f806c075df0 con 0x7f806c155280 2024-04-25T12:24:42.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.602+0000 7f80537fe640 1 -- 172.21.15.94:0/922992077 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f806401b070 con 0x7f806c155280 2024-04-25T12:24:42.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.602+0000 7f80537fe640 1 --2- 172.21.15.94:0/922992077 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f80580683b0 0x7f805806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:42.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.602+0000 7f80537fe640 1 -- 172.21.15.94:0/922992077 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f8064086290 con 0x7f806c155280 2024-04-25T12:24:42.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.602+0000 7f806affd640 1 --2- 172.21.15.94:0/922992077 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f80580683b0 0x7f805806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:42.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.602+0000 7f806affd640 1 --2- 172.21.15.94:0/922992077 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f80580683b0 0x7f805806a870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f805c0b2000 tx=0x7f805c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:42.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.606+0000 7f80537fe640 1 -- 172.21.15.94:0/922992077 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f806c1576b0 con 0x7f806c155280 2024-04-25T12:24:42.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.762+0000 7f807129e640 1 -- 172.21.15.94:0/922992077 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f806c0cc120 con 0x7f806c155280 2024-04-25T12:24:42.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.766+0000 7f80537fe640 1 -- 172.21.15.94:0/922992077 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7f80640564f0 con 0x7f806c155280 2024-04-25T12:24:42.770 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2024-04-25T12:24:42.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.766+0000 7f807129e640 1 -- 172.21.15.94:0/922992077 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f80580683b0 msgr2=0x7f805806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:42.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.766+0000 7f807129e640 1 --2- 172.21.15.94:0/922992077 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f80580683b0 0x7f805806a870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f805c0b2000 tx=0x7f805c008040 comp rx=0 tx=0).stop 2024-04-25T12:24:42.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.766+0000 7f807129e640 1 -- 172.21.15.94:0/922992077 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f806c155280 msgr2=0x7f806c155a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:42.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.766+0000 7f807129e640 1 --2- 172.21.15.94:0/922992077 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f806c155280 0x7f806c155a10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f806400c730 tx=0x7f806400cbf0 comp rx=0 tx=0).stop 2024-04-25T12:24:42.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.766+0000 7f807129e640 1 -- 172.21.15.94:0/922992077 shutdown_connections 2024-04-25T12:24:42.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.766+0000 7f807129e640 1 --2- 172.21.15.94:0/922992077 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f80580683b0 0x7f805806a870 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:42.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.766+0000 7f807129e640 1 --2- 172.21.15.94:0/922992077 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f806c155280 0x7f806c155a10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:42.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.766+0000 7f807129e640 1 --2- 172.21.15.94:0/922992077 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f806c0cb590 0x7f806c15eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:42.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.766+0000 7f807129e640 1 --2- 172.21.15.94:0/922992077 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f806c06c7b0 0x7f806c1f4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:42.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.766+0000 7f807129e640 1 -- 172.21.15.94:0/922992077 >> 172.21.15.94:0/922992077 conn(0x7f806c06d920 msgr2=0x7f806c14fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:42.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.766+0000 7f807129e640 1 -- 172.21.15.94:0/922992077 shutdown_connections 2024-04-25T12:24:42.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.766+0000 7f807129e640 1 -- 172.21.15.94:0/922992077 wait complete. 2024-04-25T12:24:42.789 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T12:24:42.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.894+0000 7ff037dd1640 1 Processor -- start 2024-04-25T12:24:42.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.894+0000 7ff037dd1640 1 -- start start 2024-04-25T12:24:42.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.898+0000 7ff037dd1640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff03006d520 0x7ff03015cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:42.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.898+0000 7ff037dd1640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0300c7070 con 0x7ff03015d040 2024-04-25T12:24:42.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.898+0000 7ff037dd1640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0300c7350 con 0x7ff03006d140 2024-04-25T12:24:42.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.898+0000 7ff037dd1640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7ff0300c7630 con 0x7ff03006d520 2024-04-25T12:24:42.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.898+0000 7ff03536c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff03006d520 0x7ff03015cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:42.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.898+0000 7ff03636e640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7ff03015d040 0x7ff030152ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50176/0 (socket says 172.21.15.94:50176) 2024-04-25T12:24:42.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.898+0000 7ff03636e640 1 -- 172.21.15.94:0/1723291900 learned_addr learned my addr 172.21.15.94:0/1723291900 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:42.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.898+0000 7ff03536c640 1 -- 172.21.15.94:0/1723291900 >> v1:172.21.15.111:6789/0 conn(0x7ff03006d140 legacy=0x7ff030070230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:42.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.898+0000 7ff03536c640 1 -- 172.21.15.94:0/1723291900 >> v1:172.21.15.94:6789/0 conn(0x7ff03015d040 legacy=0x7ff030152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:42.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.898+0000 7ff03536c640 1 -- 172.21.15.94:0/1723291900 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0300c7910 con 0x7ff03006d520 2024-04-25T12:24:42.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.898+0000 7ff034b6b640 1 -- 172.21.15.94:0/1723291900 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2836383148 0 0) 0x7ff0300c7070 con 0x7ff03015d040 2024-04-25T12:24:42.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.898+0000 7ff03536c640 1 --2- 172.21.15.94:0/1723291900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff03006d520 0x7ff03015cb00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff024009d90 tx=0x7ff02401f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644851a27eaf6f95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:42.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.898+0000 7ff034b6b640 1 -- 172.21.15.94:0/1723291900 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0240b4070 con 0x7ff03006d520 2024-04-25T12:24:42.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.898+0000 7ff034b6b640 1 -- 172.21.15.94:0/1723291900 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0240af600 con 0x7ff03006d520 2024-04-25T12:24:42.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.898+0000 7ff034b6b640 1 -- 172.21.15.94:0/1723291900 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0240af9d0 con 0x7ff03006d520 2024-04-25T12:24:42.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff037dd1640 1 -- 172.21.15.94:0/1723291900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff03006d520 msgr2=0x7ff03015cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:42.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff037dd1640 1 --2- 172.21.15.94:0/1723291900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff03006d520 0x7ff03015cb00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff024009d90 tx=0x7ff02401f150 comp rx=0 tx=0).stop 2024-04-25T12:24:42.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff037dd1640 1 -- 172.21.15.94:0/1723291900 shutdown_connections 2024-04-25T12:24:42.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff037dd1640 1 --2- 172.21.15.94:0/1723291900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff03006d520 0x7ff03015cb00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:42.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff037dd1640 1 -- 172.21.15.94:0/1723291900 >> 172.21.15.94:0/1723291900 conn(0x7ff0300ca540 msgr2=0x7ff0300ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:42.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff037dd1640 1 -- 172.21.15.94:0/1723291900 shutdown_connections 2024-04-25T12:24:42.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff037dd1640 1 -- 172.21.15.94:0/1723291900 wait complete. 2024-04-25T12:24:42.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff037dd1640 1 Processor -- start 2024-04-25T12:24:42.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff037dd1640 1 -- start start 2024-04-25T12:24:42.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff037dd1640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff03006d140 0x7ff0301f4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:42.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff037dd1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff03006d520 0x7ff030145530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:42.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff037dd1640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff03015d040 0x7ff030146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:42.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff037dd1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff030070940 con 0x7ff03006d520 2024-04-25T12:24:42.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff037dd1640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff0300c55c0 con 0x7ff03006d140 2024-04-25T12:24:42.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff037dd1640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff030070ac0 con 0x7ff03015d040 2024-04-25T12:24:42.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff03536c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff03006d520 0x7ff030145530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:42.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff03536c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff03006d520 0x7ff030145530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56842/0 (socket says 172.21.15.94:56842) 2024-04-25T12:24:42.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff03536c640 1 -- 172.21.15.94:0/2295176871 learned_addr learned my addr 172.21.15.94:0/2295176871 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:42.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff03636e640 1 --2- 172.21.15.94:0/2295176871 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff03015d040 0x7ff030146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:42.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff035b6d640 1 --2- 172.21.15.94:0/2295176871 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff03006d140 0x7ff0301f4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:42.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff03536c640 1 -- 172.21.15.94:0/2295176871 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff03015d040 msgr2=0x7ff030146190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:42.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff03536c640 1 --2- 172.21.15.94:0/2295176871 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff03015d040 0x7ff030146190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:42.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff03536c640 1 -- 172.21.15.94:0/2295176871 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff03006d140 msgr2=0x7ff0301f4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:42.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff03536c640 1 --2- 172.21.15.94:0/2295176871 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff03006d140 0x7ff0301f4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:42.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff03536c640 1 -- 172.21.15.94:0/2295176871 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff030143ed0 con 0x7ff03006d520 2024-04-25T12:24:42.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff035b6d640 1 --2- 172.21.15.94:0/2295176871 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff03006d140 0x7ff0301f4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:42.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff03536c640 1 --2- 172.21.15.94:0/2295176871 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff03006d520 0x7ff030145530 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff024009d90 tx=0x7ff02401bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:42.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff02e7fc640 1 -- 172.21.15.94:0/2295176871 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0240b4040 con 0x7ff03006d520 2024-04-25T12:24:42.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff02e7fc640 1 -- 172.21.15.94:0/2295176871 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0240039a0 con 0x7ff03006d520 2024-04-25T12:24:42.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff037dd1640 1 -- 172.21.15.94:0/2295176871 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff030144a10 con 0x7ff03006d520 2024-04-25T12:24:42.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff02e7fc640 1 -- 172.21.15.94:0/2295176871 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff024003d50 con 0x7ff03006d520 2024-04-25T12:24:42.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.902+0000 7ff037dd1640 1 -- 172.21.15.94:0/2295176871 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff030144450 con 0x7ff03006d520 2024-04-25T12:24:42.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.906+0000 7ff037dd1640 1 -- 172.21.15.94:0/2295176871 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0301f43e0 con 0x7ff03006d520 2024-04-25T12:24:42.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.906+0000 7ff02e7fc640 1 -- 172.21.15.94:0/2295176871 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff0240c4060 con 0x7ff03006d520 2024-04-25T12:24:42.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.906+0000 7ff02e7fc640 1 --2- 172.21.15.94:0/2295176871 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff01c068380 0x7ff01c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:42.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.906+0000 7ff02e7fc640 1 -- 172.21.15.94:0/2295176871 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7ff024124c20 con 0x7ff03006d520 2024-04-25T12:24:42.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.906+0000 7ff035b6d640 1 --2- 172.21.15.94:0/2295176871 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff01c068380 0x7ff01c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:42.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.906+0000 7ff035b6d640 1 --2- 172.21.15.94:0/2295176871 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff01c068380 0x7ff01c06a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff028000f70 tx=0x7ff028009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:42.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:42.910+0000 7ff02e7fc640 1 -- 172.21.15.94:0/2295176871 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff024018cb0 con 0x7ff03006d520 2024-04-25T12:24:43.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.070+0000 7ff037dd1640 1 -- 172.21.15.94:0/2295176871 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ff03015cac0 con 0x7ff03006d520 2024-04-25T12:24:43.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.070+0000 7ff02e7fc640 1 -- 172.21.15.94:0/2295176871 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7ff0240f4df0 con 0x7ff03006d520 2024-04-25T12:24:43.076 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2024-04-25T12:24:43.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.074+0000 7ff037dd1640 1 -- 172.21.15.94:0/2295176871 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff01c068380 msgr2=0x7ff01c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:43.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.074+0000 7ff037dd1640 1 --2- 172.21.15.94:0/2295176871 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff01c068380 0x7ff01c06a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff028000f70 tx=0x7ff028009040 comp rx=0 tx=0).stop 2024-04-25T12:24:43.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.074+0000 7ff037dd1640 1 -- 172.21.15.94:0/2295176871 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff03006d520 msgr2=0x7ff030145530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:43.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.074+0000 7ff037dd1640 1 --2- 172.21.15.94:0/2295176871 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff03006d520 0x7ff030145530 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff024009d90 tx=0x7ff02401bef0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.074+0000 7ff037dd1640 1 -- 172.21.15.94:0/2295176871 shutdown_connections 2024-04-25T12:24:43.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.074+0000 7ff037dd1640 1 --2- 172.21.15.94:0/2295176871 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff01c068380 0x7ff01c06a840 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.074+0000 7ff037dd1640 1 --2- 172.21.15.94:0/2295176871 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff03015d040 0x7ff030146190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.074+0000 7ff037dd1640 1 --2- 172.21.15.94:0/2295176871 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff03006d520 0x7ff030145530 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.074+0000 7ff037dd1640 1 --2- 172.21.15.94:0/2295176871 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff03006d140 0x7ff0301f4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.074+0000 7ff037dd1640 1 -- 172.21.15.94:0/2295176871 >> 172.21.15.94:0/2295176871 conn(0x7ff0300ca540 msgr2=0x7ff0300c9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:43.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.074+0000 7ff037dd1640 1 -- 172.21.15.94:0/2295176871 shutdown_connections 2024-04-25T12:24:43.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.074+0000 7ff037dd1640 1 -- 172.21.15.94:0/2295176871 wait complete. 2024-04-25T12:24:43.094 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:24:43.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.206+0000 7fd99a8bb640 1 Processor -- start 2024-04-25T12:24:43.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.206+0000 7fd99a8bb640 1 -- start start 2024-04-25T12:24:43.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.210+0000 7fd99a8bb640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd99414ffa0 0x7fd99406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:43.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.210+0000 7fd99a8bb640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd994074100 0x7fd9940c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:43.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.210+0000 7fd99a8bb640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9940c5d70 con 0x7fd99414fbc0 2024-04-25T12:24:43.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.210+0000 7fd99a8bb640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fd9940c6050 con 0x7fd99414ffa0 2024-04-25T12:24:43.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.210+0000 7fd99a8bb640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd9940c6330 con 0x7fd994074100 2024-04-25T12:24:43.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.210+0000 7fd993fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fd99414fbc0 0x7fd9940c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50192/0 (socket says 172.21.15.94:50192) 2024-04-25T12:24:43.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.210+0000 7fd993fff640 1 -- 172.21.15.94:0/334795682 learned_addr learned my addr 172.21.15.94:0/334795682 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:43.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.210+0000 7fd998e58640 1 --2- 172.21.15.94:0/334795682 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd994074100 0x7fd9940c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:43.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.210+0000 7fd9937fe640 1 --2- 172.21.15.94:0/334795682 >> v2:172.21.15.111:3300/0 conn(0x7fd99414ffa0 0x7fd99406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:43.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.210+0000 7fd992ffd640 1 -- 172.21.15.94:0/334795682 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2148462238 0 0) 0x7fd9940c5d70 con 0x7fd99414fbc0 2024-04-25T12:24:43.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.210+0000 7fd992ffd640 1 -- 172.21.15.94:0/334795682 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd980003530 con 0x7fd99414fbc0 2024-04-25T12:24:43.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.210+0000 7fd992ffd640 1 -- 172.21.15.94:0/334795682 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2338831162 0 0) 0x7fd980003530 con 0x7fd99414fbc0 2024-04-25T12:24:43.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.210+0000 7fd998e58640 1 -- 172.21.15.94:0/334795682 >> v2:172.21.15.111:3300/0 conn(0x7fd99414ffa0 msgr2=0x7fd99406f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:43.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.210+0000 7fd998e58640 1 --2- 172.21.15.94:0/334795682 >> v2:172.21.15.111:3300/0 conn(0x7fd99414ffa0 0x7fd99406f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.210+0000 7fd998e58640 1 -- 172.21.15.94:0/334795682 >> v1:172.21.15.94:6789/0 conn(0x7fd99414fbc0 legacy=0x7fd9940c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:43.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.210+0000 7fd998e58640 1 -- 172.21.15.94:0/334795682 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9940c6610 con 0x7fd994074100 2024-04-25T12:24:43.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.214+0000 7fd998e58640 1 --2- 172.21.15.94:0/334795682 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd994074100 0x7fd9940c7250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd9840097c0 tx=0x7fd98401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3786cb76074cd5c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:43.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.214+0000 7fd992ffd640 1 -- 172.21.15.94:0/334795682 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9840b0070 con 0x7fd994074100 2024-04-25T12:24:43.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.214+0000 7fd992ffd640 1 -- 172.21.15.94:0/334795682 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9840ab400 con 0x7fd994074100 2024-04-25T12:24:43.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.214+0000 7fd992ffd640 1 -- 172.21.15.94:0/334795682 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98c001a00 con 0x7fd994074100 2024-04-25T12:24:43.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.214+0000 7fd99a8bb640 1 -- 172.21.15.94:0/334795682 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd994074100 msgr2=0x7fd9940c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:43.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.214+0000 7fd99a8bb640 1 --2- 172.21.15.94:0/334795682 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd994074100 0x7fd9940c7250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd9840097c0 tx=0x7fd98401c3c0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.214+0000 7fd99a8bb640 1 -- 172.21.15.94:0/334795682 shutdown_connections 2024-04-25T12:24:43.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.214+0000 7fd99a8bb640 1 --2- 172.21.15.94:0/334795682 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd994074100 0x7fd9940c7250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.214+0000 7fd99a8bb640 1 --2- 172.21.15.94:0/334795682 >> v2:172.21.15.111:3300/0 conn(0x7fd99414ffa0 0x7fd99406f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.214+0000 7fd99a8bb640 1 -- 172.21.15.94:0/334795682 >> 172.21.15.94:0/334795682 conn(0x7fd99406b9d0 msgr2=0x7fd99406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:43.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.214+0000 7fd99a8bb640 1 -- 172.21.15.94:0/334795682 shutdown_connections 2024-04-25T12:24:43.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.214+0000 7fd99a8bb640 1 -- 172.21.15.94:0/334795682 wait complete. 2024-04-25T12:24:43.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.214+0000 7fd99a8bb640 1 Processor -- start 2024-04-25T12:24:43.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.214+0000 7fd99a8bb640 1 -- start start 2024-04-25T12:24:43.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.214+0000 7fd99a8bb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd994074100 0x7fd9941496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:43.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.214+0000 7fd99a8bb640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd99414fbc0 0x7fd99414ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:43.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.214+0000 7fd99a8bb640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd99414ffa0 0x7fd99414cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:43.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.214+0000 7fd99a8bb640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd9940c8ab0 con 0x7fd994074100 2024-04-25T12:24:43.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.214+0000 7fd99a8bb640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd9940c8930 con 0x7fd99414ffa0 2024-04-25T12:24:43.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.214+0000 7fd99a8bb640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd994166090 con 0x7fd99414fbc0 2024-04-25T12:24:43.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.214+0000 7fd993fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd994074100 0x7fd9941496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:43.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.214+0000 7fd993fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd994074100 0x7fd9941496c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56844/0 (socket says 172.21.15.94:56844) 2024-04-25T12:24:43.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.214+0000 7fd993fff640 1 -- 172.21.15.94:0/1264097734 learned_addr learned my addr 172.21.15.94:0/1264097734 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:43.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.218+0000 7fd9937fe640 1 --2- 172.21.15.94:0/1264097734 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd99414fbc0 0x7fd99414ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:43.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.218+0000 7fd998e58640 1 --2- 172.21.15.94:0/1264097734 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd99414ffa0 0x7fd99414cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:43.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.218+0000 7fd993fff640 1 -- 172.21.15.94:0/1264097734 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd99414fbc0 msgr2=0x7fd99414ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:43.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.218+0000 7fd993fff640 1 --2- 172.21.15.94:0/1264097734 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd99414fbc0 0x7fd99414ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.218+0000 7fd993fff640 1 -- 172.21.15.94:0/1264097734 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd99414ffa0 msgr2=0x7fd99414cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:43.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.218+0000 7fd993fff640 1 --2- 172.21.15.94:0/1264097734 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd99414ffa0 0x7fd99414cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.218+0000 7fd993fff640 1 -- 172.21.15.94:0/1264097734 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd99414c5b0 con 0x7fd994074100 2024-04-25T12:24:43.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.218+0000 7fd993fff640 1 --2- 172.21.15.94:0/1264097734 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd994074100 0x7fd9941496c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd98c001950 tx=0x7fd98c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:43.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.218+0000 7fd990ff9640 1 -- 172.21.15.94:0/1264097734 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98c012400 con 0x7fd994074100 2024-04-25T12:24:43.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.218+0000 7fd990ff9640 1 -- 172.21.15.94:0/1264097734 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd98c0125c0 con 0x7fd994074100 2024-04-25T12:24:43.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.218+0000 7fd99a8bb640 1 -- 172.21.15.94:0/1264097734 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd99415d170 con 0x7fd994074100 2024-04-25T12:24:43.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.218+0000 7fd990ff9640 1 -- 172.21.15.94:0/1264097734 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98c0129b0 con 0x7fd994074100 2024-04-25T12:24:43.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.218+0000 7fd99a8bb640 1 -- 172.21.15.94:0/1264097734 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9941f6140 con 0x7fd994074100 2024-04-25T12:24:43.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.218+0000 7fd99a8bb640 1 -- 172.21.15.94:0/1264097734 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd994075df0 con 0x7fd994074100 2024-04-25T12:24:43.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.218+0000 7fd990ff9640 1 -- 172.21.15.94:0/1264097734 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd98c012b50 con 0x7fd994074100 2024-04-25T12:24:43.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.218+0000 7fd990ff9640 1 --2- 172.21.15.94:0/1264097734 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd974068380 0x7fd97406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:43.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.218+0000 7fd990ff9640 1 -- 172.21.15.94:0/1264097734 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fd98c0875d0 con 0x7fd994074100 2024-04-25T12:24:43.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.218+0000 7fd9937fe640 1 --2- 172.21.15.94:0/1264097734 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd974068380 0x7fd97406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:43.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.218+0000 7fd9937fe640 1 --2- 172.21.15.94:0/1264097734 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd974068380 0x7fd97406a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd994149c00 tx=0x7fd97c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:43.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.222+0000 7fd990ff9640 1 -- 172.21.15.94:0/1264097734 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd98c057830 con 0x7fd994074100 2024-04-25T12:24:43.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.422+0000 7fd99a8bb640 1 -- 172.21.15.94:0/1264097734 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd994149c50 con 0x7fd994074100 2024-04-25T12:24:43.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.422+0000 7fd990ff9640 1 -- 172.21.15.94:0/1264097734 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6917 (secure 0 0 0) 0x7fd98c057130 con 0x7fd994074100 2024-04-25T12:24:43.427 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:43.427 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6838/1468945344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6835","nonce":1468945344},{"type":"v1","addr":"172.21.15.94:6838","nonce":1468945344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T12:21:53.517464+0000","modified":"2024-04-25T12:24:38.902153+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4285,"mds_1":4276,"mds_2":4254,"mds_3":4229,"mds_4":4223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4223":{"gid":4223,"name":"e","rank":4,"incarnation":18,"state":"up:creating","state_seq":1,"addr":"172.21.15.94:6839/3773379365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":3773379365},{"type":"v1","addr":"172.21.15.94:6839","nonce":3773379365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4229":{"gid":4229,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":44,"addr":"172.21.15.111:6835/3463503555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3463503555},{"type":"v1","addr":"172.21.15.111:6835","nonce":3463503555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4254":{"gid":4254,"name":"a","rank":2,"incarnation":14,"state":"up:active","state_seq":43,"addr":"172.21.15.94:6837/1182495659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1182495659},{"type":"v1","addr":"172.21.15.94:6837","nonce":1182495659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":41,"addr":"172.21.15.111:6833/2332499082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":2332499082},{"type":"v1","addr":"172.21.15.111:6833","nonce":2332499082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.111:6837/3560813143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":3560813143},{"type":"v1","addr":"172.21.15.111:6837","nonce":3560813143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285,4276,4254,4229]},"id":1}]} 2024-04-25T12:24:43.428 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 18 2024-04-25T12:24:43.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.426+0000 7fd99a8bb640 1 -- 172.21.15.94:0/1264097734 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd974068380 msgr2=0x7fd97406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:43.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.426+0000 7fd99a8bb640 1 --2- 172.21.15.94:0/1264097734 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd974068380 0x7fd97406a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd994149c00 tx=0x7fd97c009190 comp rx=0 tx=0).stop 2024-04-25T12:24:43.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.426+0000 7fd99a8bb640 1 -- 172.21.15.94:0/1264097734 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd994074100 msgr2=0x7fd9941496c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:43.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.426+0000 7fd99a8bb640 1 --2- 172.21.15.94:0/1264097734 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd994074100 0x7fd9941496c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd98c001950 tx=0x7fd98c00a430 comp rx=0 tx=0).stop 2024-04-25T12:24:43.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.426+0000 7fd99a8bb640 1 -- 172.21.15.94:0/1264097734 shutdown_connections 2024-04-25T12:24:43.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.426+0000 7fd99a8bb640 1 --2- 172.21.15.94:0/1264097734 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd974068380 0x7fd97406a840 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.426+0000 7fd99a8bb640 1 --2- 172.21.15.94:0/1264097734 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd99414fbc0 0x7fd99414ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.426+0000 7fd99a8bb640 1 --2- 172.21.15.94:0/1264097734 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd99414ffa0 0x7fd99414cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.426+0000 7fd99a8bb640 1 --2- 172.21.15.94:0/1264097734 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd994074100 0x7fd9941496c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.426+0000 7fd99a8bb640 1 -- 172.21.15.94:0/1264097734 >> 172.21.15.94:0/1264097734 conn(0x7fd99406b9d0 msgr2=0x7fd994143f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:43.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.426+0000 7fd99a8bb640 1 -- 172.21.15.94:0/1264097734 shutdown_connections 2024-04-25T12:24:43.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.426+0000 7fd99a8bb640 1 -- 172.21.15.94:0/1264097734 wait complete. 2024-04-25T12:24:43.447 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:24:43.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.546+0000 7f1cd76ed640 1 Processor -- start 2024-04-25T12:24:43.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.546+0000 7f1cd76ed640 1 -- start start 2024-04-25T12:24:43.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.546+0000 7f1cd76ed640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1cd00c8250 0x7f1cd00c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:43.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.546+0000 7f1cd76ed640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f1cd00c8a70 0x7f1cd0152250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:43.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.546+0000 7f1cd76ed640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cd015b740 con 0x7f1cd00c8630 2024-04-25T12:24:43.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.546+0000 7f1cd76ed640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f1cd00c6490 con 0x7f1cd00c8a70 2024-04-25T12:24:43.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.546+0000 7f1cd76ed640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f1cd00c58c0 con 0x7f1cd00c8250 2024-04-25T12:24:43.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.550+0000 7f1cd5489640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1cd00c8250 0x7f1cd00c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:43.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.550+0000 7f1cd5c8a640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f1cd00c8a70 0x7f1cd0152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:43.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.550+0000 7f1cd4c88640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f1cd00c8630 0x7f1cd0151b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.94:42430/0 (socket says 172.21.15.94:42430) 2024-04-25T12:24:43.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.550+0000 7f1cd4c88640 1 -- 172.21.15.94:0/477044374 learned_addr learned my addr 172.21.15.94:0/477044374 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:43.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.550+0000 7f1cc7fff640 1 -- 172.21.15.94:0/477044374 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2978617329 0 0) 0x7f1cd015b740 con 0x7f1cd00c8630 2024-04-25T12:24:43.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.550+0000 7f1cc7fff640 1 -- 172.21.15.94:0/477044374 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cbc005740 con 0x7f1cd00c8630 2024-04-25T12:24:43.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.550+0000 7f1cd5489640 1 -- 172.21.15.94:0/477044374 >> v2:172.21.15.111:3300/0 conn(0x7f1cd00c8a70 msgr2=0x7f1cd0152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:43.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.550+0000 7f1cd5489640 1 --2- 172.21.15.94:0/477044374 >> v2:172.21.15.111:3300/0 conn(0x7f1cd00c8a70 0x7f1cd0152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.550+0000 7f1cd5489640 1 -- 172.21.15.94:0/477044374 >> v1:172.21.15.111:6789/0 conn(0x7f1cd00c8630 legacy=0x7f1cd0151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:43.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.550+0000 7f1cd5489640 1 -- 172.21.15.94:0/477044374 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cd00c5b60 con 0x7f1cd00c8250 2024-04-25T12:24:43.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.550+0000 7f1cd5489640 1 --2- 172.21.15.94:0/477044374 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1cd00c8250 0x7f1cd00c39e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1cc00097f0 tx=0x7f1cc001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e058df96541e1b9e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:43.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.550+0000 7f1cc7fff640 1 -- 172.21.15.94:0/477044374 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc00b0070 con 0x7f1cd00c8250 2024-04-25T12:24:43.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.550+0000 7f1cc7fff640 1 -- 172.21.15.94:0/477044374 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cc00ab600 con 0x7f1cd00c8250 2024-04-25T12:24:43.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.550+0000 7f1cc7fff640 1 -- 172.21.15.94:0/477044374 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc00ab9b0 con 0x7f1cd00c8250 2024-04-25T12:24:43.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.550+0000 7f1cd76ed640 1 -- 172.21.15.94:0/477044374 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1cd00c8250 msgr2=0x7f1cd00c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:43.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.550+0000 7f1cd76ed640 1 --2- 172.21.15.94:0/477044374 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1cd00c8250 0x7f1cd00c39e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1cc00097f0 tx=0x7f1cc001c410 comp rx=0 tx=0).stop 2024-04-25T12:24:43.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd76ed640 1 -- 172.21.15.94:0/477044374 shutdown_connections 2024-04-25T12:24:43.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd76ed640 1 --2- 172.21.15.94:0/477044374 >> v2:172.21.15.111:3300/0 conn(0x7f1cd00c8a70 0x7f1cd0152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd76ed640 1 --2- 172.21.15.94:0/477044374 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1cd00c8250 0x7f1cd00c39e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd76ed640 1 -- 172.21.15.94:0/477044374 >> 172.21.15.94:0/477044374 conn(0x7f1cd006b9d0 msgr2=0x7f1cd006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:43.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd76ed640 1 -- 172.21.15.94:0/477044374 shutdown_connections 2024-04-25T12:24:43.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd76ed640 1 -- 172.21.15.94:0/477044374 wait complete. 2024-04-25T12:24:43.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd76ed640 1 Processor -- start 2024-04-25T12:24:43.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd76ed640 1 -- start start 2024-04-25T12:24:43.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd76ed640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1cd00c8250 0x7f1cd00cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:43.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd76ed640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1cd00c8630 0x7f1cd01f3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:43.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd76ed640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1cd00c8a70 0x7f1cd013d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:43.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd76ed640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd00c6920 con 0x7f1cd00c8a70 2024-04-25T12:24:43.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd76ed640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd015b400 con 0x7f1cd00c8630 2024-04-25T12:24:43.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd76ed640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f1cd00681d0 con 0x7f1cd00c8250 2024-04-25T12:24:43.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd5c8a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1cd00c8a70 0x7f1cd013d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:43.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd5c8a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1cd00c8a70 0x7f1cd013d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56846/0 (socket says 172.21.15.94:56846) 2024-04-25T12:24:43.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd5c8a640 1 -- 172.21.15.94:0/3020193704 learned_addr learned my addr 172.21.15.94:0/3020193704 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:43.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd5489640 1 --2- 172.21.15.94:0/3020193704 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1cd00c8250 0x7f1cd00cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:43.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd4c88640 1 --2- 172.21.15.94:0/3020193704 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1cd00c8630 0x7f1cd01f3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:43.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd5c8a640 1 -- 172.21.15.94:0/3020193704 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1cd00c8250 msgr2=0x7f1cd00cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:43.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd5c8a640 1 --2- 172.21.15.94:0/3020193704 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1cd00c8250 0x7f1cd00cb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd5c8a640 1 -- 172.21.15.94:0/3020193704 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1cd00c8630 msgr2=0x7f1cd01f3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:43.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd5c8a640 1 --2- 172.21.15.94:0/3020193704 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1cd00c8630 0x7f1cd01f3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd5c8a640 1 -- 172.21.15.94:0/3020193704 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cd013e780 con 0x7f1cd00c8a70 2024-04-25T12:24:43.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd5c8a640 1 --2- 172.21.15.94:0/3020193704 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1cd00c8a70 0x7f1cd013d900 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800efc0 tx=0x7f1cc800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:43.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cc5ffb640 1 -- 172.21.15.94:0/3020193704 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc8018020 con 0x7f1cd00c8a70 2024-04-25T12:24:43.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cc5ffb640 1 -- 172.21.15.94:0/3020193704 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cc8014480 con 0x7f1cd00c8a70 2024-04-25T12:24:43.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cc5ffb640 1 -- 172.21.15.94:0/3020193704 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc8014870 con 0x7f1cd00c8a70 2024-04-25T12:24:43.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd76ed640 1 -- 172.21.15.94:0/3020193704 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cd0152940 con 0x7f1cd00c8a70 2024-04-25T12:24:43.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd76ed640 1 -- 172.21.15.94:0/3020193704 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cd0152f00 con 0x7f1cd00c8a70 2024-04-25T12:24:43.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.554+0000 7f1cd76ed640 1 -- 172.21.15.94:0/3020193704 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cd0075df0 con 0x7f1cd00c8a70 2024-04-25T12:24:43.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.558+0000 7f1cc5ffb640 1 -- 172.21.15.94:0/3020193704 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1cc801b020 con 0x7f1cd00c8a70 2024-04-25T12:24:43.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.558+0000 7f1cc5ffb640 1 --2- 172.21.15.94:0/3020193704 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f1cb40683b0 0x7f1cb406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:43.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.558+0000 7f1cd5489640 1 --2- 172.21.15.94:0/3020193704 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f1cb40683b0 0x7f1cb406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:43.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.558+0000 7f1cc5ffb640 1 -- 172.21.15.94:0/3020193704 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f1cc8087a70 con 0x7f1cd00c8a70 2024-04-25T12:24:43.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.558+0000 7f1cd5489640 1 --2- 172.21.15.94:0/3020193704 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f1cb40683b0 0x7f1cb406a870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1cc00ad000 tx=0x7f1cc00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:43.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.562+0000 7f1cc5ffb640 1 -- 172.21.15.94:0/3020193704 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1cc8022030 con 0x7f1cd00c8a70 2024-04-25T12:24:43.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.710+0000 7f1cd76ed640 1 -- 172.21.15.94:0/3020193704 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1cd0071e50 con 0x7f1cd00c8a70 2024-04-25T12:24:43.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.714+0000 7f1cc5ffb640 1 -- 172.21.15.94:0/3020193704 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18873 (secure 0 0 0) 0x7f1cc8010040 con 0x7f1cd00c8a70 2024-04-25T12:24:43.718 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:43.719 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"7059a9e2-aec4-4b84-b942-caf531e15da3","created":"2024-04-25T12:21:29.118508+0000","modified":"2024-04-25T12:22:34.871807+0000","last_up_change":"2024-04-25T12:21:40.912605+0000","last_in_change":"2024-04-25T12:21:31.372905+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:39.781011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:51.465886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:52.470540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:56.209936+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"640a65ef-0734-468a-a8f5-9ed70cf75c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6809","nonce":2553247564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6811","nonce":2553247564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6815","nonce":2553247564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6813","nonce":2553247564}]},"public_addr":"172.21.15.94:6809/2553247564","cluster_addr":"172.21.15.94:6811/2553247564","heartbeat_back_addr":"172.21.15.94:6815/2553247564","heartbeat_front_addr":"172.21.15.94:6813/2553247564","state":["exists","up"]},{"osd":1,"uuid":"d6e886e6-c8c1-4761-9a4c-abc6961c7c81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6818","nonce":2492806478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6822","nonce":2492806478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6830","nonce":2492806478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6826","nonce":2492806478}]},"public_addr":"172.21.15.94:6818/2492806478","cluster_addr":"172.21.15.94:6822/2492806478","heartbeat_back_addr":"172.21.15.94:6830/2492806478","heartbeat_front_addr":"172.21.15.94:6826/2492806478","state":["exists","up"]},{"osd":2,"uuid":"ba20f409-ed46-43b6-b16d-43dc4622c042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6801","nonce":1485061290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6803","nonce":1485061290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6807","nonce":1485061290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6805","nonce":1485061290}]},"public_addr":"172.21.15.94:6801/1485061290","cluster_addr":"172.21.15.94:6803/1485061290","heartbeat_back_addr":"172.21.15.94:6807/1485061290","heartbeat_front_addr":"172.21.15.94:6805/1485061290","state":["exists","up"]},{"osd":3,"uuid":"85816a2b-3a3f-4ec8-8373-8230d948396f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6819","nonce":1548488434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6823","nonce":1548488434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6829","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6831","nonce":1548488434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6827","nonce":1548488434}]},"public_addr":"172.21.15.94:6819/1548488434","cluster_addr":"172.21.15.94:6823/1548488434","heartbeat_back_addr":"172.21.15.94:6831/1548488434","heartbeat_front_addr":"172.21.15.94:6827/1548488434","state":["exists","up"]},{"osd":4,"uuid":"b4a953b7-01d6-4623-9324-63135fdaf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6811","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6814","nonce":4070977083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6817","nonce":4070977083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6823","nonce":4070977083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6819","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6821","nonce":4070977083}]},"public_addr":"172.21.15.111:6814/4070977083","cluster_addr":"172.21.15.111:6817/4070977083","heartbeat_back_addr":"172.21.15.111:6823/4070977083","heartbeat_front_addr":"172.21.15.111:6821/4070977083","state":["exists","up"]},{"osd":5,"uuid":"c0acc514-427d-41bf-a965-b8463cebf045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6803","nonce":1054925605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6809","nonce":1054925605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6820","nonce":1054925605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6815","nonce":1054925605}]},"public_addr":"172.21.15.111:6803/1054925605","cluster_addr":"172.21.15.111:6809/1054925605","heartbeat_back_addr":"172.21.15.111:6820/1054925605","heartbeat_front_addr":"172.21.15.111:6815/1054925605","state":["exists","up"]},{"osd":6,"uuid":"26ff742f-5a57-44a7-a095-f04d6e87f885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6825","nonce":3619235078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6827","nonce":3619235078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6831","nonce":3619235078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6829","nonce":3619235078}]},"public_addr":"172.21.15.111:6825/3619235078","cluster_addr":"172.21.15.111:6827/3619235078","heartbeat_back_addr":"172.21.15.111:6831/3619235078","heartbeat_front_addr":"172.21.15.111:6829/3619235078","state":["exists","up"]},{"osd":7,"uuid":"9c214cba-693a-4b25-aad7-05a5b0006e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6801","nonce":558758517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6805","nonce":558758517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6813","nonce":558758517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6807","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6808","nonce":558758517}]},"public_addr":"172.21.15.111:6801/558758517","cluster_addr":"172.21.15.111:6805/558758517","heartbeat_back_addr":"172.21.15.111:6813/558758517","heartbeat_front_addr":"172.21.15.111:6808/558758517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.664958+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.853375+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.654455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:37.033852+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.968691+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.856013+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.913496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.848565+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:24:43.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.714+0000 7f1cd76ed640 1 -- 172.21.15.94:0/3020193704 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f1cb40683b0 msgr2=0x7f1cb406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:43.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.714+0000 7f1cd76ed640 1 --2- 172.21.15.94:0/3020193704 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f1cb40683b0 0x7f1cb406a870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1cc00ad000 tx=0x7f1cc00a6000 comp rx=0 tx=0).stop 2024-04-25T12:24:43.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.714+0000 7f1cd76ed640 1 -- 172.21.15.94:0/3020193704 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1cd00c8a70 msgr2=0x7f1cd013d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:43.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.714+0000 7f1cd76ed640 1 --2- 172.21.15.94:0/3020193704 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1cd00c8a70 0x7f1cd013d900 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800efc0 tx=0x7f1cc800c490 comp rx=0 tx=0).stop 2024-04-25T12:24:43.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.714+0000 7f1cd76ed640 1 -- 172.21.15.94:0/3020193704 shutdown_connections 2024-04-25T12:24:43.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.714+0000 7f1cd76ed640 1 --2- 172.21.15.94:0/3020193704 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f1cb40683b0 0x7f1cb406a870 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.714+0000 7f1cd76ed640 1 --2- 172.21.15.94:0/3020193704 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1cd00c8a70 0x7f1cd013d900 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.714+0000 7f1cd76ed640 1 --2- 172.21.15.94:0/3020193704 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1cd00c8630 0x7f1cd01f3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.714+0000 7f1cd76ed640 1 --2- 172.21.15.94:0/3020193704 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1cd00c8250 0x7f1cd00cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.714+0000 7f1cd76ed640 1 -- 172.21.15.94:0/3020193704 >> 172.21.15.94:0/3020193704 conn(0x7f1cd006b9d0 msgr2=0x7f1cd0141170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:43.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.714+0000 7f1cd76ed640 1 -- 172.21.15.94:0/3020193704 shutdown_connections 2024-04-25T12:24:43.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.714+0000 7f1cd76ed640 1 -- 172.21.15.94:0/3020193704 wait complete. 2024-04-25T12:24:43.736 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T12:21:39.781011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T12:21:51.465886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T12:21:52.470540+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T12:21:56.209936+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T12:24:43.737 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T12:24:43.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.846+0000 7fc0d2527640 1 Processor -- start 2024-04-25T12:24:43.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.846+0000 7fc0d2527640 1 -- start start 2024-04-25T12:24:43.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.846+0000 7fc0d2527640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc0cc0c8800 0x7fc0cc0c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:43.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.846+0000 7fc0d2527640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc0cc0c5e90 0x7fc0cc0c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:43.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.846+0000 7fc0d2527640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0cc0c8be0 con 0x7fc0cc0c4b40 2024-04-25T12:24:43.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.846+0000 7fc0d2527640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc0cc158090 con 0x7fc0cc0c5e90 2024-04-25T12:24:43.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.846+0000 7fc0d2527640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fc0cc1585c0 con 0x7fc0cc0c8800 2024-04-25T12:24:43.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.846+0000 7fc0d0ac4640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc0cc0c5e90 0x7fc0cc0c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:43.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.846+0000 7fc0cb7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc0cc0c4b40 0x7fc0cc0c5780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50198/0 (socket says 172.21.15.94:50198) 2024-04-25T12:24:43.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.846+0000 7fc0cb7fe640 1 -- 172.21.15.94:0/1180254982 learned_addr learned my addr 172.21.15.94:0/1180254982 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:43.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.846+0000 7fc0cbfff640 1 --2- 172.21.15.94:0/1180254982 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc0cc0c8800 0x7fc0cc0c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:43.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.846+0000 7fc0d0ac4640 1 -- 172.21.15.94:0/1180254982 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc0cc0c8800 msgr2=0x7fc0cc0c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:43.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.846+0000 7fc0d0ac4640 1 --2- 172.21.15.94:0/1180254982 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc0cc0c8800 0x7fc0cc0c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.846+0000 7fc0d0ac4640 1 -- 172.21.15.94:0/1180254982 >> v1:172.21.15.94:6789/0 conn(0x7fc0cc0c4b40 legacy=0x7fc0cc0c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:43.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.846+0000 7fc0d0ac4640 1 -- 172.21.15.94:0/1180254982 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0cc0c4790 con 0x7fc0cc0c5e90 2024-04-25T12:24:43.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.846+0000 7fc0caffd640 1 -- 172.21.15.94:0/1180254982 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1531946135 0 0) 0x7fc0cc0c8be0 con 0x7fc0cc0c4b40 2024-04-25T12:24:43.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d0ac4640 1 --2- 172.21.15.94:0/1180254982 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0cc0c5e90 0x7fc0cc0c3f20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4009d90 tx=0x7fc0c401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e30bd5acafcfffc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:43.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0caffd640 1 -- 172.21.15.94:0/1180254982 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c40ac070 con 0x7fc0cc0c5e90 2024-04-25T12:24:43.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0caffd640 1 -- 172.21.15.94:0/1180254982 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0c40a66a0 con 0x7fc0cc0c5e90 2024-04-25T12:24:43.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0caffd640 1 -- 172.21.15.94:0/1180254982 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c40a6a70 con 0x7fc0cc0c5e90 2024-04-25T12:24:43.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d2527640 1 -- 172.21.15.94:0/1180254982 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0cc0c5e90 msgr2=0x7fc0cc0c3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:43.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d2527640 1 --2- 172.21.15.94:0/1180254982 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0cc0c5e90 0x7fc0cc0c3f20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4009d90 tx=0x7fc0c401c850 comp rx=0 tx=0).stop 2024-04-25T12:24:43.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d2527640 1 -- 172.21.15.94:0/1180254982 shutdown_connections 2024-04-25T12:24:43.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d2527640 1 --2- 172.21.15.94:0/1180254982 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0cc0c5e90 0x7fc0cc0c3f20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d2527640 1 --2- 172.21.15.94:0/1180254982 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc0cc0c8800 0x7fc0cc0c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d2527640 1 -- 172.21.15.94:0/1180254982 >> 172.21.15.94:0/1180254982 conn(0x7fc0cc06b9d0 msgr2=0x7fc0cc06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:43.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d2527640 1 -- 172.21.15.94:0/1180254982 shutdown_connections 2024-04-25T12:24:43.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d2527640 1 -- 172.21.15.94:0/1180254982 wait complete. 2024-04-25T12:24:43.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d2527640 1 Processor -- start 2024-04-25T12:24:43.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d2527640 1 -- start start 2024-04-25T12:24:43.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d2527640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0cc0c4b40 0x7fc0cc164bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:43.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d2527640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc0cc0c5e90 0x7fc0cc14c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:43.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d2527640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0cc0c8800 0x7fc0cc14c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:43.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d2527640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc068790 con 0x7fc0cc0c8800 2024-04-25T12:24:43.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d2527640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc068610 con 0x7fc0cc0c4b40 2024-04-25T12:24:43.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d2527640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fc0cc0681d0 con 0x7fc0cc0c5e90 2024-04-25T12:24:43.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d0ac4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0cc0c8800 0x7fc0cc14c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:43.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d0ac4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0cc0c8800 0x7fc0cc14c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56862/0 (socket says 172.21.15.94:56862) 2024-04-25T12:24:43.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d0ac4640 1 -- 172.21.15.94:0/452219153 learned_addr learned my addr 172.21.15.94:0/452219153 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:43.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0cbfff640 1 --2- 172.21.15.94:0/452219153 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0cc0c4b40 0x7fc0cc164bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:43.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0cb7fe640 1 --2- 172.21.15.94:0/452219153 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc0cc0c5e90 0x7fc0cc14c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:43.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d0ac4640 1 -- 172.21.15.94:0/452219153 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc0cc0c5e90 msgr2=0x7fc0cc14c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:43.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d0ac4640 1 --2- 172.21.15.94:0/452219153 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc0cc0c5e90 0x7fc0cc14c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d0ac4640 1 -- 172.21.15.94:0/452219153 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0cc0c4b40 msgr2=0x7fc0cc164bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:43.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d0ac4640 1 --2- 172.21.15.94:0/452219153 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0cc0c4b40 0x7fc0cc164bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:43.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d0ac4640 1 -- 172.21.15.94:0/452219153 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0cc1651c0 con 0x7fc0cc0c8800 2024-04-25T12:24:43.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0cbfff640 1 --2- 172.21.15.94:0/452219153 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0cc0c4b40 0x7fc0cc164bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:43.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0cb7fe640 1 --2- 172.21.15.94:0/452219153 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc0cc0c5e90 0x7fc0cc14c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:43.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d0ac4640 1 --2- 172.21.15.94:0/452219153 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0cc0c8800 0x7fc0cc14c990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc0c401af00 tx=0x7fc0c40195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:43.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0c8ff9640 1 -- 172.21.15.94:0/452219153 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c40ac070 con 0x7fc0cc0c8800 2024-04-25T12:24:43.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0c8ff9640 1 -- 172.21.15.94:0/452219153 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0c40a7690 con 0x7fc0cc0c8800 2024-04-25T12:24:43.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d2527640 1 -- 172.21.15.94:0/452219153 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0cc1654a0 con 0x7fc0cc0c8800 2024-04-25T12:24:43.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0c8ff9640 1 -- 172.21.15.94:0/452219153 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c40a7a60 con 0x7fc0cc0c8800 2024-04-25T12:24:43.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.850+0000 7fc0d2527640 1 -- 172.21.15.94:0/452219153 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0cc14bc50 con 0x7fc0cc0c8800 2024-04-25T12:24:43.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.854+0000 7fc0d2527640 1 -- 172.21.15.94:0/452219153 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0cc075df0 con 0x7fc0cc0c8800 2024-04-25T12:24:43.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.854+0000 7fc0c8ff9640 1 -- 172.21.15.94:0/452219153 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc0c40af070 con 0x7fc0cc0c8800 2024-04-25T12:24:43.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.854+0000 7fc0c8ff9640 1 --2- 172.21.15.94:0/452219153 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc0b80683b0 0x7fc0b806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:43.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.854+0000 7fc0c8ff9640 1 -- 172.21.15.94:0/452219153 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fc0c4121130 con 0x7fc0cc0c8800 2024-04-25T12:24:43.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.854+0000 7fc0cbfff640 1 --2- 172.21.15.94:0/452219153 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc0b80683b0 0x7fc0b806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:43.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.854+0000 7fc0cbfff640 1 --2- 172.21.15.94:0/452219153 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc0b80683b0 0x7fc0b806a870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc0097a0 tx=0x7fc0bc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:43.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:43.858+0000 7fc0c8ff9640 1 -- 172.21.15.94:0/452219153 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc0c4016560 con 0x7fc0cc0c8800 2024-04-25T12:24:44.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.018+0000 7fc0d2527640 1 -- 172.21.15.94:0/452219153 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc0cc14bf60 con 0x7fc0cc0c8800 2024-04-25T12:24:44.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.018+0000 7fc0c8ff9640 1 -- 172.21.15.94:0/452219153 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7fc0c40b0e90 con 0x7fc0cc0c8800 2024-04-25T12:24:44.025 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2024-04-25T12:24:44.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.022+0000 7fc0d2527640 1 -- 172.21.15.94:0/452219153 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc0b80683b0 msgr2=0x7fc0b806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:44.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.022+0000 7fc0d2527640 1 --2- 172.21.15.94:0/452219153 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc0b80683b0 0x7fc0b806a870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc0097a0 tx=0x7fc0bc008040 comp rx=0 tx=0).stop 2024-04-25T12:24:44.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.022+0000 7fc0d2527640 1 -- 172.21.15.94:0/452219153 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0cc0c8800 msgr2=0x7fc0cc14c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:44.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.022+0000 7fc0d2527640 1 --2- 172.21.15.94:0/452219153 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0cc0c8800 0x7fc0cc14c990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc0c401af00 tx=0x7fc0c40195f0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.022+0000 7fc0d2527640 1 -- 172.21.15.94:0/452219153 shutdown_connections 2024-04-25T12:24:44.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.022+0000 7fc0d2527640 1 --2- 172.21.15.94:0/452219153 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc0b80683b0 0x7fc0b806a870 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.022+0000 7fc0d2527640 1 --2- 172.21.15.94:0/452219153 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc0cc0c5e90 0x7fc0cc14c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.022+0000 7fc0d2527640 1 --2- 172.21.15.94:0/452219153 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0cc0c8800 0x7fc0cc14c990 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.022+0000 7fc0d2527640 1 --2- 172.21.15.94:0/452219153 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0cc0c4b40 0x7fc0cc164bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.022+0000 7fc0d2527640 1 -- 172.21.15.94:0/452219153 >> 172.21.15.94:0/452219153 conn(0x7fc0cc06b9d0 msgr2=0x7fc0cc0cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:44.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.022+0000 7fc0d2527640 1 -- 172.21.15.94:0/452219153 shutdown_connections 2024-04-25T12:24:44.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.022+0000 7fc0d2527640 1 -- 172.21.15.94:0/452219153 wait complete. 2024-04-25T12:24:44.043 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T12:24:44.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.158+0000 7f315abff640 1 Processor -- start 2024-04-25T12:24:44.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.162+0000 7f315abff640 1 -- start start 2024-04-25T12:24:44.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.162+0000 7f315abff640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f31540c8250 0x7f31540c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:44.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.162+0000 7f315abff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f31540c8a70 0x7f3154152250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:44.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.162+0000 7f315abff640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f315415b740 con 0x7f31540c8630 2024-04-25T12:24:44.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.162+0000 7f315abff640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f31540c6490 con 0x7f31540c8a70 2024-04-25T12:24:44.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.162+0000 7f315abff640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f31540c58c0 con 0x7f31540c8250 2024-04-25T12:24:44.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.162+0000 7f315919c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f31540c8a70 0x7f3154152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:44.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.162+0000 7f315919c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f31540c8a70 0x7f3154152250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56868/0 (socket says 172.21.15.94:56868) 2024-04-25T12:24:44.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.162+0000 7f315919c640 1 -- 172.21.15.94:0/4124763380 learned_addr learned my addr 172.21.15.94:0/4124763380 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:44.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.162+0000 7f315899b640 1 --2- 172.21.15.94:0/4124763380 >> v2:172.21.15.111:3300/0 conn(0x7f31540c8250 0x7f31540c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:44.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.162+0000 7f315919c640 1 -- 172.21.15.94:0/4124763380 >> v2:172.21.15.111:3300/0 conn(0x7f31540c8250 msgr2=0x7f31540c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:44.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.162+0000 7f315919c640 1 --2- 172.21.15.94:0/4124763380 >> v2:172.21.15.111:3300/0 conn(0x7f31540c8250 0x7f31540c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.162+0000 7f315919c640 1 -- 172.21.15.94:0/4124763380 >> v1:172.21.15.111:6789/0 conn(0x7f31540c8630 legacy=0x7f3154151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:44.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.162+0000 7f315919c640 1 -- 172.21.15.94:0/4124763380 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31540c5b60 con 0x7f31540c8a70 2024-04-25T12:24:44.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.162+0000 7f315919c640 1 --2- 172.21.15.94:0/4124763380 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31540c8a70 0x7f3154152250 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f31540c6610 tx=0x7f314c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8c1f66489557c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:44.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.162+0000 7f31537fe640 1 -- 172.21.15.94:0/4124763380 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c0a5710 con 0x7f31540c8a70 2024-04-25T12:24:44.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.162+0000 7f31537fe640 1 -- 172.21.15.94:0/4124763380 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f314c0a58b0 con 0x7f31540c8a70 2024-04-25T12:24:44.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.162+0000 7f31537fe640 1 -- 172.21.15.94:0/4124763380 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c0a5c80 con 0x7f31540c8a70 2024-04-25T12:24:44.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315abff640 1 -- 172.21.15.94:0/4124763380 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31540c8a70 msgr2=0x7f3154152250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:44.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315abff640 1 --2- 172.21.15.94:0/4124763380 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31540c8a70 0x7f3154152250 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f31540c6610 tx=0x7f314c01c960 comp rx=0 tx=0).stop 2024-04-25T12:24:44.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315abff640 1 -- 172.21.15.94:0/4124763380 shutdown_connections 2024-04-25T12:24:44.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315abff640 1 --2- 172.21.15.94:0/4124763380 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31540c8a70 0x7f3154152250 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315abff640 1 --2- 172.21.15.94:0/4124763380 >> v2:172.21.15.111:3300/0 conn(0x7f31540c8250 0x7f31540c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315abff640 1 -- 172.21.15.94:0/4124763380 >> 172.21.15.94:0/4124763380 conn(0x7f315406b9d0 msgr2=0x7f315406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:44.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315abff640 1 -- 172.21.15.94:0/4124763380 shutdown_connections 2024-04-25T12:24:44.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315abff640 1 -- 172.21.15.94:0/4124763380 wait complete. 2024-04-25T12:24:44.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315abff640 1 Processor -- start 2024-04-25T12:24:44.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315abff640 1 -- start start 2024-04-25T12:24:44.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315abff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31540c8250 0x7f3154150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:44.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315abff640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f31540c8630 0x7f31540caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:44.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315abff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31540c8a70 0x7f315413b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:44.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315abff640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f31540c6900 con 0x7f31540c8250 2024-04-25T12:24:44.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315abff640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f315415b400 con 0x7f31540c8a70 2024-04-25T12:24:44.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315abff640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f31540681d0 con 0x7f31540c8630 2024-04-25T12:24:44.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315899b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31540c8250 0x7f3154150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:44.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315899b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31540c8250 0x7f3154150240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56878/0 (socket says 172.21.15.94:56878) 2024-04-25T12:24:44.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315899b640 1 -- 172.21.15.94:0/835573953 learned_addr learned my addr 172.21.15.94:0/835573953 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:44.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315919c640 1 --2- 172.21.15.94:0/835573953 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31540c8a70 0x7f315413b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:44.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f3153fff640 1 --2- 172.21.15.94:0/835573953 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f31540c8630 0x7f31540caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:44.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315899b640 1 -- 172.21.15.94:0/835573953 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f31540c8630 msgr2=0x7f31540caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:44.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315899b640 1 --2- 172.21.15.94:0/835573953 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f31540c8630 0x7f31540caed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315899b640 1 -- 172.21.15.94:0/835573953 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31540c8a70 msgr2=0x7f315413b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:44.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315899b640 1 --2- 172.21.15.94:0/835573953 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31540c8a70 0x7f315413b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315899b640 1 -- 172.21.15.94:0/835573953 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315413a350 con 0x7f31540c8250 2024-04-25T12:24:44.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315899b640 1 --2- 172.21.15.94:0/835573953 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31540c8250 0x7f3154150240 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f314800d830 tx=0x7f314800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:44.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f31517fa640 1 -- 172.21.15.94:0/835573953 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314800b660 con 0x7f31540c8250 2024-04-25T12:24:44.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f31517fa640 1 -- 172.21.15.94:0/835573953 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3148019070 con 0x7f31540c8250 2024-04-25T12:24:44.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315abff640 1 -- 172.21.15.94:0/835573953 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f315414f8a0 con 0x7f31540c8250 2024-04-25T12:24:44.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f31517fa640 1 -- 172.21.15.94:0/835573953 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314800ba00 con 0x7f31540c8250 2024-04-25T12:24:44.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.166+0000 7f315abff640 1 -- 172.21.15.94:0/835573953 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31541543d0 con 0x7f31540c8250 2024-04-25T12:24:44.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.170+0000 7f315abff640 1 -- 172.21.15.94:0/835573953 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3154075df0 con 0x7f31540c8250 2024-04-25T12:24:44.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.170+0000 7f31517fa640 1 -- 172.21.15.94:0/835573953 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f314801e460 con 0x7f31540c8250 2024-04-25T12:24:44.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.170+0000 7f31517fa640 1 --2- 172.21.15.94:0/835573953 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f3138068380 0x7f313806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:44.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.170+0000 7f31517fa640 1 -- 172.21.15.94:0/835573953 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f3148087410 con 0x7f31540c8250 2024-04-25T12:24:44.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.170+0000 7f3153fff640 1 --2- 172.21.15.94:0/835573953 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f3138068380 0x7f313806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:44.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.170+0000 7f3153fff640 1 --2- 172.21.15.94:0/835573953 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f3138068380 0x7f313806a840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3140007fd0 tx=0x7f3140009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:44.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.174+0000 7f31517fa640 1 -- 172.21.15.94:0/835573953 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f31480575e0 con 0x7f31540c8250 2024-04-25T12:24:44.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.334+0000 7f315abff640 1 -- 172.21.15.94:0/835573953 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f31540c5300 con 0x7f31540c8250 2024-04-25T12:24:44.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.334+0000 7f31517fa640 1 -- 172.21.15.94:0/835573953 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7f3148056ee0 con 0x7f31540c8250 2024-04-25T12:24:44.339 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2024-04-25T12:24:44.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.334+0000 7f315abff640 1 -- 172.21.15.94:0/835573953 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f3138068380 msgr2=0x7f313806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:44.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.334+0000 7f315abff640 1 --2- 172.21.15.94:0/835573953 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f3138068380 0x7f313806a840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3140007fd0 tx=0x7f3140009040 comp rx=0 tx=0).stop 2024-04-25T12:24:44.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.334+0000 7f315abff640 1 -- 172.21.15.94:0/835573953 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31540c8250 msgr2=0x7f3154150240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:44.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.334+0000 7f315abff640 1 --2- 172.21.15.94:0/835573953 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31540c8250 0x7f3154150240 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f314800d830 tx=0x7f314800dcf0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.334+0000 7f315abff640 1 -- 172.21.15.94:0/835573953 shutdown_connections 2024-04-25T12:24:44.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.334+0000 7f315abff640 1 --2- 172.21.15.94:0/835573953 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f3138068380 0x7f313806a840 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.334+0000 7f315abff640 1 --2- 172.21.15.94:0/835573953 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f31540c8630 0x7f31540caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.334+0000 7f315abff640 1 --2- 172.21.15.94:0/835573953 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31540c8a70 0x7f315413b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.334+0000 7f315abff640 1 --2- 172.21.15.94:0/835573953 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31540c8250 0x7f3154150240 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.334+0000 7f315abff640 1 -- 172.21.15.94:0/835573953 >> 172.21.15.94:0/835573953 conn(0x7f315406b9d0 msgr2=0x7f315406bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:44.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.334+0000 7f315abff640 1 -- 172.21.15.94:0/835573953 shutdown_connections 2024-04-25T12:24:44.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.334+0000 7f315abff640 1 -- 172.21.15.94:0/835573953 wait complete. 2024-04-25T12:24:44.357 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T12:24:44.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcbaa53a640 1 Processor -- start 2024-04-25T12:24:44.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcbaa53a640 1 -- start start 2024-04-25T12:24:44.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcbaa53a640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcba414fbc0 0x7fcba406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:44.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcbaa53a640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fcba4074100 0x7fcba40c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:44.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcbaa53a640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcba40c5d70 con 0x7fcba414ffa0 2024-04-25T12:24:44.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcbaa53a640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fcba40c6050 con 0x7fcba4074100 2024-04-25T12:24:44.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcbaa53a640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fcba40c6330 con 0x7fcba414fbc0 2024-04-25T12:24:44.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba37fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fcba414ffa0 0x7fcba40c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50204/0 (socket says 172.21.15.94:50204) 2024-04-25T12:24:44.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba37fe640 1 -- 172.21.15.94:0/1422324501 learned_addr learned my addr 172.21.15.94:0/1422324501 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:44.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba8ad7640 1 --2- 172.21.15.94:0/1422324501 >> v2:172.21.15.111:3300/0 conn(0x7fcba4074100 0x7fcba40c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:44.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba3fff640 1 --2- 172.21.15.94:0/1422324501 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcba414fbc0 0x7fcba406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:44.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba2ffd640 1 -- 172.21.15.94:0/1422324501 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2309239311 0 0) 0x7fcba40c5d70 con 0x7fcba414ffa0 2024-04-25T12:24:44.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba2ffd640 1 -- 172.21.15.94:0/1422324501 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb90003530 con 0x7fcba414ffa0 2024-04-25T12:24:44.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba2ffd640 1 -- 172.21.15.94:0/1422324501 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 737824436 0 0) 0x7fcb90003530 con 0x7fcba414ffa0 2024-04-25T12:24:44.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba2ffd640 1 -- 172.21.15.94:0/1422324501 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcba414fbc0 msgr2=0x7fcba406f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:44.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba2ffd640 1 --2- 172.21.15.94:0/1422324501 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcba414fbc0 0x7fcba406f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba2ffd640 1 -- 172.21.15.94:0/1422324501 >> v2:172.21.15.111:3300/0 conn(0x7fcba4074100 msgr2=0x7fcba40c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:44.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba2ffd640 1 --2- 172.21.15.94:0/1422324501 >> v2:172.21.15.111:3300/0 conn(0x7fcba4074100 0x7fcba40c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba2ffd640 1 -- 172.21.15.94:0/1422324501 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba40c6610 con 0x7fcba414ffa0 2024-04-25T12:24:44.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba2ffd640 1 -- 172.21.15.94:0/1422324501 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7fcb8c001680 con 0x7fcba414ffa0 2024-04-25T12:24:44.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba8ad7640 1 --2- 172.21.15.94:0/1422324501 >> v2:172.21.15.111:3300/0 conn(0x7fcba4074100 0x7fcba40c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:24:44.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba2ffd640 1 -- 172.21.15.94:0/1422324501 >> v1:172.21.15.94:6789/0 conn(0x7fcba414ffa0 legacy=0x7fcba40c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:44.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba2ffd640 1 --2- 172.21.15.94:0/1422324501 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcb900039c0 0x7fcb90003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:44.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba2ffd640 1 --2- 172.21.15.94:0/1422324501 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcba414fbc0 0x7fcb90004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:44.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba2ffd640 1 --2- 172.21.15.94:0/1422324501 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb90004d50 0x7fcb900051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:44.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba2ffd640 1 -- 172.21.15.94:0/1422324501 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fcba40c6050 con 0x7fcb900039c0 2024-04-25T12:24:44.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba2ffd640 1 -- 172.21.15.94:0/1422324501 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fcba40c6330 con 0x7fcb90004d50 2024-04-25T12:24:44.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba2ffd640 1 -- 172.21.15.94:0/1422324501 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fcb9000b9d0 con 0x7fcba414fbc0 2024-04-25T12:24:44.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba3fff640 1 --2- 172.21.15.94:0/1422324501 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcb900039c0 0x7fcb90003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:44.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba8ad7640 1 --2- 172.21.15.94:0/1422324501 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb90004d50 0x7fcb900051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:44.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba37fe640 1 --2- 172.21.15.94:0/1422324501 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcba414fbc0 0x7fcb90004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:44.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba3fff640 1 -- 172.21.15.94:0/1422324501 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcba414fbc0 msgr2=0x7fcb90004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:44.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba3fff640 1 --2- 172.21.15.94:0/1422324501 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcba414fbc0 0x7fcb90004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba3fff640 1 -- 172.21.15.94:0/1422324501 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb90004d50 msgr2=0x7fcb900051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:44.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba3fff640 1 --2- 172.21.15.94:0/1422324501 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb90004d50 0x7fcb900051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba3fff640 1 -- 172.21.15.94:0/1422324501 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb90003530 con 0x7fcb900039c0 2024-04-25T12:24:44.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.470+0000 7fcba37fe640 1 --2- 172.21.15.94:0/1422324501 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcba414fbc0 0x7fcb90004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:44.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.474+0000 7fcba3fff640 1 --2- 172.21.15.94:0/1422324501 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcb900039c0 0x7fcb90003de0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcb94009fa0 tx=0x7fcb9401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673cf5b7095d5e0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:44.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.474+0000 7fcba2ffd640 1 -- 172.21.15.94:0/1422324501 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb940b2070 con 0x7fcb900039c0 2024-04-25T12:24:44.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.474+0000 7fcba2ffd640 1 -- 172.21.15.94:0/1422324501 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb940a5d10 con 0x7fcb900039c0 2024-04-25T12:24:44.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.474+0000 7fcba2ffd640 1 -- 172.21.15.94:0/1422324501 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb94009bf0 con 0x7fcb900039c0 2024-04-25T12:24:44.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.474+0000 7fcbaa53a640 1 -- 172.21.15.94:0/1422324501 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcb900039c0 msgr2=0x7fcb90003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:44.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.474+0000 7fcbaa53a640 1 --2- 172.21.15.94:0/1422324501 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcb900039c0 0x7fcb90003de0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcb94009fa0 tx=0x7fcb9401cc40 comp rx=0 tx=0).stop 2024-04-25T12:24:44.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.474+0000 7fcba8ad7640 1 -- 172.21.15.94:0/1422324501 reap_dead start 2024-04-25T12:24:44.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.474+0000 7fcbaa53a640 1 -- 172.21.15.94:0/1422324501 shutdown_connections 2024-04-25T12:24:44.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.474+0000 7fcbaa53a640 1 -- 172.21.15.94:0/1422324501 >> 172.21.15.94:0/1422324501 conn(0x7fcba406b9d0 msgr2=0x7fcba406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:44.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.474+0000 7fcbaa53a640 1 -- 172.21.15.94:0/1422324501 shutdown_connections 2024-04-25T12:24:44.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.474+0000 7fcbaa53a640 1 -- 172.21.15.94:0/1422324501 wait complete. 2024-04-25T12:24:44.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.474+0000 7fcbaa53a640 1 Processor -- start 2024-04-25T12:24:44.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.474+0000 7fcbaa53a640 1 -- start start 2024-04-25T12:24:44.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.474+0000 7fcbaa53a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcb900039c0 0x7fcba41590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:44.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.474+0000 7fcbaa53a640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcba4072a90 0x7fcba41f4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:44.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.474+0000 7fcbaa53a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcba414bb20 0x7fcba413fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:44.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.474+0000 7fcbaa53a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fcba40c8930 con 0x7fcb900039c0 2024-04-25T12:24:44.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.474+0000 7fcbaa53a640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fcba406fb10 con 0x7fcba414bb20 2024-04-25T12:24:44.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.474+0000 7fcbaa53a640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fcba40c8ab0 con 0x7fcba4072a90 2024-04-25T12:24:44.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.478+0000 7fcba3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcb900039c0 0x7fcba41590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:44.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.478+0000 7fcba3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcb900039c0 0x7fcba41590e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56904/0 (socket says 172.21.15.94:56904) 2024-04-25T12:24:44.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.478+0000 7fcba3fff640 1 -- 172.21.15.94:0/2337298744 learned_addr learned my addr 172.21.15.94:0/2337298744 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:44.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.478+0000 7fcba37fe640 1 --2- 172.21.15.94:0/2337298744 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcba4072a90 0x7fcba41f4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:44.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.478+0000 7fcba8ad7640 1 --2- 172.21.15.94:0/2337298744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcba414bb20 0x7fcba413fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:44.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.478+0000 7fcba3fff640 1 -- 172.21.15.94:0/2337298744 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcba4072a90 msgr2=0x7fcba41f4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:44.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.478+0000 7fcba3fff640 1 --2- 172.21.15.94:0/2337298744 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcba4072a90 0x7fcba41f4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.478+0000 7fcba3fff640 1 -- 172.21.15.94:0/2337298744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcba414bb20 msgr2=0x7fcba413fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:44.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.478+0000 7fcba3fff640 1 --2- 172.21.15.94:0/2337298744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcba414bb20 0x7fcba413fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.478+0000 7fcba3fff640 1 -- 172.21.15.94:0/2337298744 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba40c39e0 con 0x7fcb900039c0 2024-04-25T12:24:44.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.478+0000 7fcba37fe640 1 --2- 172.21.15.94:0/2337298744 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcba4072a90 0x7fcba41f4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:44.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.478+0000 7fcba3fff640 1 --2- 172.21.15.94:0/2337298744 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcb900039c0 0x7fcba41590e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcb940b0040 tx=0x7fcb90005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:44.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.478+0000 7fcba0ff9640 1 -- 172.21.15.94:0/2337298744 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb940be070 con 0x7fcb900039c0 2024-04-25T12:24:44.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.478+0000 7fcba0ff9640 1 -- 172.21.15.94:0/2337298744 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb940b3040 con 0x7fcb900039c0 2024-04-25T12:24:44.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.478+0000 7fcbaa53a640 1 -- 172.21.15.94:0/2337298744 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcba4159e50 con 0x7fcb900039c0 2024-04-25T12:24:44.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.478+0000 7fcba0ff9640 1 -- 172.21.15.94:0/2337298744 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb940b2050 con 0x7fcb900039c0 2024-04-25T12:24:44.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.478+0000 7fcbaa53a640 1 -- 172.21.15.94:0/2337298744 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcba40c3c80 con 0x7fcb900039c0 2024-04-25T12:24:44.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.478+0000 7fcbaa53a640 1 -- 172.21.15.94:0/2337298744 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcba4075df0 con 0x7fcb900039c0 2024-04-25T12:24:44.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.478+0000 7fcba0ff9640 1 -- 172.21.15.94:0/2337298744 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcb940c1070 con 0x7fcb900039c0 2024-04-25T12:24:44.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.478+0000 7fcba0ff9640 1 --2- 172.21.15.94:0/2337298744 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fcb84068380 0x7fcb8406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:44.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.478+0000 7fcba0ff9640 1 -- 172.21.15.94:0/2337298744 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fcb94121440 con 0x7fcb900039c0 2024-04-25T12:24:44.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.478+0000 7fcba37fe640 1 --2- 172.21.15.94:0/2337298744 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fcb84068380 0x7fcb8406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:44.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.478+0000 7fcba37fe640 1 --2- 172.21.15.94:0/2337298744 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fcb84068380 0x7fcb8406a840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c001870 tx=0x7fcb8c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:44.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.482+0000 7fcba0ff9640 1 -- 172.21.15.94:0/2337298744 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcb94016950 con 0x7fcb900039c0 2024-04-25T12:24:44.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.642+0000 7fcbaa53a640 1 -- 172.21.15.94:0/2337298744 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcba40c7df0 con 0x7fcb900039c0 2024-04-25T12:24:44.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.642+0000 7fcba0ff9640 1 -- 172.21.15.94:0/2337298744 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7fcb940f1050 con 0x7fcb900039c0 2024-04-25T12:24:44.649 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2024-04-25T12:24:44.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.646+0000 7fcbaa53a640 1 -- 172.21.15.94:0/2337298744 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fcb84068380 msgr2=0x7fcb8406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:44.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.646+0000 7fcbaa53a640 1 --2- 172.21.15.94:0/2337298744 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fcb84068380 0x7fcb8406a840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c001870 tx=0x7fcb8c009040 comp rx=0 tx=0).stop 2024-04-25T12:24:44.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.646+0000 7fcbaa53a640 1 -- 172.21.15.94:0/2337298744 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcb900039c0 msgr2=0x7fcba41590e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:44.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.646+0000 7fcbaa53a640 1 --2- 172.21.15.94:0/2337298744 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcb900039c0 0x7fcba41590e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcb940b0040 tx=0x7fcb90005840 comp rx=0 tx=0).stop 2024-04-25T12:24:44.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.646+0000 7fcbaa53a640 1 -- 172.21.15.94:0/2337298744 shutdown_connections 2024-04-25T12:24:44.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.646+0000 7fcbaa53a640 1 --2- 172.21.15.94:0/2337298744 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fcb84068380 0x7fcb8406a840 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.646+0000 7fcbaa53a640 1 --2- 172.21.15.94:0/2337298744 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcba4072a90 0x7fcba41f4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.646+0000 7fcbaa53a640 1 --2- 172.21.15.94:0/2337298744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcba414bb20 0x7fcba413fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.646+0000 7fcbaa53a640 1 --2- 172.21.15.94:0/2337298744 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcb900039c0 0x7fcba41590e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.646+0000 7fcbaa53a640 1 -- 172.21.15.94:0/2337298744 >> 172.21.15.94:0/2337298744 conn(0x7fcba406b9d0 msgr2=0x7fcba4073660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:44.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.646+0000 7fcbaa53a640 1 -- 172.21.15.94:0/2337298744 shutdown_connections 2024-04-25T12:24:44.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.646+0000 7fcbaa53a640 1 -- 172.21.15.94:0/2337298744 wait complete. 2024-04-25T12:24:44.668 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T12:24:44.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.782+0000 7f6d66a52640 1 Processor -- start 2024-04-25T12:24:44.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.782+0000 7f6d66a52640 1 -- start start 2024-04-25T12:24:44.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d66a52640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6d60074100 0x7f6d6006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:44.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d66a52640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d600c5d70 con 0x7f6d6014fbc0 2024-04-25T12:24:44.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d66a52640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d600c6050 con 0x7f6d6014ffa0 2024-04-25T12:24:44.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d66a52640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6d600c6330 con 0x7f6d60074100 2024-04-25T12:24:44.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5ffff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f6d6014fbc0 0x7f6d600c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50216/0 (socket says 172.21.15.94:50216) 2024-04-25T12:24:44.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5ffff640 1 -- 172.21.15.94:0/3215285608 learned_addr learned my addr 172.21.15.94:0/3215285608 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:44.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d64fef640 1 --2- 172.21.15.94:0/3215285608 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6d60074100 0x7f6d6006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:44.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5f7fe640 1 -- 172.21.15.94:0/3215285608 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3171101774 0 0) 0x7f6d600c5d70 con 0x7f6d6014fbc0 2024-04-25T12:24:44.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5f7fe640 1 -- 172.21.15.94:0/3215285608 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d4c003530 con 0x7f6d6014fbc0 2024-04-25T12:24:44.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5f7fe640 1 -- 172.21.15.94:0/3215285608 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3636781531 0 0) 0x7f6d4c003530 con 0x7f6d6014fbc0 2024-04-25T12:24:44.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5f7fe640 1 -- 172.21.15.94:0/3215285608 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6d60074100 msgr2=0x7f6d6006f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:44.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5f7fe640 1 --2- 172.21.15.94:0/3215285608 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6d60074100 0x7f6d6006f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5f7fe640 1 -- 172.21.15.94:0/3215285608 >> v1:172.21.15.111:6789/0 conn(0x7f6d6014ffa0 legacy=0x7f6d600c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:44.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5f7fe640 1 -- 172.21.15.94:0/3215285608 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d600c6610 con 0x7f6d6014fbc0 2024-04-25T12:24:44.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5f7fe640 1 -- 172.21.15.94:0/3215285608 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7f6d50001680 con 0x7f6d6014fbc0 2024-04-25T12:24:44.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5f7fe640 1 -- 172.21.15.94:0/3215285608 >> v1:172.21.15.94:6789/0 conn(0x7f6d6014fbc0 legacy=0x7f6d600c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:44.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5f7fe640 1 --2- 172.21.15.94:0/3215285608 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d4c0039f0 0x7f6d4c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:44.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5f7fe640 1 --2- 172.21.15.94:0/3215285608 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6d60074100 0x7f6d4c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:44.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5f7fe640 1 --2- 172.21.15.94:0/3215285608 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d4c004d50 0x7f6d4c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:44.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5f7fe640 1 -- 172.21.15.94:0/3215285608 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6d600c6330 con 0x7f6d4c0039f0 2024-04-25T12:24:44.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5f7fe640 1 -- 172.21.15.94:0/3215285608 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4c00ba00 con 0x7f6d4c004d50 2024-04-25T12:24:44.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5f7fe640 1 -- 172.21.15.94:0/3215285608 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6d4c00bc00 con 0x7f6d60074100 2024-04-25T12:24:44.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5ffff640 1 --2- 172.21.15.94:0/3215285608 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d4c0039f0 0x7f6d4c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:44.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d64fef640 1 --2- 172.21.15.94:0/3215285608 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d4c004d50 0x7f6d4c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:44.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d577fe640 1 --2- 172.21.15.94:0/3215285608 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6d60074100 0x7f6d4c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:44.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5ffff640 1 -- 172.21.15.94:0/3215285608 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6d60074100 msgr2=0x7f6d4c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:44.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5ffff640 1 --2- 172.21.15.94:0/3215285608 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6d60074100 0x7f6d4c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5ffff640 1 -- 172.21.15.94:0/3215285608 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d4c004d50 msgr2=0x7f6d4c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:44.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5ffff640 1 --2- 172.21.15.94:0/3215285608 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d4c004d50 0x7f6d4c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5ffff640 1 -- 172.21.15.94:0/3215285608 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d4c003530 con 0x7f6d4c0039f0 2024-04-25T12:24:44.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d577fe640 1 --2- 172.21.15.94:0/3215285608 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6d60074100 0x7f6d4c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:44.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5ffff640 1 --2- 172.21.15.94:0/3215285608 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d4c0039f0 0x7f6d4c003dd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000c240 tx=0x7f6d5001cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56f8c1c86f3dd09 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:44.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5f7fe640 1 -- 172.21.15.94:0/3215285608 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d50007d20 con 0x7f6d4c0039f0 2024-04-25T12:24:44.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5f7fe640 1 -- 172.21.15.94:0/3215285608 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d500a9020 con 0x7f6d4c0039f0 2024-04-25T12:24:44.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.786+0000 7f6d5f7fe640 1 -- 172.21.15.94:0/3215285608 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d50005ae0 con 0x7f6d4c0039f0 2024-04-25T12:24:44.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d66a52640 1 -- 172.21.15.94:0/3215285608 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d4c0039f0 msgr2=0x7f6d4c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:44.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d66a52640 1 --2- 172.21.15.94:0/3215285608 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d4c0039f0 0x7f6d4c003dd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000c240 tx=0x7f6d5001cbc0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d64fef640 1 -- 172.21.15.94:0/3215285608 reap_dead start 2024-04-25T12:24:44.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d66a52640 1 -- 172.21.15.94:0/3215285608 shutdown_connections 2024-04-25T12:24:44.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d66a52640 1 -- 172.21.15.94:0/3215285608 >> 172.21.15.94:0/3215285608 conn(0x7f6d6006b9d0 msgr2=0x7f6d6006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:44.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d66a52640 1 -- 172.21.15.94:0/3215285608 shutdown_connections 2024-04-25T12:24:44.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d66a52640 1 -- 172.21.15.94:0/3215285608 wait complete. 2024-04-25T12:24:44.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d66a52640 1 Processor -- start 2024-04-25T12:24:44.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d66a52640 1 -- start start 2024-04-25T12:24:44.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d66a52640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d4c0039f0 0x7f6d601517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:44.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d66a52640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6d601445e0 0x7f6d60151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:44.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d66a52640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d600cb560 0x7f6d60142d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:44.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d66a52640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6d60163080 con 0x7f6d600cb560 2024-04-25T12:24:44.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d66a52640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6006fb10 con 0x7f6d4c0039f0 2024-04-25T12:24:44.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d66a52640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6d60163200 con 0x7f6d601445e0 2024-04-25T12:24:44.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d64fef640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d600cb560 0x7f6d60142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:44.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d64fef640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d600cb560 0x7f6d60142d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56908/0 (socket says 172.21.15.94:56908) 2024-04-25T12:24:44.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d64fef640 1 -- 172.21.15.94:0/2584322190 learned_addr learned my addr 172.21.15.94:0/2584322190 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:44.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d5ffff640 1 --2- 172.21.15.94:0/2584322190 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d4c0039f0 0x7f6d601517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:44.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d577fe640 1 --2- 172.21.15.94:0/2584322190 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6d601445e0 0x7f6d60151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:44.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d64fef640 1 -- 172.21.15.94:0/2584322190 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6d601445e0 msgr2=0x7f6d60151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:44.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d64fef640 1 --2- 172.21.15.94:0/2584322190 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6d601445e0 0x7f6d60151d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d64fef640 1 -- 172.21.15.94:0/2584322190 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d4c0039f0 msgr2=0x7f6d601517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:44.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d64fef640 1 --2- 172.21.15.94:0/2584322190 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d4c0039f0 0x7f6d601517f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d64fef640 1 -- 172.21.15.94:0/2584322190 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d60159e70 con 0x7f6d600cb560 2024-04-25T12:24:44.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d64fef640 1 --2- 172.21.15.94:0/2584322190 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d600cb560 0x7f6d60142d90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6d58007cf0 tx=0x7f6d580115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:44.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d5d7fa640 1 -- 172.21.15.94:0/2584322190 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d58011de0 con 0x7f6d600cb560 2024-04-25T12:24:44.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d5d7fa640 1 -- 172.21.15.94:0/2584322190 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d5801b070 con 0x7f6d600cb560 2024-04-25T12:24:44.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d66a52640 1 -- 172.21.15.94:0/2584322190 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d601efb40 con 0x7f6d600cb560 2024-04-25T12:24:44.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d5d7fa640 1 -- 172.21.15.94:0/2584322190 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d580039a0 con 0x7f6d600cb560 2024-04-25T12:24:44.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d66a52640 1 -- 172.21.15.94:0/2584322190 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d601f0100 con 0x7f6d600cb560 2024-04-25T12:24:44.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.790+0000 7f6d66a52640 1 -- 172.21.15.94:0/2584322190 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d60075df0 con 0x7f6d600cb560 2024-04-25T12:24:44.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.794+0000 7f6d5d7fa640 1 -- 172.21.15.94:0/2584322190 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6d58003b40 con 0x7f6d600cb560 2024-04-25T12:24:44.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.794+0000 7f6d5d7fa640 1 --2- 172.21.15.94:0/2584322190 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6d400683b0 0x7f6d4006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:44.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.794+0000 7f6d5d7fa640 1 -- 172.21.15.94:0/2584322190 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f6d58087440 con 0x7f6d600cb560 2024-04-25T12:24:44.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.794+0000 7f6d5ffff640 1 --2- 172.21.15.94:0/2584322190 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6d400683b0 0x7f6d4006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:44.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.794+0000 7f6d5ffff640 1 --2- 172.21.15.94:0/2584322190 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6d400683b0 0x7f6d4006a870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6d500aa000 tx=0x7f6d600735f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:44.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.798+0000 7f6d5d7fa640 1 -- 172.21.15.94:0/2584322190 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6d58025020 con 0x7f6d600cb560 2024-04-25T12:24:44.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.950+0000 7f6d66a52640 1 -- 172.21.15.94:0/2584322190 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f6d600c7df0 con 0x7f6d600cb560 2024-04-25T12:24:44.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.950+0000 7f6d5d7fa640 1 -- 172.21.15.94:0/2584322190 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7f6d60159e70 con 0x7f6d600cb560 2024-04-25T12:24:44.955 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2024-04-25T12:24:44.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.950+0000 7f6d66a52640 1 -- 172.21.15.94:0/2584322190 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6d400683b0 msgr2=0x7f6d4006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:44.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.950+0000 7f6d66a52640 1 --2- 172.21.15.94:0/2584322190 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6d400683b0 0x7f6d4006a870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6d500aa000 tx=0x7f6d600735f0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.950+0000 7f6d66a52640 1 -- 172.21.15.94:0/2584322190 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d600cb560 msgr2=0x7f6d60142d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:44.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.950+0000 7f6d66a52640 1 --2- 172.21.15.94:0/2584322190 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d600cb560 0x7f6d60142d90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6d58007cf0 tx=0x7f6d580115a0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.950+0000 7f6d66a52640 1 -- 172.21.15.94:0/2584322190 shutdown_connections 2024-04-25T12:24:44.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.950+0000 7f6d66a52640 1 --2- 172.21.15.94:0/2584322190 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6d400683b0 0x7f6d4006a870 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.950+0000 7f6d66a52640 1 --2- 172.21.15.94:0/2584322190 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6d601445e0 0x7f6d60151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.950+0000 7f6d66a52640 1 --2- 172.21.15.94:0/2584322190 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d600cb560 0x7f6d60142d90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.950+0000 7f6d66a52640 1 --2- 172.21.15.94:0/2584322190 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d4c0039f0 0x7f6d601517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:44.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.950+0000 7f6d66a52640 1 -- 172.21.15.94:0/2584322190 >> 172.21.15.94:0/2584322190 conn(0x7f6d6006b9d0 msgr2=0x7f6d6014d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:44.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.950+0000 7f6d66a52640 1 -- 172.21.15.94:0/2584322190 shutdown_connections 2024-04-25T12:24:44.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:44.950+0000 7f6d66a52640 1 -- 172.21.15.94:0/2584322190 wait complete. 2024-04-25T12:24:44.973 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:24:45.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.074+0000 7f81dff2b640 1 Processor -- start 2024-04-25T12:24:45.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.074+0000 7f81dff2b640 1 -- start start 2024-04-25T12:24:45.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dff2b640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f81d8155350 0x7f81d80c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:45.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dff2b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81d815bc10 con 0x7f81d80cda50 2024-04-25T12:24:45.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dff2b640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81d815beb0 con 0x7f81d815b0b0 2024-04-25T12:24:45.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dff2b640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f81d80cca40 con 0x7f81d8155350 2024-04-25T12:24:45.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dd4c6640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f81d80cda50 0x7f81d80cb7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50226/0 (socket says 172.21.15.94:50226) 2024-04-25T12:24:45.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dd4c6640 1 -- 172.21.15.94:0/3120232328 learned_addr learned my addr 172.21.15.94:0/3120232328 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:45.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81ddcc7640 1 --2- 172.21.15.94:0/3120232328 >> v2:172.21.15.111:3300/0 conn(0x7f81d8155350 0x7f81d80c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:45.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dccc5640 1 -- 172.21.15.94:0/3120232328 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 414633655 0 0) 0x7f81d815bc10 con 0x7f81d80cda50 2024-04-25T12:24:45.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dccc5640 1 -- 172.21.15.94:0/3120232328 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81c4003530 con 0x7f81d80cda50 2024-04-25T12:24:45.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dccc5640 1 -- 172.21.15.94:0/3120232328 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2586177635 0 0) 0x7f81c4003530 con 0x7f81d80cda50 2024-04-25T12:24:45.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dccc5640 1 -- 172.21.15.94:0/3120232328 >> v2:172.21.15.111:3300/0 conn(0x7f81d8155350 msgr2=0x7f81d80c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:45.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dccc5640 1 --2- 172.21.15.94:0/3120232328 >> v2:172.21.15.111:3300/0 conn(0x7f81d8155350 0x7f81d80c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dccc5640 1 -- 172.21.15.94:0/3120232328 >> v1:172.21.15.111:6789/0 conn(0x7f81d815b0b0 legacy=0x7f81d815b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:45.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dccc5640 1 -- 172.21.15.94:0/3120232328 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d80ccc90 con 0x7f81d80cda50 2024-04-25T12:24:45.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dccc5640 1 -- 172.21.15.94:0/3120232328 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7f81c80016a0 con 0x7f81d80cda50 2024-04-25T12:24:45.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dccc5640 1 -- 172.21.15.94:0/3120232328 >> v1:172.21.15.94:6789/0 conn(0x7f81d80cda50 legacy=0x7f81d80cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:45.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dccc5640 1 --2- 172.21.15.94:0/3120232328 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81c40039c0 0x7f81c4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:45.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dccc5640 1 --2- 172.21.15.94:0/3120232328 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81c4004810 0x7f81c4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:45.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dccc5640 1 --2- 172.21.15.94:0/3120232328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81c40051d0 0x7f81c400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:45.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dccc5640 1 -- 172.21.15.94:0/3120232328 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f81d80cca40 con 0x7f81c4004810 2024-04-25T12:24:45.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dccc5640 1 -- 172.21.15.94:0/3120232328 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f81c400c080 con 0x7f81c40051d0 2024-04-25T12:24:45.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dccc5640 1 -- 172.21.15.94:0/3120232328 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f81c400c280 con 0x7f81c40039c0 2024-04-25T12:24:45.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dd4c6640 1 --2- 172.21.15.94:0/3120232328 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81c4004810 0x7f81c4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:45.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81de4c8640 1 --2- 172.21.15.94:0/3120232328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81c40051d0 0x7f81c400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:45.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81ddcc7640 1 --2- 172.21.15.94:0/3120232328 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81c40039c0 0x7f81c4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:45.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dd4c6640 1 -- 172.21.15.94:0/3120232328 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81c40039c0 msgr2=0x7f81c4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:45.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dd4c6640 1 --2- 172.21.15.94:0/3120232328 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81c40039c0 0x7f81c4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dd4c6640 1 -- 172.21.15.94:0/3120232328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81c40051d0 msgr2=0x7f81c400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:45.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dd4c6640 1 --2- 172.21.15.94:0/3120232328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81c40051d0 0x7f81c400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81de4c8640 1 -- 172.21.15.94:0/3120232328 reap_dead start 2024-04-25T12:24:45.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.078+0000 7f81dd4c6640 1 -- 172.21.15.94:0/3120232328 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c4003530 con 0x7f81c4004810 2024-04-25T12:24:45.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dd4c6640 1 --2- 172.21.15.94:0/3120232328 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81c4004810 0x7f81c4004c90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f81c800c210 tx=0x7f81c801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d574d3047bc91ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:45.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dccc5640 1 -- 172.21.15.94:0/3120232328 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c8007d40 con 0x7f81c4004810 2024-04-25T12:24:45.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dccc5640 1 -- 172.21.15.94:0/3120232328 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c80a9070 con 0x7f81c4004810 2024-04-25T12:24:45.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dccc5640 1 -- 172.21.15.94:0/3120232328 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c80a5dc0 con 0x7f81c4004810 2024-04-25T12:24:45.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dff2b640 1 -- 172.21.15.94:0/3120232328 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81c4004810 msgr2=0x7f81c4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:45.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dff2b640 1 --2- 172.21.15.94:0/3120232328 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81c4004810 0x7f81c4004c90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f81c800c210 tx=0x7f81c801cc60 comp rx=0 tx=0).stop 2024-04-25T12:24:45.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dff2b640 1 -- 172.21.15.94:0/3120232328 shutdown_connections 2024-04-25T12:24:45.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dff2b640 1 --2- 172.21.15.94:0/3120232328 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81c4004810 0x7f81c4004c90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dff2b640 1 -- 172.21.15.94:0/3120232328 >> 172.21.15.94:0/3120232328 conn(0x7f81d806cc30 msgr2=0x7f81d806d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:45.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dff2b640 1 -- 172.21.15.94:0/3120232328 shutdown_connections 2024-04-25T12:24:45.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dff2b640 1 -- 172.21.15.94:0/3120232328 wait complete. 2024-04-25T12:24:45.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dff2b640 1 Processor -- start 2024-04-25T12:24:45.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dff2b640 1 -- start start 2024-04-25T12:24:45.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dff2b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81c4004810 0x7f81d81f1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:45.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dff2b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81d815e2b0 0x7f81d814b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:45.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dff2b640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81d80b6080 0x7f81d80b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:45.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dff2b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f81d80cd530 con 0x7f81d815e2b0 2024-04-25T12:24:45.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dff2b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f81d80cd250 con 0x7f81c4004810 2024-04-25T12:24:45.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dff2b640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f81d8155730 con 0x7f81d80b6080 2024-04-25T12:24:45.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dd4c6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81d815e2b0 0x7f81d814b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:45.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dd4c6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81d815e2b0 0x7f81d814b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56928/0 (socket says 172.21.15.94:56928) 2024-04-25T12:24:45.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dd4c6640 1 -- 172.21.15.94:0/2036728610 learned_addr learned my addr 172.21.15.94:0/2036728610 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:45.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81ddcc7640 1 --2- 172.21.15.94:0/2036728610 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81c4004810 0x7f81d81f1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:45.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81de4c8640 1 --2- 172.21.15.94:0/2036728610 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81d80b6080 0x7f81d80b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:45.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dd4c6640 1 -- 172.21.15.94:0/2036728610 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81d80b6080 msgr2=0x7f81d80b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:45.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dd4c6640 1 --2- 172.21.15.94:0/2036728610 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81d80b6080 0x7f81d80b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dd4c6640 1 -- 172.21.15.94:0/2036728610 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81c4004810 msgr2=0x7f81d81f1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:45.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dd4c6640 1 --2- 172.21.15.94:0/2036728610 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81c4004810 0x7f81d81f1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dd4c6640 1 -- 172.21.15.94:0/2036728610 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d814bc60 con 0x7f81d815e2b0 2024-04-25T12:24:45.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81ddcc7640 1 --2- 172.21.15.94:0/2036728610 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81c4004810 0x7f81d81f1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:24:45.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dd4c6640 1 --2- 172.21.15.94:0/2036728610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81d815e2b0 0x7f81d814b720 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f81c801ca90 tx=0x7f81c4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:45.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81ce7fc640 1 -- 172.21.15.94:0/2036728610 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c80bc070 con 0x7f81d815e2b0 2024-04-25T12:24:45.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81ce7fc640 1 -- 172.21.15.94:0/2036728610 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c8000ee0 con 0x7f81d815e2b0 2024-04-25T12:24:45.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dff2b640 1 -- 172.21.15.94:0/2036728610 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81d815c410 con 0x7f81d815e2b0 2024-04-25T12:24:45.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81ce7fc640 1 -- 172.21.15.94:0/2036728610 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c8007d40 con 0x7f81d815e2b0 2024-04-25T12:24:45.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.082+0000 7f81dff2b640 1 -- 172.21.15.94:0/2036728610 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81d815c9d0 con 0x7f81d815e2b0 2024-04-25T12:24:45.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.086+0000 7f81dff2b640 1 -- 172.21.15.94:0/2036728610 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81d8075df0 con 0x7f81d815e2b0 2024-04-25T12:24:45.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.086+0000 7f81ce7fc640 1 -- 172.21.15.94:0/2036728610 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f81c80bf070 con 0x7f81d815e2b0 2024-04-25T12:24:45.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.086+0000 7f81ce7fc640 1 --2- 172.21.15.94:0/2036728610 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f81bc0683b0 0x7f81bc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:45.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.086+0000 7f81ddcc7640 1 --2- 172.21.15.94:0/2036728610 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f81bc0683b0 0x7f81bc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:45.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.086+0000 7f81ce7fc640 1 -- 172.21.15.94:0/2036728610 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f81c8120230 con 0x7f81d815e2b0 2024-04-25T12:24:45.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.086+0000 7f81ddcc7640 1 --2- 172.21.15.94:0/2036728610 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f81bc0683b0 0x7f81bc06a870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f81d0009b70 tx=0x7f81d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:45.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.090+0000 7f81ce7fc640 1 -- 172.21.15.94:0/2036728610 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f81c8016970 con 0x7f81d815e2b0 2024-04-25T12:24:45.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.282+0000 7f81dff2b640 1 -- 172.21.15.94:0/2036728610 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81d815ec00 con 0x7f81d815e2b0 2024-04-25T12:24:45.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.286+0000 7f81ce7fc640 1 -- 172.21.15.94:0/2036728610 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6921 (secure 0 0 0) 0x7f81c80f0400 con 0x7f81d815e2b0 2024-04-25T12:24:45.290 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:45.290 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6838/1468945344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6835","nonce":1468945344},{"type":"v1","addr":"172.21.15.94:6838","nonce":1468945344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T12:21:53.517464+0000","modified":"2024-04-25T12:24:43.925388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4285,"mds_1":4276,"mds_2":4254,"mds_3":4229,"mds_4":4223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4223":{"gid":4223,"name":"e","rank":4,"incarnation":18,"state":"up:active","state_seq":46,"addr":"172.21.15.94:6839/3773379365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":3773379365},{"type":"v1","addr":"172.21.15.94:6839","nonce":3773379365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4229":{"gid":4229,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":44,"addr":"172.21.15.111:6835/3463503555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3463503555},{"type":"v1","addr":"172.21.15.111:6835","nonce":3463503555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4254":{"gid":4254,"name":"a","rank":2,"incarnation":14,"state":"up:active","state_seq":43,"addr":"172.21.15.94:6837/1182495659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1182495659},{"type":"v1","addr":"172.21.15.94:6837","nonce":1182495659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":41,"addr":"172.21.15.111:6833/2332499082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":2332499082},{"type":"v1","addr":"172.21.15.111:6833","nonce":2332499082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.111:6837/3560813143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":3560813143},{"type":"v1","addr":"172.21.15.111:6837","nonce":3560813143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4223,4229,4254,4276,4285]},"id":1}]} 2024-04-25T12:24:45.290 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 19 2024-04-25T12:24:45.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.286+0000 7f81dff2b640 1 -- 172.21.15.94:0/2036728610 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f81bc0683b0 msgr2=0x7f81bc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:45.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.286+0000 7f81dff2b640 1 --2- 172.21.15.94:0/2036728610 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f81bc0683b0 0x7f81bc06a870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f81d0009b70 tx=0x7f81d0008040 comp rx=0 tx=0).stop 2024-04-25T12:24:45.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.286+0000 7f81dff2b640 1 -- 172.21.15.94:0/2036728610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81d815e2b0 msgr2=0x7f81d814b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:45.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.286+0000 7f81dff2b640 1 --2- 172.21.15.94:0/2036728610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81d815e2b0 0x7f81d814b720 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f81c801ca90 tx=0x7f81c4005840 comp rx=0 tx=0).stop 2024-04-25T12:24:45.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.286+0000 7f81dff2b640 1 -- 172.21.15.94:0/2036728610 shutdown_connections 2024-04-25T12:24:45.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.286+0000 7f81dff2b640 1 --2- 172.21.15.94:0/2036728610 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f81bc0683b0 0x7f81bc06a870 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.286+0000 7f81dff2b640 1 --2- 172.21.15.94:0/2036728610 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81d80b6080 0x7f81d80b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.286+0000 7f81dff2b640 1 --2- 172.21.15.94:0/2036728610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81d815e2b0 0x7f81d814b720 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.286+0000 7f81dff2b640 1 --2- 172.21.15.94:0/2036728610 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81c4004810 0x7f81d81f1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.286+0000 7f81dff2b640 1 -- 172.21.15.94:0/2036728610 >> 172.21.15.94:0/2036728610 conn(0x7f81d806cc30 msgr2=0x7f81d80c6140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:45.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.286+0000 7f81dff2b640 1 -- 172.21.15.94:0/2036728610 shutdown_connections 2024-04-25T12:24:45.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.286+0000 7f81dff2b640 1 -- 172.21.15.94:0/2036728610 wait complete. 2024-04-25T12:24:45.308 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:24:45.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.406+0000 7f8f6c3d3640 1 Processor -- start 2024-04-25T12:24:45.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.406+0000 7f8f6c3d3640 1 -- start start 2024-04-25T12:24:45.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.410+0000 7f8f6c3d3640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f8f6414ffa0 0x7f8f6406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:45.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.410+0000 7f8f6c3d3640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8f64074100 0x7f8f640c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:45.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.410+0000 7f8f6c3d3640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f640c5d70 con 0x7f8f6414fbc0 2024-04-25T12:24:45.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.410+0000 7f8f6c3d3640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f8f640c6050 con 0x7f8f64074100 2024-04-25T12:24:45.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.410+0000 7f8f6c3d3640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f8f640c6330 con 0x7f8f6414ffa0 2024-04-25T12:24:45.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.410+0000 7f8f6a970640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8f64074100 0x7f8f640c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:45.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.410+0000 7f8f6a970640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8f64074100 0x7f8f640c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56942/0 (socket says 172.21.15.94:56942) 2024-04-25T12:24:45.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.410+0000 7f8f6a970640 1 -- 172.21.15.94:0/3331454776 learned_addr learned my addr 172.21.15.94:0/3331454776 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:45.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.410+0000 7f8f6996e640 1 --2- 172.21.15.94:0/3331454776 >> v2:172.21.15.111:3300/0 conn(0x7f8f6414ffa0 0x7f8f6406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:45.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.410+0000 7f8f6a970640 1 -- 172.21.15.94:0/3331454776 >> v2:172.21.15.111:3300/0 conn(0x7f8f6414ffa0 msgr2=0x7f8f6406f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:45.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.410+0000 7f8f6a970640 1 --2- 172.21.15.94:0/3331454776 >> v2:172.21.15.111:3300/0 conn(0x7f8f6414ffa0 0x7f8f6406f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.410+0000 7f8f6a970640 1 -- 172.21.15.94:0/3331454776 >> v1:172.21.15.111:6789/0 conn(0x7f8f6414fbc0 legacy=0x7f8f640c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:45.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.410+0000 7f8f6a970640 1 -- 172.21.15.94:0/3331454776 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f640c6610 con 0x7f8f64074100 2024-04-25T12:24:45.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.410+0000 7f8f6a970640 1 --2- 172.21.15.94:0/3331454776 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f64074100 0x7f8f640c7250 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c009870 tx=0x7f8f5c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f2b11a5ecb7e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:45.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.410+0000 7f8f6916d640 1 -- 172.21.15.94:0/3331454776 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c0aa660 con 0x7f8f64074100 2024-04-25T12:24:45.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.410+0000 7f8f6916d640 1 -- 172.21.15.94:0/3331454776 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f5c0af070 con 0x7f8f64074100 2024-04-25T12:24:45.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.410+0000 7f8f6916d640 1 -- 172.21.15.94:0/3331454776 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c0aaa20 con 0x7f8f64074100 2024-04-25T12:24:45.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6c3d3640 1 -- 172.21.15.94:0/3331454776 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f64074100 msgr2=0x7f8f640c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:45.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6c3d3640 1 --2- 172.21.15.94:0/3331454776 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f64074100 0x7f8f640c7250 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c009870 tx=0x7f8f5c01c4e0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6c3d3640 1 -- 172.21.15.94:0/3331454776 shutdown_connections 2024-04-25T12:24:45.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6c3d3640 1 --2- 172.21.15.94:0/3331454776 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f64074100 0x7f8f640c7250 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6c3d3640 1 --2- 172.21.15.94:0/3331454776 >> v2:172.21.15.111:3300/0 conn(0x7f8f6414ffa0 0x7f8f6406f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6c3d3640 1 -- 172.21.15.94:0/3331454776 >> 172.21.15.94:0/3331454776 conn(0x7f8f6406b9d0 msgr2=0x7f8f6406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:45.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6c3d3640 1 -- 172.21.15.94:0/3331454776 shutdown_connections 2024-04-25T12:24:45.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6c3d3640 1 -- 172.21.15.94:0/3331454776 wait complete. 2024-04-25T12:24:45.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6c3d3640 1 Processor -- start 2024-04-25T12:24:45.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6c3d3640 1 -- start start 2024-04-25T12:24:45.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6c3d3640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8f64074100 0x7f8f64152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:45.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6c3d3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f6414fbc0 0x7f8f6414ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:45.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6c3d3640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8f6414ffa0 0x7f8f6414bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:45.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6c3d3640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8f640c8ab0 con 0x7f8f6414fbc0 2024-04-25T12:24:45.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6c3d3640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8f640c8930 con 0x7f8f6414ffa0 2024-04-25T12:24:45.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6c3d3640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f8f64166090 con 0x7f8f64074100 2024-04-25T12:24:45.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6996e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f6414fbc0 0x7f8f6414ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:45.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6996e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f6414fbc0 0x7f8f6414ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56956/0 (socket says 172.21.15.94:56956) 2024-04-25T12:24:45.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6996e640 1 -- 172.21.15.94:0/2428473907 learned_addr learned my addr 172.21.15.94:0/2428473907 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:45.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6a16f640 1 --2- 172.21.15.94:0/2428473907 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8f64074100 0x7f8f64152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:45.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6a970640 1 --2- 172.21.15.94:0/2428473907 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8f6414ffa0 0x7f8f6414bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:45.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6996e640 1 -- 172.21.15.94:0/2428473907 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8f64074100 msgr2=0x7f8f64152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:45.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6996e640 1 --2- 172.21.15.94:0/2428473907 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8f64074100 0x7f8f64152ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6996e640 1 -- 172.21.15.94:0/2428473907 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8f6414ffa0 msgr2=0x7f8f6414bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:45.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6996e640 1 --2- 172.21.15.94:0/2428473907 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8f6414ffa0 0x7f8f6414bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6996e640 1 -- 172.21.15.94:0/2428473907 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f64153530 con 0x7f8f6414fbc0 2024-04-25T12:24:45.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6996e640 1 --2- 172.21.15.94:0/2428473907 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f6414fbc0 0x7f8f6414ba80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800d5f0 tx=0x7f8f5800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:45.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f62ffd640 1 -- 172.21.15.94:0/2428473907 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f580125f0 con 0x7f8f6414fbc0 2024-04-25T12:24:45.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f62ffd640 1 -- 172.21.15.94:0/2428473907 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f58019070 con 0x7f8f6414fbc0 2024-04-25T12:24:45.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6c3d3640 1 -- 172.21.15.94:0/2428473907 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f641f58d0 con 0x7f8f6414fbc0 2024-04-25T12:24:45.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f62ffd640 1 -- 172.21.15.94:0/2428473907 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f580129b0 con 0x7f8f6414fbc0 2024-04-25T12:24:45.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.414+0000 7f8f6c3d3640 1 -- 172.21.15.94:0/2428473907 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f641f5e90 con 0x7f8f6414fbc0 2024-04-25T12:24:45.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.418+0000 7f8f6c3d3640 1 -- 172.21.15.94:0/2428473907 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f64075df0 con 0x7f8f6414fbc0 2024-04-25T12:24:45.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.418+0000 7f8f62ffd640 1 -- 172.21.15.94:0/2428473907 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8f58012b50 con 0x7f8f6414fbc0 2024-04-25T12:24:45.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.418+0000 7f8f62ffd640 1 --2- 172.21.15.94:0/2428473907 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8f50068380 0x7f8f5006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:45.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.418+0000 7f8f6a16f640 1 --2- 172.21.15.94:0/2428473907 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8f50068380 0x7f8f5006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:45.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.418+0000 7f8f62ffd640 1 -- 172.21.15.94:0/2428473907 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f8f580871e0 con 0x7f8f6414fbc0 2024-04-25T12:24:45.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.418+0000 7f8f6a16f640 1 --2- 172.21.15.94:0/2428473907 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8f50068380 0x7f8f5006a840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8f54004450 tx=0x7f8f54009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:45.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.422+0000 7f8f62ffd640 1 -- 172.21.15.94:0/2428473907 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8f58057310 con 0x7f8f6414fbc0 2024-04-25T12:24:45.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.578+0000 7f8f6c3d3640 1 -- 172.21.15.94:0/2428473907 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8f64149c50 con 0x7f8f6414fbc0 2024-04-25T12:24:45.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.582+0000 7f8f62ffd640 1 -- 172.21.15.94:0/2428473907 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18873 (secure 0 0 0) 0x7f8f58056c10 con 0x7f8f6414fbc0 2024-04-25T12:24:45.587 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:45.587 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"7059a9e2-aec4-4b84-b942-caf531e15da3","created":"2024-04-25T12:21:29.118508+0000","modified":"2024-04-25T12:22:34.871807+0000","last_up_change":"2024-04-25T12:21:40.912605+0000","last_in_change":"2024-04-25T12:21:31.372905+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:39.781011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:51.465886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:52.470540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:56.209936+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"640a65ef-0734-468a-a8f5-9ed70cf75c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6809","nonce":2553247564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6811","nonce":2553247564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6815","nonce":2553247564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6813","nonce":2553247564}]},"public_addr":"172.21.15.94:6809/2553247564","cluster_addr":"172.21.15.94:6811/2553247564","heartbeat_back_addr":"172.21.15.94:6815/2553247564","heartbeat_front_addr":"172.21.15.94:6813/2553247564","state":["exists","up"]},{"osd":1,"uuid":"d6e886e6-c8c1-4761-9a4c-abc6961c7c81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6818","nonce":2492806478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6822","nonce":2492806478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6830","nonce":2492806478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6826","nonce":2492806478}]},"public_addr":"172.21.15.94:6818/2492806478","cluster_addr":"172.21.15.94:6822/2492806478","heartbeat_back_addr":"172.21.15.94:6830/2492806478","heartbeat_front_addr":"172.21.15.94:6826/2492806478","state":["exists","up"]},{"osd":2,"uuid":"ba20f409-ed46-43b6-b16d-43dc4622c042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6801","nonce":1485061290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6803","nonce":1485061290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6807","nonce":1485061290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6805","nonce":1485061290}]},"public_addr":"172.21.15.94:6801/1485061290","cluster_addr":"172.21.15.94:6803/1485061290","heartbeat_back_addr":"172.21.15.94:6807/1485061290","heartbeat_front_addr":"172.21.15.94:6805/1485061290","state":["exists","up"]},{"osd":3,"uuid":"85816a2b-3a3f-4ec8-8373-8230d948396f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6819","nonce":1548488434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6823","nonce":1548488434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6829","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6831","nonce":1548488434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6827","nonce":1548488434}]},"public_addr":"172.21.15.94:6819/1548488434","cluster_addr":"172.21.15.94:6823/1548488434","heartbeat_back_addr":"172.21.15.94:6831/1548488434","heartbeat_front_addr":"172.21.15.94:6827/1548488434","state":["exists","up"]},{"osd":4,"uuid":"b4a953b7-01d6-4623-9324-63135fdaf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6811","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6814","nonce":4070977083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6817","nonce":4070977083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6823","nonce":4070977083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6819","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6821","nonce":4070977083}]},"public_addr":"172.21.15.111:6814/4070977083","cluster_addr":"172.21.15.111:6817/4070977083","heartbeat_back_addr":"172.21.15.111:6823/4070977083","heartbeat_front_addr":"172.21.15.111:6821/4070977083","state":["exists","up"]},{"osd":5,"uuid":"c0acc514-427d-41bf-a965-b8463cebf045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6803","nonce":1054925605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6809","nonce":1054925605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6820","nonce":1054925605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6815","nonce":1054925605}]},"public_addr":"172.21.15.111:6803/1054925605","cluster_addr":"172.21.15.111:6809/1054925605","heartbeat_back_addr":"172.21.15.111:6820/1054925605","heartbeat_front_addr":"172.21.15.111:6815/1054925605","state":["exists","up"]},{"osd":6,"uuid":"26ff742f-5a57-44a7-a095-f04d6e87f885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6825","nonce":3619235078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6827","nonce":3619235078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6831","nonce":3619235078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6829","nonce":3619235078}]},"public_addr":"172.21.15.111:6825/3619235078","cluster_addr":"172.21.15.111:6827/3619235078","heartbeat_back_addr":"172.21.15.111:6831/3619235078","heartbeat_front_addr":"172.21.15.111:6829/3619235078","state":["exists","up"]},{"osd":7,"uuid":"9c214cba-693a-4b25-aad7-05a5b0006e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6801","nonce":558758517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6805","nonce":558758517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6813","nonce":558758517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6807","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6808","nonce":558758517}]},"public_addr":"172.21.15.111:6801/558758517","cluster_addr":"172.21.15.111:6805/558758517","heartbeat_back_addr":"172.21.15.111:6813/558758517","heartbeat_front_addr":"172.21.15.111:6808/558758517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.664958+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.853375+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.654455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:37.033852+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.968691+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.856013+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.913496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.848565+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:24:45.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.582+0000 7f8f6c3d3640 1 -- 172.21.15.94:0/2428473907 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8f50068380 msgr2=0x7f8f5006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:45.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.582+0000 7f8f6c3d3640 1 --2- 172.21.15.94:0/2428473907 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8f50068380 0x7f8f5006a840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8f54004450 tx=0x7f8f54009040 comp rx=0 tx=0).stop 2024-04-25T12:24:45.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.582+0000 7f8f6c3d3640 1 -- 172.21.15.94:0/2428473907 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f6414fbc0 msgr2=0x7f8f6414ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:45.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.582+0000 7f8f6c3d3640 1 --2- 172.21.15.94:0/2428473907 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f6414fbc0 0x7f8f6414ba80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800d5f0 tx=0x7f8f5800dab0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.582+0000 7f8f6c3d3640 1 -- 172.21.15.94:0/2428473907 shutdown_connections 2024-04-25T12:24:45.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.582+0000 7f8f6c3d3640 1 --2- 172.21.15.94:0/2428473907 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8f50068380 0x7f8f5006a840 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.582+0000 7f8f6c3d3640 1 --2- 172.21.15.94:0/2428473907 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8f6414ffa0 0x7f8f6414bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.582+0000 7f8f6c3d3640 1 --2- 172.21.15.94:0/2428473907 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8f6414fbc0 0x7f8f6414ba80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.582+0000 7f8f6c3d3640 1 --2- 172.21.15.94:0/2428473907 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8f64074100 0x7f8f64152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.582+0000 7f8f6c3d3640 1 -- 172.21.15.94:0/2428473907 >> 172.21.15.94:0/2428473907 conn(0x7f8f6406b9d0 msgr2=0x7f8f6406ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:45.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.582+0000 7f8f6c3d3640 1 -- 172.21.15.94:0/2428473907 shutdown_connections 2024-04-25T12:24:45.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.582+0000 7f8f6c3d3640 1 -- 172.21.15.94:0/2428473907 wait complete. 2024-04-25T12:24:45.605 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:24:45.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.710+0000 7f45007a9640 1 Processor -- start 2024-04-25T12:24:45.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.710+0000 7f45007a9640 1 -- start start 2024-04-25T12:24:45.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.714+0000 7f45007a9640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f44f80c8800 0x7f44f80c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:45.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.714+0000 7f45007a9640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f44f80c4b40 0x7f44f80c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:45.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.714+0000 7f45007a9640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44f80c8be0 con 0x7f44f80c5780 2024-04-25T12:24:45.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.714+0000 7f45007a9640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f44f8158090 con 0x7f44f80c4b40 2024-04-25T12:24:45.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.714+0000 7f45007a9640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f44f81585c0 con 0x7f44f80c8800 2024-04-25T12:24:45.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.714+0000 7f44fdd44640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f44f80c4b40 0x7f44f80c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:45.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.714+0000 7f44fdd44640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f44f80c4b40 0x7f44f80c3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56964/0 (socket says 172.21.15.94:56964) 2024-04-25T12:24:45.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.714+0000 7f44fdd44640 1 -- 172.21.15.94:0/4136760648 learned_addr learned my addr 172.21.15.94:0/4136760648 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:45.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.714+0000 7f44fe545640 1 --2- 172.21.15.94:0/4136760648 >> v2:172.21.15.111:3300/0 conn(0x7f44f80c8800 0x7f44f80c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:45.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.714+0000 7f44fdd44640 1 -- 172.21.15.94:0/4136760648 >> v2:172.21.15.111:3300/0 conn(0x7f44f80c8800 msgr2=0x7f44f80c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:45.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.714+0000 7f44fdd44640 1 --2- 172.21.15.94:0/4136760648 >> v2:172.21.15.111:3300/0 conn(0x7f44f80c8800 0x7f44f80c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.714+0000 7f44fdd44640 1 -- 172.21.15.94:0/4136760648 >> v1:172.21.15.111:6789/0 conn(0x7f44f80c5780 legacy=0x7f44f80c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:45.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.714+0000 7f44fdd44640 1 -- 172.21.15.94:0/4136760648 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f80c4790 con 0x7f44f80c4b40 2024-04-25T12:24:45.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.714+0000 7f44fe545640 1 --2- 172.21.15.94:0/4136760648 >> v2:172.21.15.111:3300/0 conn(0x7f44f80c8800 0x7f44f80c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:24:45.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.714+0000 7f44fdd44640 1 --2- 172.21.15.94:0/4136760648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f44f80c4b40 0x7f44f80c3f20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f44f8070da0 tx=0x7f44f401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b6c4c2ab87118f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:45.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.714+0000 7f44fd543640 1 -- 172.21.15.94:0/4136760648 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f40b0070 con 0x7f44f80c4b40 2024-04-25T12:24:45.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.714+0000 7f44fd543640 1 -- 172.21.15.94:0/4136760648 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44f40ab600 con 0x7f44f80c4b40 2024-04-25T12:24:45.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.714+0000 7f44fd543640 1 -- 172.21.15.94:0/4136760648 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f40ab9d0 con 0x7f44f80c4b40 2024-04-25T12:24:45.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.714+0000 7f45007a9640 1 -- 172.21.15.94:0/4136760648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f44f80c4b40 msgr2=0x7f44f80c3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:45.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.714+0000 7f45007a9640 1 --2- 172.21.15.94:0/4136760648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f44f80c4b40 0x7f44f80c3f20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f44f8070da0 tx=0x7f44f401c400 comp rx=0 tx=0).stop 2024-04-25T12:24:45.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.714+0000 7f45007a9640 1 -- 172.21.15.94:0/4136760648 shutdown_connections 2024-04-25T12:24:45.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.714+0000 7f45007a9640 1 --2- 172.21.15.94:0/4136760648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f44f80c4b40 0x7f44f80c3f20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.714+0000 7f45007a9640 1 --2- 172.21.15.94:0/4136760648 >> v2:172.21.15.111:3300/0 conn(0x7f44f80c8800 0x7f44f80c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.714+0000 7f45007a9640 1 -- 172.21.15.94:0/4136760648 >> 172.21.15.94:0/4136760648 conn(0x7f44f806b9d0 msgr2=0x7f44f806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:45.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.714+0000 7f45007a9640 1 -- 172.21.15.94:0/4136760648 shutdown_connections 2024-04-25T12:24:45.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.714+0000 7f45007a9640 1 -- 172.21.15.94:0/4136760648 wait complete. 2024-04-25T12:24:45.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f45007a9640 1 Processor -- start 2024-04-25T12:24:45.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f45007a9640 1 -- start start 2024-04-25T12:24:45.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f45007a9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f44f80c4b40 0x7f44f814dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:45.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f45007a9640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f44f80c5780 0x7f44f81f5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:45.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f45007a9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f44f80c8800 0x7f44f81f5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:45.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f45007a9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f44f8068790 con 0x7f44f80c8800 2024-04-25T12:24:45.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f45007a9640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f44f8068610 con 0x7f44f80c4b40 2024-04-25T12:24:45.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f45007a9640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f44f80681d0 con 0x7f44f80c5780 2024-04-25T12:24:45.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f44fed46640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f44f80c8800 0x7f44f81f5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:45.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f44fed46640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f44f80c8800 0x7f44f81f5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56966/0 (socket says 172.21.15.94:56966) 2024-04-25T12:24:45.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f44fed46640 1 -- 172.21.15.94:0/2691555396 learned_addr learned my addr 172.21.15.94:0/2691555396 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:45.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f44fdd44640 1 --2- 172.21.15.94:0/2691555396 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f44f80c5780 0x7f44f81f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:45.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f44fe545640 1 --2- 172.21.15.94:0/2691555396 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f44f80c4b40 0x7f44f814dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:45.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f44fed46640 1 -- 172.21.15.94:0/2691555396 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f44f80c5780 msgr2=0x7f44f81f5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:45.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f44fed46640 1 --2- 172.21.15.94:0/2691555396 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f44f80c5780 0x7f44f81f5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f44fed46640 1 -- 172.21.15.94:0/2691555396 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f44f80c4b40 msgr2=0x7f44f814dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:45.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f44fed46640 1 --2- 172.21.15.94:0/2691555396 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f44f80c4b40 0x7f44f814dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f44fed46640 1 -- 172.21.15.94:0/2691555396 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f814c9d0 con 0x7f44f80c8800 2024-04-25T12:24:45.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f44fdd44640 1 --2- 172.21.15.94:0/2691555396 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f44f80c5780 0x7f44f81f5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:45.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f44fed46640 1 --2- 172.21.15.94:0/2691555396 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f44f80c8800 0x7f44f81f5d70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f44f000c730 tx=0x7f44f000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:45.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f44eeffd640 1 -- 172.21.15.94:0/2691555396 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f0003b80 con 0x7f44f80c8800 2024-04-25T12:24:45.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f44eeffd640 1 -- 172.21.15.94:0/2691555396 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44f0003d20 con 0x7f44f80c8800 2024-04-25T12:24:45.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f45007a9640 1 -- 172.21.15.94:0/2691555396 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f814c070 con 0x7f44f80c8800 2024-04-25T12:24:45.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f44eeffd640 1 -- 172.21.15.94:0/2691555396 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f0005310 con 0x7f44f80c8800 2024-04-25T12:24:45.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f45007a9640 1 -- 172.21.15.94:0/2691555396 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f814e270 con 0x7f44f80c8800 2024-04-25T12:24:45.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f45007a9640 1 -- 172.21.15.94:0/2691555396 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44f8075df0 con 0x7f44f80c8800 2024-04-25T12:24:45.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.718+0000 7f44eeffd640 1 -- 172.21.15.94:0/2691555396 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f44f00056c0 con 0x7f44f80c8800 2024-04-25T12:24:45.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.722+0000 7f44eeffd640 1 --2- 172.21.15.94:0/2691555396 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f44dc068380 0x7f44dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:45.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.722+0000 7f44eeffd640 1 -- 172.21.15.94:0/2691555396 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f44f0086e10 con 0x7f44f80c8800 2024-04-25T12:24:45.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.722+0000 7f44fe545640 1 --2- 172.21.15.94:0/2691555396 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f44dc068380 0x7f44dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:45.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.722+0000 7f44fe545640 1 --2- 172.21.15.94:0/2691555396 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f44dc068380 0x7f44dc06a840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f44e800ba10 tx=0x7f44e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:45.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.726+0000 7f44eeffd640 1 -- 172.21.15.94:0/2691555396 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f44f0056fe0 con 0x7f44f80c8800 2024-04-25T12:24:45.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.906+0000 7f45007a9640 1 -- 172.21.15.94:0/2691555396 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44f8074550 con 0x7f44f80c8800 2024-04-25T12:24:45.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.910+0000 7f44eeffd640 1 -- 172.21.15.94:0/2691555396 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6921 (secure 0 0 0) 0x7f44f005be20 con 0x7f44f80c8800 2024-04-25T12:24:45.914 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:45.914 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6838/1468945344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6835","nonce":1468945344},{"type":"v1","addr":"172.21.15.94:6838","nonce":1468945344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T12:21:53.517464+0000","modified":"2024-04-25T12:24:43.925388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4285,"mds_1":4276,"mds_2":4254,"mds_3":4229,"mds_4":4223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4223":{"gid":4223,"name":"e","rank":4,"incarnation":18,"state":"up:active","state_seq":46,"addr":"172.21.15.94:6839/3773379365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":3773379365},{"type":"v1","addr":"172.21.15.94:6839","nonce":3773379365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4229":{"gid":4229,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":44,"addr":"172.21.15.111:6835/3463503555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3463503555},{"type":"v1","addr":"172.21.15.111:6835","nonce":3463503555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4254":{"gid":4254,"name":"a","rank":2,"incarnation":14,"state":"up:active","state_seq":43,"addr":"172.21.15.94:6837/1182495659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1182495659},{"type":"v1","addr":"172.21.15.94:6837","nonce":1182495659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":41,"addr":"172.21.15.111:6833/2332499082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":2332499082},{"type":"v1","addr":"172.21.15.111:6833","nonce":2332499082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.111:6837/3560813143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":3560813143},{"type":"v1","addr":"172.21.15.111:6837","nonce":3560813143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4223,4229,4254,4276,4285]},"id":1}]} 2024-04-25T12:24:45.914 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 19 2024-04-25T12:24:45.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.910+0000 7f45007a9640 1 -- 172.21.15.94:0/2691555396 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f44dc068380 msgr2=0x7f44dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:45.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.910+0000 7f45007a9640 1 --2- 172.21.15.94:0/2691555396 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f44dc068380 0x7f44dc06a840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f44e800ba10 tx=0x7f44e8008040 comp rx=0 tx=0).stop 2024-04-25T12:24:45.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.910+0000 7f45007a9640 1 -- 172.21.15.94:0/2691555396 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f44f80c8800 msgr2=0x7f44f81f5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:45.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.910+0000 7f45007a9640 1 --2- 172.21.15.94:0/2691555396 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f44f80c8800 0x7f44f81f5d70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f44f000c730 tx=0x7f44f000cbf0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.910+0000 7f45007a9640 1 -- 172.21.15.94:0/2691555396 shutdown_connections 2024-04-25T12:24:45.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.910+0000 7f45007a9640 1 --2- 172.21.15.94:0/2691555396 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f44dc068380 0x7f44dc06a840 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.910+0000 7f45007a9640 1 --2- 172.21.15.94:0/2691555396 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f44f80c5780 0x7f44f81f5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.910+0000 7f45007a9640 1 --2- 172.21.15.94:0/2691555396 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f44f80c8800 0x7f44f81f5d70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.910+0000 7f45007a9640 1 --2- 172.21.15.94:0/2691555396 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f44f80c4b40 0x7f44f814dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:45.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.910+0000 7f45007a9640 1 -- 172.21.15.94:0/2691555396 >> 172.21.15.94:0/2691555396 conn(0x7f44f806b9d0 msgr2=0x7f44f80ca8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:45.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.910+0000 7f45007a9640 1 -- 172.21.15.94:0/2691555396 shutdown_connections 2024-04-25T12:24:45.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:45.910+0000 7f45007a9640 1 -- 172.21.15.94:0/2691555396 wait complete. 2024-04-25T12:24:46.536 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T12:21:53.517464+0000', 'modified': '2024-04-25T12:24:43.925388+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4285, 'mds_1': 4276, 'mds_2': 4254, 'mds_3': 4229, 'mds_4': 4223}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4223': {'gid': 4223, 'name': 'e', 'rank': 4, 'incarnation': 18, 'state': 'up:active', 'state_seq': 46, 'addr': '172.21.15.94:6839/3773379365', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6836', 'nonce': 3773379365}, {'type': 'v1', 'addr': '172.21.15.94:6839', 'nonce': 3773379365}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4229': {'gid': 4229, 'name': 'f', 'rank': 3, 'incarnation': 16, 'state': 'up:active', 'state_seq': 44, 'addr': '172.21.15.111:6835/3463503555', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6834', 'nonce': 3463503555}, {'type': 'v1', 'addr': '172.21.15.111:6835', 'nonce': 3463503555}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4254': {'gid': 4254, 'name': 'a', 'rank': 2, 'incarnation': 14, 'state': 'up:active', 'state_seq': 43, 'addr': '172.21.15.94:6837/1182495659', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6834', 'nonce': 1182495659}, {'type': 'v1', 'addr': '172.21.15.94:6837', 'nonce': 1182495659}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4276': {'gid': 4276, 'name': 'd', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 41, 'addr': '172.21.15.111:6833/2332499082', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6832', 'nonce': 2332499082}, {'type': 'v1', 'addr': '172.21.15.111:6833', 'nonce': 2332499082}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4285': {'gid': 4285, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.111:6837/3560813143', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6836', 'nonce': 3560813143}, {'type': 'v1', 'addr': '172.21.15.111:6837', 'nonce': 3560813143}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4285, 'qdb_cluster': [4223, 4229, 4254, 4276, 4285]} 2024-04-25T12:24:46.536 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-25T12:24:46.536 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-25T12:24:46.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.662+0000 7f5097549640 1 Processor -- start 2024-04-25T12:24:46.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.662+0000 7f5097549640 1 -- start start 2024-04-25T12:24:46.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.662+0000 7f5097549640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f509014fbc0 0x7f509006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:46.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.662+0000 7f5097549640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50900c5d70 con 0x7f509014ffa0 2024-04-25T12:24:46.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.662+0000 7f5097549640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50900c6050 con 0x7f5090074100 2024-04-25T12:24:46.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.662+0000 7f5097549640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f50900c6330 con 0x7f509014fbc0 2024-04-25T12:24:46.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.662+0000 7f5094ae4640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f509014ffa0 0x7f50900c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50234/0 (socket says 172.21.15.94:50234) 2024-04-25T12:24:46.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.662+0000 7f5094ae4640 1 -- 172.21.15.94:0/949867701 learned_addr learned my addr 172.21.15.94:0/949867701 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:46.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.662+0000 7f50952e5640 1 --2- 172.21.15.94:0/949867701 >> v2:172.21.15.111:3300/0 conn(0x7f509014fbc0 0x7f509006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:46.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.662+0000 7f5087fff640 1 -- 172.21.15.94:0/949867701 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2982838360 0 0) 0x7f50900c5d70 con 0x7f509014ffa0 2024-04-25T12:24:46.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.662+0000 7f5087fff640 1 -- 172.21.15.94:0/949867701 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f507c003530 con 0x7f509014ffa0 2024-04-25T12:24:46.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.662+0000 7f50952e5640 1 -- 172.21.15.94:0/949867701 >> v1:172.21.15.111:6789/0 conn(0x7f5090074100 legacy=0x7f50900c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:46.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.662+0000 7f50952e5640 1 -- 172.21.15.94:0/949867701 >> v1:172.21.15.94:6789/0 conn(0x7f509014ffa0 legacy=0x7f50900c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:46.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.662+0000 7f50952e5640 1 -- 172.21.15.94:0/949867701 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50900c6610 con 0x7f509014fbc0 2024-04-25T12:24:46.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.666+0000 7f50952e5640 1 --2- 172.21.15.94:0/949867701 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f509014fbc0 0x7f509006f700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f50880097f0 tx=0x7f508801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b70dc52ff5e558d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:46.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.666+0000 7f5087fff640 1 -- 172.21.15.94:0/949867701 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50880aa620 con 0x7f509014fbc0 2024-04-25T12:24:46.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.666+0000 7f5087fff640 1 -- 172.21.15.94:0/949867701 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50880af070 con 0x7f509014fbc0 2024-04-25T12:24:46.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.666+0000 7f5087fff640 1 -- 172.21.15.94:0/949867701 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50880aa9c0 con 0x7f509014fbc0 2024-04-25T12:24:46.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.666+0000 7f5097549640 1 -- 172.21.15.94:0/949867701 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f509014fbc0 msgr2=0x7f509006f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:46.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.666+0000 7f5097549640 1 --2- 172.21.15.94:0/949867701 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f509014fbc0 0x7f509006f700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f50880097f0 tx=0x7f508801c4a0 comp rx=0 tx=0).stop 2024-04-25T12:24:46.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.666+0000 7f5097549640 1 -- 172.21.15.94:0/949867701 shutdown_connections 2024-04-25T12:24:46.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.666+0000 7f5097549640 1 --2- 172.21.15.94:0/949867701 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f509014fbc0 0x7f509006f700 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:46.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.666+0000 7f5097549640 1 -- 172.21.15.94:0/949867701 >> 172.21.15.94:0/949867701 conn(0x7f509006b9d0 msgr2=0x7f509006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:46.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.666+0000 7f5097549640 1 -- 172.21.15.94:0/949867701 shutdown_connections 2024-04-25T12:24:46.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.666+0000 7f5097549640 1 -- 172.21.15.94:0/949867701 wait complete. 2024-04-25T12:24:46.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.666+0000 7f5097549640 1 Processor -- start 2024-04-25T12:24:46.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.666+0000 7f5097549640 1 -- start start 2024-04-25T12:24:46.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f5097549640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5090074100 0x7f5090148690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:46.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f5097549640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f509014fbc0 0x7f509015c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:46.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f5097549640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f509014ffa0 0x7f509015a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:46.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f5097549640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5090167630 con 0x7f509014fbc0 2024-04-25T12:24:46.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f5097549640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f50901674b0 con 0x7f509014ffa0 2024-04-25T12:24:46.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f5097549640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f50901677b0 con 0x7f5090074100 2024-04-25T12:24:46.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f5094ae4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f509014fbc0 0x7f509015c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:46.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f5094ae4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f509014fbc0 0x7f509015c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56982/0 (socket says 172.21.15.94:56982) 2024-04-25T12:24:46.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f5094ae4640 1 -- 172.21.15.94:0/4225223976 learned_addr learned my addr 172.21.15.94:0/4225223976 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:46.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f50952e5640 1 --2- 172.21.15.94:0/4225223976 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5090074100 0x7f5090148690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:46.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f5095ae6640 1 --2- 172.21.15.94:0/4225223976 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f509014ffa0 0x7f509015a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:46.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f5094ae4640 1 -- 172.21.15.94:0/4225223976 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5090074100 msgr2=0x7f5090148690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:46.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f5094ae4640 1 --2- 172.21.15.94:0/4225223976 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5090074100 0x7f5090148690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:46.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f5094ae4640 1 -- 172.21.15.94:0/4225223976 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f509014ffa0 msgr2=0x7f509015a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:46.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f5094ae4640 1 --2- 172.21.15.94:0/4225223976 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f509014ffa0 0x7f509015a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:46.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f5094ae4640 1 -- 172.21.15.94:0/4225223976 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50900c58c0 con 0x7f509014fbc0 2024-04-25T12:24:46.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f5095ae6640 1 --2- 172.21.15.94:0/4225223976 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f509014ffa0 0x7f509015a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:24:46.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f5094ae4640 1 --2- 172.21.15.94:0/4225223976 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f509014fbc0 0x7f509015c190 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f508000c420 tx=0x7f508000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:46.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f5085ffb640 1 -- 172.21.15.94:0/4225223976 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5080017070 con 0x7f509014fbc0 2024-04-25T12:24:46.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f5085ffb640 1 -- 172.21.15.94:0/4225223976 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5080005cf0 con 0x7f509014fbc0 2024-04-25T12:24:46.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f5097549640 1 -- 172.21.15.94:0/4225223976 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50901f8480 con 0x7f509014fbc0 2024-04-25T12:24:46.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f5085ffb640 1 -- 172.21.15.94:0/4225223976 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50800072d0 con 0x7f509014fbc0 2024-04-25T12:24:46.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f5097549640 1 -- 172.21.15.94:0/4225223976 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f509015cf40 con 0x7f509014fbc0 2024-04-25T12:24:46.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f5085ffb640 1 -- 172.21.15.94:0/4225223976 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f508001a070 con 0x7f509014fbc0 2024-04-25T12:24:46.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f5085ffb640 1 --2- 172.21.15.94:0/4225223976 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5074068380 0x7f507406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:46.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f5085ffb640 1 -- 172.21.15.94:0/4225223976 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f5080085fb0 con 0x7f509014fbc0 2024-04-25T12:24:46.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f50952e5640 1 --2- 172.21.15.94:0/4225223976 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5074068380 0x7f507406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:46.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.670+0000 7f50952e5640 1 --2- 172.21.15.94:0/4225223976 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5074068380 0x7f507406a840 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f50880ae000 tx=0x7f50880a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:46.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f509a6cb000 1 Processor -- start 2024-04-25T12:24:46.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f509a6cb000 1 -- start start 2024-04-25T12:24:46.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f509a6cb000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2b9c0d190 0x55f2b9c0d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:46.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f509a6cb000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 0x55f2b9c48080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:46.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f509a6cb000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f2b9c485c0 0x55f2b9c489a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:46.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f509a6cb000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55f2b9a56420 con 0x55f2b9c0dab0 2024-04-25T12:24:46.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f509a6cb000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55f2b99f0bf0 con 0x55f2b9c0d190 2024-04-25T12:24:46.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f509a6cb000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x55f2b9a523e0 con 0x55f2b9c485c0 2024-04-25T12:24:46.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f5094ae4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 0x55f2b9c48080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:46.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f5094ae4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 0x55f2b9c48080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56988/0 (socket says 172.21.15.94:56988) 2024-04-25T12:24:46.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f5094ae4640 1 -- 172.21.15.94:0/2480059513 learned_addr learned my addr 172.21.15.94:0/2480059513 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:46.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f50952e5640 1 --2- 172.21.15.94:0/2480059513 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2b9c0d190 0x55f2b9c0d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:46.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f5095ae6640 1 --2- 172.21.15.94:0/2480059513 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f2b9c485c0 0x55f2b9c489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:46.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f5094ae4640 1 -- 172.21.15.94:0/2480059513 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f2b9c485c0 msgr2=0x55f2b9c489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:46.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f5094ae4640 1 --2- 172.21.15.94:0/2480059513 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f2b9c485c0 0x55f2b9c489a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:46.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f5094ae4640 1 -- 172.21.15.94:0/2480059513 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2b9c0d190 msgr2=0x55f2b9c0d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:46.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f5094ae4640 1 --2- 172.21.15.94:0/2480059513 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2b9c0d190 0x55f2b9c0d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:46.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f5094ae4640 1 -- 172.21.15.94:0/2480059513 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2b9afe450 con 0x55f2b9c0dab0 2024-04-25T12:24:46.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f5094ae4640 1 --2- 172.21.15.94:0/2480059513 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 0x55f2b9c48080 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5080084120 tx=0x7f5080059ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6232d9f26b021b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:46.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f507affd640 1 -- 172.21.15.94:0/2480059513 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5080053ec0 con 0x55f2b9c0dab0 2024-04-25T12:24:46.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f507affd640 1 -- 172.21.15.94:0/2480059513 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5080052230 con 0x55f2b9c0dab0 2024-04-25T12:24:46.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f507affd640 1 -- 172.21.15.94:0/2480059513 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5080007670 con 0x55f2b9c0dab0 2024-04-25T12:24:46.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f509a6cb000 1 -- 172.21.15.94:0/2480059513 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 msgr2=0x55f2b9c48080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:46.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f509a6cb000 1 --2- 172.21.15.94:0/2480059513 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 0x55f2b9c48080 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5080084120 tx=0x7f5080059ec0 comp rx=0 tx=0).stop 2024-04-25T12:24:46.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f509a6cb000 1 -- 172.21.15.94:0/2480059513 shutdown_connections 2024-04-25T12:24:46.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f509a6cb000 1 --2- 172.21.15.94:0/2480059513 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f2b9c485c0 0x55f2b9c489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:46.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f509a6cb000 1 --2- 172.21.15.94:0/2480059513 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 0x55f2b9c48080 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:46.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f509a6cb000 1 --2- 172.21.15.94:0/2480059513 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2b9c0d190 0x55f2b9c0d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:46.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f509a6cb000 1 -- 172.21.15.94:0/2480059513 >> 172.21.15.94:0/2480059513 conn(0x55f2b9c44e40 msgr2=0x55f2b9c47260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:46.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f509a6cb000 1 -- 172.21.15.94:0/2480059513 shutdown_connections 2024-04-25T12:24:46.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f509a6cb000 1 -- 172.21.15.94:0/2480059513 wait complete. 2024-04-25T12:24:46.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f509a6cb000 1 -- start start 2024-04-25T12:24:46.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.674+0000 7f509a6cb000 1 Processor -- start 2024-04-25T12:24:46.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f509a6cb000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f2b9c0d190 0x55f2b9c09bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:46.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f509a6cb000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 0x55f2b9c0a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:46.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f509a6cb000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2b9c485c0 0x55f2b9c0a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:46.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f509a6cb000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55f2b99f6ec0 con 0x55f2b9c0dab0 2024-04-25T12:24:46.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f509a6cb000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55f2b9ad7120 con 0x55f2b9c485c0 2024-04-25T12:24:46.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f509a6cb000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x55f2b9a61350 con 0x55f2b9c0d190 2024-04-25T12:24:46.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f509a6cb000 10 client.0 _ll_register_callbacks cb 0x55f2b9a334d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:24:46.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f5094ae4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 0x55f2b9c0a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:46.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f5094ae4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 0x55f2b9c0a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57002/0 (socket says 172.21.15.94:57002) 2024-04-25T12:24:46.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f5094ae4640 1 -- 172.21.15.94:0/2349314777 learned_addr learned my addr 172.21.15.94:0/2349314777 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:46.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f50952e5640 1 --2- 172.21.15.94:0/2349314777 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f2b9c0d190 0x55f2b9c09bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:46.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f5095ae6640 1 --2- 172.21.15.94:0/2349314777 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2b9c485c0 0x55f2b9c0a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:46.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f5094ae4640 1 -- 172.21.15.94:0/2349314777 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f2b9c0d190 msgr2=0x55f2b9c09bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:46.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f5094ae4640 1 --2- 172.21.15.94:0/2349314777 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f2b9c0d190 0x55f2b9c09bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:46.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f5094ae4640 1 -- 172.21.15.94:0/2349314777 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2b9c485c0 msgr2=0x55f2b9c0a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:46.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f5094ae4640 1 --2- 172.21.15.94:0/2349314777 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2b9c485c0 0x55f2b9c0a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:46.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f5094ae4640 1 -- 172.21.15.94:0/2349314777 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2b9a9bf80 con 0x55f2b9c0dab0 2024-04-25T12:24:46.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f5094ae4640 1 --2- 172.21.15.94:0/2349314777 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 0x55f2b9c0a110 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5080007fd0 tx=0x7f5080000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a3a8ee4cc1eac6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:46.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f506ffff640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-04-25T12:24:46.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f506ffff640 1 -- 172.21.15.94:0/2349314777 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5080055210 con 0x55f2b9c0dab0 2024-04-25T12:24:46.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f506ffff640 1 -- 172.21.15.94:0/2349314777 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f508007dae0 con 0x55f2b9c0dab0 2024-04-25T12:24:46.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f509a6cb000 1 -- 172.21.15.94:0/2349314777 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5080052230 con 0x55f2b9c0dab0 2024-04-25T12:24:46.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f506ffff640 1 -- 172.21.15.94:0/2349314777 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f508007dce0 con 0x55f2b9c0dab0 2024-04-25T12:24:46.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f509a6cb000 10 client.4914 fetch_fsmap learned FSMap version 19 2024-04-25T12:24:46.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f509a6cb000 1 -- 172.21.15.94:0/2349314777 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55f2b9a2ff00 con 0x55f2b9c0dab0 2024-04-25T12:24:46.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f506ffff640 1 -- 172.21.15.94:0/2349314777 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5080052230 con 0x55f2b9c0dab0 2024-04-25T12:24:46.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f506ffff640 1 -- 172.21.15.94:0/2349314777 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f508006f030 con 0x55f2b9c0dab0 2024-04-25T12:24:46.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f509a6cb000 10 client.4914 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T12:24:46.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f509a6cb000 10 client.4914 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-25T12:24:46.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f509a6cb000 20 client.4914 populate_metadata read hostname 'smithi094' 2024-04-25T12:24:46.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f509a6cb000 1 --2- 172.21.15.94:0/2349314777 >> [v2:172.21.15.94:6836/3773379365,v1:172.21.15.94:6839/3773379365] conn(0x55f2b9c5cd90 0x55f2b9c5f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:46.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f509a6cb000 4 client.4914 mds_command: new command op to 4223 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T12:24:46.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f509a6cb000 1 -- 172.21.15.94:0/2349314777 --> [v2:172.21.15.94:6836/3773379365,v1:172.21.15.94:6839/3773379365] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2b99efbc0 con 0x55f2b9c5cd90 2024-04-25T12:24:46.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f50952e5640 1 --2- 172.21.15.94:0/2349314777 >> [v2:172.21.15.94:6836/3773379365,v1:172.21.15.94:6839/3773379365] conn(0x55f2b9c5cd90 0x55f2b9c5f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:46.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f506ffff640 10 client.4914 ms_handle_connect on v2:172.21.15.94:6836/3773379365 2024-04-25T12:24:46.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:46.678+0000 7f50952e5640 1 --2- 172.21.15.94:0/2349314777 >> [v2:172.21.15.94:6836/3773379365,v1:172.21.15.94:6839/3773379365] conn(0x55f2b9c5cd90 0x55f2b9c5f180 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c9ef8cef7460ab5b server_cookie=1ae840c320472044 in_seq=0 out_seq=0 2024-04-25T12:24:48.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.930+0000 7f506ffff640 1 -- 172.21.15.94:0/2349314777 <== mds.4 v2:172.21.15.94:6836/3773379365 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f2b99efbc0 con 0x55f2b9c5cd90 2024-04-25T12:24:48.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.930+0000 7f506ffff640 10 client.4914 handle_command_reply: tid=0 2024-04-25T12:24:48.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.930+0000 7f509a6cb000 1 client.4914 shutdown 2024-04-25T12:24:48.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.930+0000 7f509a6cb000 1 -- 172.21.15.94:0/2349314777 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 msgr2=0x55f2b9c0a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:48.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.930+0000 7f509a6cb000 1 --2- 172.21.15.94:0/2349314777 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 0x55f2b9c0a110 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5080007fd0 tx=0x7f5080000ee0 comp rx=0 tx=0).stop 2024-04-25T12:24:48.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.930+0000 7f509a6cb000 1 -- 172.21.15.94:0/2349314777 shutdown_connections 2024-04-25T12:24:48.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.930+0000 7f509a6cb000 1 --2- 172.21.15.94:0/2349314777 >> [v2:172.21.15.94:6836/3773379365,v1:172.21.15.94:6839/3773379365] conn(0x55f2b9c5cd90 0x55f2b9c5f180 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:48.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.930+0000 7f509a6cb000 1 --2- 172.21.15.94:0/2349314777 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2b9c485c0 0x55f2b9c0a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:48.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.930+0000 7f509a6cb000 1 --2- 172.21.15.94:0/2349314777 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 0x55f2b9c0a110 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:48.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.930+0000 7f506ffff640 0 client.4914 ms_handle_reset on v2:172.21.15.94:6836/3773379365 2024-04-25T12:24:48.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.930+0000 7f509a6cb000 1 --2- 172.21.15.94:0/2349314777 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f2b9c0d190 0x55f2b9c09bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:48.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.930+0000 7f509a6cb000 1 -- 172.21.15.94:0/2349314777 >> 172.21.15.94:0/2349314777 conn(0x55f2b9c44e40 msgr2=0x55f2b9c461c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:48.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.930+0000 7f509a6cb000 1 -- 172.21.15.94:0/2349314777 shutdown_connections 2024-04-25T12:24:48.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.930+0000 7f509a6cb000 1 -- 172.21.15.94:0/2349314777 wait complete. 2024-04-25T12:24:48.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.930+0000 7f509a6cb000 20 client.4914 trim_cache size 0 max 16384 2024-04-25T12:24:48.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.954+0000 7f509a6cb000 1 Processor -- start 2024-04-25T12:24:48.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.954+0000 7f509a6cb000 1 -- start start 2024-04-25T12:24:48.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.954+0000 7f509a6cb000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f2b9c0d190 0x55f2b9c43500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:48.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.954+0000 7f509a6cb000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 0x55f2b9c43a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:48.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.954+0000 7f509a6cb000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2b9c485c0 0x55f2b9cb46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.954+0000 7f509a6cb000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55f2b9a55730 con 0x55f2b9c0dab0 2024-04-25T12:24:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.954+0000 7f509a6cb000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55f2b9a5aa50 con 0x55f2b9c485c0 2024-04-25T12:24:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.954+0000 7f509a6cb000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x55f2b9a63630 con 0x55f2b9c0d190 2024-04-25T12:24:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f5094ae4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 0x55f2b9c43a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f5094ae4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 0x55f2b9c43a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57008/0 (socket says 172.21.15.94:57008) 2024-04-25T12:24:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f5094ae4640 1 -- 172.21.15.94:0/1028656925 learned_addr learned my addr 172.21.15.94:0/1028656925 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f5095ae6640 1 --2- 172.21.15.94:0/1028656925 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2b9c485c0 0x55f2b9cb46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f50952e5640 1 --2- 172.21.15.94:0/1028656925 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f2b9c0d190 0x55f2b9c43500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f5094ae4640 1 -- 172.21.15.94:0/1028656925 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f2b9c0d190 msgr2=0x55f2b9c43500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f5094ae4640 1 --2- 172.21.15.94:0/1028656925 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f2b9c0d190 0x55f2b9c43500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f5094ae4640 1 -- 172.21.15.94:0/1028656925 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2b9c485c0 msgr2=0x55f2b9cb46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f5094ae4640 1 --2- 172.21.15.94:0/1028656925 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2b9c485c0 0x55f2b9cb46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f5094ae4640 1 -- 172.21.15.94:0/1028656925 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2b99dce80 con 0x55f2b9c0dab0 2024-04-25T12:24:48.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f50952e5640 1 --2- 172.21.15.94:0/1028656925 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f2b9c0d190 0x55f2b9c43500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:48.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f5094ae4640 1 --2- 172.21.15.94:0/1028656925 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 0x55f2b9c43a40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5080055b00 tx=0x7f5080080040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a27c7b92ab56dab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:48.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f507a7fc640 1 -- 172.21.15.94:0/1028656925 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5080007780 con 0x55f2b9c0dab0 2024-04-25T12:24:48.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f507a7fc640 1 -- 172.21.15.94:0/1028656925 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5080053c60 con 0x55f2b9c0dab0 2024-04-25T12:24:48.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f507a7fc640 1 -- 172.21.15.94:0/1028656925 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5080055010 con 0x55f2b9c0dab0 2024-04-25T12:24:48.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f509a6cb000 1 -- 172.21.15.94:0/1028656925 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 msgr2=0x55f2b9c43a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:48.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f509a6cb000 1 --2- 172.21.15.94:0/1028656925 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 0x55f2b9c43a40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5080055b00 tx=0x7f5080080040 comp rx=0 tx=0).stop 2024-04-25T12:24:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f509a6cb000 1 -- 172.21.15.94:0/1028656925 shutdown_connections 2024-04-25T12:24:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f509a6cb000 1 --2- 172.21.15.94:0/1028656925 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2b9c485c0 0x55f2b9cb46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f509a6cb000 1 --2- 172.21.15.94:0/1028656925 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 0x55f2b9c43a40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f509a6cb000 1 --2- 172.21.15.94:0/1028656925 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f2b9c0d190 0x55f2b9c43500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f509a6cb000 1 -- 172.21.15.94:0/1028656925 >> 172.21.15.94:0/1028656925 conn(0x55f2b9c44e40 msgr2=0x55f2b9c623d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f509a6cb000 1 -- 172.21.15.94:0/1028656925 shutdown_connections 2024-04-25T12:24:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f509a6cb000 1 -- 172.21.15.94:0/1028656925 wait complete. 2024-04-25T12:24:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f509a6cb000 1 -- start start 2024-04-25T12:24:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f509a6cb000 1 Processor -- start 2024-04-25T12:24:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f509a6cb000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f2b9c0d190 0x55f2b9c7dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f509a6cb000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 0x55f2b9c7e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f509a6cb000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2b9c485c0 0x55f2b9c7e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f509a6cb000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55f2b99f6ec0 con 0x55f2b9c0dab0 2024-04-25T12:24:48.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f509a6cb000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55f2b99f6a40 con 0x55f2b9c485c0 2024-04-25T12:24:48.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f509a6cb000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x55f2b9ad7120 con 0x55f2b9c0d190 2024-04-25T12:24:48.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f509a6cb000 10 client.0 _ll_register_callbacks cb 0x7f50800557d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:24:48.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f5094ae4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 0x55f2b9c7e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:48.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f5094ae4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 0x55f2b9c7e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57018/0 (socket says 172.21.15.94:57018) 2024-04-25T12:24:48.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f5094ae4640 1 -- 172.21.15.94:0/1474728367 learned_addr learned my addr 172.21.15.94:0/1474728367 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:48.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f50952e5640 1 --2- 172.21.15.94:0/1474728367 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f2b9c0d190 0x55f2b9c7dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:48.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.958+0000 7f5095ae6640 1 --2- 172.21.15.94:0/1474728367 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2b9c485c0 0x55f2b9c7e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:48.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f5094ae4640 1 -- 172.21.15.94:0/1474728367 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f2b9c0d190 msgr2=0x55f2b9c7dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:48.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f5094ae4640 1 --2- 172.21.15.94:0/1474728367 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f2b9c0d190 0x55f2b9c7dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:48.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f5094ae4640 1 -- 172.21.15.94:0/1474728367 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2b9c485c0 msgr2=0x55f2b9c7e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:48.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f5094ae4640 1 --2- 172.21.15.94:0/1474728367 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2b9c485c0 0x55f2b9c7e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:48.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f5094ae4640 1 -- 172.21.15.94:0/1474728367 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2b9a1eb30 con 0x55f2b9c0dab0 2024-04-25T12:24:48.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f5095ae6640 1 --2- 172.21.15.94:0/1474728367 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2b9c485c0 0x55f2b9c7e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:24:48.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f5094ae4640 1 --2- 172.21.15.94:0/1474728367 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 0x55f2b9c7e2c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5080055b50 tx=0x7f508000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85161344c466edf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:48.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f506ffff640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-04-25T12:24:48.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f506ffff640 1 -- 172.21.15.94:0/1474728367 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5080007780 con 0x55f2b9c0dab0 2024-04-25T12:24:48.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f506ffff640 1 -- 172.21.15.94:0/1474728367 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f5080051b20 con 0x55f2b9c0dab0 2024-04-25T12:24:48.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f509a6cb000 1 -- 172.21.15.94:0/1474728367 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5080053c60 con 0x55f2b9c0dab0 2024-04-25T12:24:48.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f506ffff640 1 -- 172.21.15.94:0/1474728367 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5080054a80 con 0x55f2b9c0dab0 2024-04-25T12:24:48.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f509a6cb000 10 client.4920 fetch_fsmap learned FSMap version 19 2024-04-25T12:24:48.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f509a6cb000 1 -- 172.21.15.94:0/1474728367 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55f2b9ad75b0 con 0x55f2b9c0dab0 2024-04-25T12:24:48.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f506ffff640 1 -- 172.21.15.94:0/1474728367 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5080053c60 con 0x55f2b9c0dab0 2024-04-25T12:24:48.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f506ffff640 1 -- 172.21.15.94:0/1474728367 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f508006f040 con 0x55f2b9c0dab0 2024-04-25T12:24:48.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f509a6cb000 10 client.4920 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T12:24:48.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f509a6cb000 10 client.4920 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-25T12:24:48.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f509a6cb000 20 client.4920 populate_metadata read hostname 'smithi094' 2024-04-25T12:24:48.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f509a6cb000 1 --2- 172.21.15.94:0/1474728367 >> [v2:172.21.15.94:6836/3773379365,v1:172.21.15.94:6839/3773379365] conn(0x55f2b9c7f160 0x55f2b9cc5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:48.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f509a6cb000 4 client.4920 mds_command: new command op to 4223 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T12:24:48.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f509a6cb000 1 -- 172.21.15.94:0/1474728367 --> [v2:172.21.15.94:6836/3773379365,v1:172.21.15.94:6839/3773379365] -- command(tid 0: {"prefix": "status"}) -- 0x55f2b9a63e40 con 0x55f2b9c7f160 2024-04-25T12:24:48.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f50952e5640 1 --2- 172.21.15.94:0/1474728367 >> [v2:172.21.15.94:6836/3773379365,v1:172.21.15.94:6839/3773379365] conn(0x55f2b9c7f160 0x55f2b9cc5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:48.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f50952e5640 1 --2- 172.21.15.94:0/1474728367 >> [v2:172.21.15.94:6836/3773379365,v1:172.21.15.94:6839/3773379365] conn(0x55f2b9c7f160 0x55f2b9cc5c40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b9208b362aa7ec57 server_cookie=bad36313acd0ac9c in_seq=0 out_seq=0 2024-04-25T12:24:48.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f506ffff640 10 client.4920 ms_handle_connect on v2:172.21.15.94:6836/3773379365 2024-04-25T12:24:48.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f506ffff640 1 -- 172.21.15.94:0/1474728367 <== mds.4 v2:172.21.15.94:6836/3773379365 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55f2b9a63e40 con 0x55f2b9c7f160 2024-04-25T12:24:48.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f506ffff640 10 client.4920 handle_command_reply: tid=0 2024-04-25T12:24:48.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f509a6cb000 1 client.4920 shutdown 2024-04-25T12:24:48.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f509a6cb000 1 -- 172.21.15.94:0/1474728367 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 msgr2=0x55f2b9c7e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:48.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f509a6cb000 1 --2- 172.21.15.94:0/1474728367 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 0x55f2b9c7e2c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5080055b50 tx=0x7f508000cf90 comp rx=0 tx=0).stop 2024-04-25T12:24:48.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f509a6cb000 1 -- 172.21.15.94:0/1474728367 shutdown_connections 2024-04-25T12:24:48.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f509a6cb000 1 --2- 172.21.15.94:0/1474728367 >> [v2:172.21.15.94:6836/3773379365,v1:172.21.15.94:6839/3773379365] conn(0x55f2b9c7f160 0x55f2b9cc5c40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:48.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f509a6cb000 1 --2- 172.21.15.94:0/1474728367 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2b9c485c0 0x55f2b9c7e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:48.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f509a6cb000 1 --2- 172.21.15.94:0/1474728367 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f2b9c0dab0 0x55f2b9c7e2c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:48.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f506ffff640 0 client.4920 ms_handle_reset on v2:172.21.15.94:6836/3773379365 2024-04-25T12:24:48.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f509a6cb000 1 --2- 172.21.15.94:0/1474728367 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f2b9c0d190 0x55f2b9c7dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:48.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f509a6cb000 1 -- 172.21.15.94:0/1474728367 >> 172.21.15.94:0/1474728367 conn(0x55f2b9c44e40 msgr2=0x55f2b9c617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:48.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f509a6cb000 1 -- 172.21.15.94:0/1474728367 shutdown_connections 2024-04-25T12:24:48.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f509a6cb000 1 -- 172.21.15.94:0/1474728367 wait complete. 2024-04-25T12:24:48.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f509a6cb000 20 client.4920 trim_cache size 0 max 16384 2024-04-25T12:24:48.973 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-25T12:24:48.973 INFO:teuthology.orchestra.run.smithi094.stdout: "cluster_fsid": "7059a9e2-aec4-4b84-b942-caf531e15da3", 2024-04-25T12:24:48.973 INFO:teuthology.orchestra.run.smithi094.stdout: "whoami": 4, 2024-04-25T12:24:48.973 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 4223, 2024-04-25T12:24:48.974 INFO:teuthology.orchestra.run.smithi094.stdout: "want_state": "up:active", 2024-04-25T12:24:48.974 INFO:teuthology.orchestra.run.smithi094.stdout: "state": "up:active", 2024-04-25T12:24:48.974 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs", 2024-04-25T12:24:48.974 INFO:teuthology.orchestra.run.smithi094.stdout: "rank_uptime": 10.06099629, 2024-04-25T12:24:48.974 INFO:teuthology.orchestra.run.smithi094.stdout: "mdsmap_epoch": 19, 2024-04-25T12:24:48.974 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch": 28, 2024-04-25T12:24:48.974 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch_barrier": 28, 2024-04-25T12:24:48.974 INFO:teuthology.orchestra.run.smithi094.stdout: "uptime": 181.94352229099999 2024-04-25T12:24:48.974 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-25T12:24:48.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f5097549640 1 -- 172.21.15.94:0/4225223976 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5074068380 msgr2=0x7f507406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:48.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f5097549640 1 --2- 172.21.15.94:0/4225223976 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5074068380 0x7f507406a840 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f50880ae000 tx=0x7f50880a7000 comp rx=0 tx=0).stop 2024-04-25T12:24:48.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f5097549640 1 -- 172.21.15.94:0/4225223976 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f509014fbc0 msgr2=0x7f509015c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:48.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f5097549640 1 --2- 172.21.15.94:0/4225223976 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f509014fbc0 0x7f509015c190 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f508000c420 tx=0x7f508000c8e0 comp rx=0 tx=0).stop 2024-04-25T12:24:48.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f5097549640 1 -- 172.21.15.94:0/4225223976 shutdown_connections 2024-04-25T12:24:48.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f5097549640 1 --2- 172.21.15.94:0/4225223976 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5074068380 0x7f507406a840 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:48.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f5097549640 1 --2- 172.21.15.94:0/4225223976 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f509014ffa0 0x7f509015a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:48.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f5097549640 1 --2- 172.21.15.94:0/4225223976 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f509014fbc0 0x7f509015c190 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:48.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f5097549640 1 --2- 172.21.15.94:0/4225223976 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5090074100 0x7f5090148690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:48.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f5097549640 1 -- 172.21.15.94:0/4225223976 >> 172.21.15.94:0/4225223976 conn(0x7f509006b9d0 msgr2=0x7f50900cbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:48.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f5097549640 1 -- 172.21.15.94:0/4225223976 shutdown_connections 2024-04-25T12:24:48.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:48.962+0000 7f5097549640 1 -- 172.21.15.94:0/4225223976 wait complete. 2024-04-25T12:24:48.988 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-25T12:24:49.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabdaaaa640 1 Processor -- start 2024-04-25T12:24:49.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabdaaaa640 1 -- start start 2024-04-25T12:24:49.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabdaaaa640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabd414ffa0 0x7fabd406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabdaaaa640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabd40c5d70 con 0x7fabd414fbc0 2024-04-25T12:24:49.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabdaaaa640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabd40c6050 con 0x7fabd4074100 2024-04-25T12:24:49.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabdaaaa640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fabd40c6330 con 0x7fabd414ffa0 2024-04-25T12:24:49.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabd8846640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fabd414fbc0 0x7fabd40c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50246/0 (socket says 172.21.15.94:50246) 2024-04-25T12:24:49.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabd8846640 1 -- 172.21.15.94:0/297700895 learned_addr learned my addr 172.21.15.94:0/297700895 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:49.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabd3fff640 1 --2- 172.21.15.94:0/297700895 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabd414ffa0 0x7fabd406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabd37fe640 1 -- 172.21.15.94:0/297700895 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1381700736 0 0) 0x7fabd40c5d70 con 0x7fabd414fbc0 2024-04-25T12:24:49.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabd37fe640 1 -- 172.21.15.94:0/297700895 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabbc003530 con 0x7fabd414fbc0 2024-04-25T12:24:49.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabd37fe640 1 -- 172.21.15.94:0/297700895 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4060618157 0 0) 0x7fabbc003530 con 0x7fabd414fbc0 2024-04-25T12:24:49.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabd37fe640 1 -- 172.21.15.94:0/297700895 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabd414ffa0 msgr2=0x7fabd406f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabd37fe640 1 --2- 172.21.15.94:0/297700895 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabd414ffa0 0x7fabd406f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabd37fe640 1 -- 172.21.15.94:0/297700895 >> v1:172.21.15.111:6789/0 conn(0x7fabd4074100 legacy=0x7fabd40c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabd37fe640 1 -- 172.21.15.94:0/297700895 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd40c6610 con 0x7fabd414fbc0 2024-04-25T12:24:49.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabd37fe640 1 -- 172.21.15.94:0/297700895 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7fabc4001680 con 0x7fabd414fbc0 2024-04-25T12:24:49.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabd37fe640 1 -- 172.21.15.94:0/297700895 >> v1:172.21.15.94:6789/0 conn(0x7fabd414fbc0 legacy=0x7fabd40c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabd37fe640 1 --2- 172.21.15.94:0/297700895 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabd414ffa0 0x7fabbc0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabd37fe640 1 --2- 172.21.15.94:0/297700895 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabbc003f30 0x7fabbc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabd37fe640 1 --2- 172.21.15.94:0/297700895 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fabbc004d50 0x7fabbc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabd37fe640 1 -- 172.21.15.94:0/297700895 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fabd40c6330 con 0x7fabbc004d50 2024-04-25T12:24:49.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabd37fe640 1 -- 172.21.15.94:0/297700895 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fabbc00ba30 con 0x7fabbc003f30 2024-04-25T12:24:49.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabd37fe640 1 -- 172.21.15.94:0/297700895 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fabbc00bc30 con 0x7fabd414ffa0 2024-04-25T12:24:49.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabd9047640 1 --2- 172.21.15.94:0/297700895 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fabbc004d50 0x7fabbc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabd8846640 1 --2- 172.21.15.94:0/297700895 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabd414ffa0 0x7fabbc0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabd3fff640 1 --2- 172.21.15.94:0/297700895 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabbc003f30 0x7fabbc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabd9047640 1 -- 172.21.15.94:0/297700895 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabd414ffa0 msgr2=0x7fabbc0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabd9047640 1 --2- 172.21.15.94:0/297700895 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabd414ffa0 0x7fabbc0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabd9047640 1 -- 172.21.15.94:0/297700895 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabbc003f30 msgr2=0x7fabbc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabd9047640 1 --2- 172.21.15.94:0/297700895 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabbc003f30 0x7fabbc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.102+0000 7fabd9047640 1 -- 172.21.15.94:0/297700895 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabbc003530 con 0x7fabbc004d50 2024-04-25T12:24:49.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.106+0000 7fabd9047640 1 --2- 172.21.15.94:0/297700895 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fabbc004d50 0x7fabbc0051d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fabd40ca3b0 tx=0x7fabcc01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1608727e31082c52 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.106+0000 7fabd37fe640 1 -- 172.21.15.94:0/297700895 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabcc001460 con 0x7fabbc004d50 2024-04-25T12:24:49.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.106+0000 7fabd37fe640 1 -- 172.21.15.94:0/297700895 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabcc0b0070 con 0x7fabbc004d50 2024-04-25T12:24:49.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.106+0000 7fabd37fe640 1 -- 172.21.15.94:0/297700895 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabcc0ab880 con 0x7fabbc004d50 2024-04-25T12:24:49.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.106+0000 7fabdaaaa640 1 -- 172.21.15.94:0/297700895 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fabbc004d50 msgr2=0x7fabbc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.106+0000 7fabdaaaa640 1 --2- 172.21.15.94:0/297700895 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fabbc004d50 0x7fabbc0051d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fabd40ca3b0 tx=0x7fabcc01c4c0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.106+0000 7fabd9047640 1 -- 172.21.15.94:0/297700895 reap_dead start 2024-04-25T12:24:49.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.106+0000 7fabdaaaa640 1 -- 172.21.15.94:0/297700895 shutdown_connections 2024-04-25T12:24:49.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.106+0000 7fabdaaaa640 1 -- 172.21.15.94:0/297700895 >> 172.21.15.94:0/297700895 conn(0x7fabd406b9d0 msgr2=0x7fabd406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:49.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.106+0000 7fabdaaaa640 1 -- 172.21.15.94:0/297700895 shutdown_connections 2024-04-25T12:24:49.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.106+0000 7fabdaaaa640 1 -- 172.21.15.94:0/297700895 wait complete. 2024-04-25T12:24:49.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.106+0000 7fabdaaaa640 1 Processor -- start 2024-04-25T12:24:49.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.106+0000 7fabdaaaa640 1 -- start start 2024-04-25T12:24:49.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.106+0000 7fabdaaaa640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabbc004d50 0x7fabd41e32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabdaaaa640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fabd41df060 0x7fabd41e3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabdaaaa640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabd41e1ca0 0x7fabd41e2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabdaaaa640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fabd4068350 con 0x7fabd41df060 2024-04-25T12:24:49.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabdaaaa640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fabd40681d0 con 0x7fabbc004d50 2024-04-25T12:24:49.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabdaaaa640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fabd40c8930 con 0x7fabd41e1ca0 2024-04-25T12:24:49.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabd3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fabd41df060 0x7fabd41e3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabd3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fabd41df060 0x7fabd41e3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57024/0 (socket says 172.21.15.94:57024) 2024-04-25T12:24:49.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabd3fff640 1 -- 172.21.15.94:0/275246288 learned_addr learned my addr 172.21.15.94:0/275246288 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:49.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabd9047640 1 --2- 172.21.15.94:0/275246288 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabd41e1ca0 0x7fabd41e2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabd8846640 1 --2- 172.21.15.94:0/275246288 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabbc004d50 0x7fabd41e32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabd3fff640 1 -- 172.21.15.94:0/275246288 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabd41e1ca0 msgr2=0x7fabd41e2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabd3fff640 1 --2- 172.21.15.94:0/275246288 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabd41e1ca0 0x7fabd41e2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabd3fff640 1 -- 172.21.15.94:0/275246288 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabbc004d50 msgr2=0x7fabd41e32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabd3fff640 1 --2- 172.21.15.94:0/275246288 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabbc004d50 0x7fabd41e32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabd3fff640 1 -- 172.21.15.94:0/275246288 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd41e4c00 con 0x7fabd41df060 2024-04-25T12:24:49.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabd3fff640 1 --2- 172.21.15.94:0/275246288 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fabd41df060 0x7fabd41e3e10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fabc8007f30 tx=0x7fabc8011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabd17fa640 1 -- 172.21.15.94:0/275246288 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc801a020 con 0x7fabd41df060 2024-04-25T12:24:49.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabd17fa640 1 -- 172.21.15.94:0/275246288 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc8016470 con 0x7fabd41df060 2024-04-25T12:24:49.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabdaaaa640 1 -- 172.21.15.94:0/275246288 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabd41e4ec0 con 0x7fabd41df060 2024-04-25T12:24:49.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabd17fa640 1 -- 172.21.15.94:0/275246288 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc8016860 con 0x7fabd41df060 2024-04-25T12:24:49.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabdaaaa640 1 -- 172.21.15.94:0/275246288 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabd41ef4a0 con 0x7fabd41df060 2024-04-25T12:24:49.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabd17fa640 1 -- 172.21.15.94:0/275246288 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fabc801d020 con 0x7fabd41df060 2024-04-25T12:24:49.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabd17fa640 1 --2- 172.21.15.94:0/275246288 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fabc0068380 0x7fabc006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabd17fa640 1 -- 172.21.15.94:0/275246288 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fabc8087db0 con 0x7fabd41df060 2024-04-25T12:24:49.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabd8846640 1 --2- 172.21.15.94:0/275246288 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fabc0068380 0x7fabc006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabd8846640 1 --2- 172.21.15.94:0/275246288 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fabc0068380 0x7fabc006a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fabc4001060 tx=0x7fabc4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabddc2c000 1 Processor -- start 2024-04-25T12:24:49.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.110+0000 7fabddc2c000 1 -- start start 2024-04-25T12:24:49.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabddc2c000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x558137aa2190 0x558137aa2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabddc2c000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2ab0 0x558137add080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabddc2c000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558137add5c0 0x558137add9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabddc2c000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5581378eb420 con 0x558137aa2ab0 2024-04-25T12:24:49.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabddc2c000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x558137885bf0 con 0x558137add5c0 2024-04-25T12:24:49.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabddc2c000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x5581378e73e0 con 0x558137aa2190 2024-04-25T12:24:49.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabd3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2ab0 0x558137add080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabd3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2ab0 0x558137add080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57040/0 (socket says 172.21.15.94:57040) 2024-04-25T12:24:49.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabd3fff640 1 -- 172.21.15.94:0/4093674664 learned_addr learned my addr 172.21.15.94:0/4093674664 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:49.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabd9047640 1 --2- 172.21.15.94:0/4093674664 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558137add5c0 0x558137add9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabd8846640 1 --2- 172.21.15.94:0/4093674664 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x558137aa2190 0x558137aa2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabd3fff640 1 -- 172.21.15.94:0/4093674664 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x558137aa2190 msgr2=0x558137aa2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabd3fff640 1 --2- 172.21.15.94:0/4093674664 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x558137aa2190 0x558137aa2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabd3fff640 1 -- 172.21.15.94:0/4093674664 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558137add5c0 msgr2=0x558137add9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabd3fff640 1 --2- 172.21.15.94:0/4093674664 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558137add5c0 0x558137add9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabd3fff640 1 -- 172.21.15.94:0/4093674664 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558137993450 con 0x558137aa2ab0 2024-04-25T12:24:49.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabd3fff640 1 --2- 172.21.15.94:0/4093674664 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2ab0 0x558137add080 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fabc8085ef0 tx=0x7fabc8057930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6449befcbcdb9e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabba7fc640 1 -- 172.21.15.94:0/4093674664 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc8055af0 con 0x558137aa2ab0 2024-04-25T12:24:49.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabba7fc640 1 -- 172.21.15.94:0/4093674664 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc8053e60 con 0x558137aa2ab0 2024-04-25T12:24:49.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabba7fc640 1 -- 172.21.15.94:0/4093674664 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc8060210 con 0x558137aa2ab0 2024-04-25T12:24:49.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabddc2c000 1 -- 172.21.15.94:0/4093674664 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2ab0 msgr2=0x558137add080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabddc2c000 1 --2- 172.21.15.94:0/4093674664 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2ab0 0x558137add080 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fabc8085ef0 tx=0x7fabc8057930 comp rx=0 tx=0).stop 2024-04-25T12:24:49.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabddc2c000 1 -- 172.21.15.94:0/4093674664 shutdown_connections 2024-04-25T12:24:49.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabddc2c000 1 --2- 172.21.15.94:0/4093674664 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558137add5c0 0x558137add9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabddc2c000 1 --2- 172.21.15.94:0/4093674664 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2ab0 0x558137add080 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabddc2c000 1 --2- 172.21.15.94:0/4093674664 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x558137aa2190 0x558137aa2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabddc2c000 1 -- 172.21.15.94:0/4093674664 >> 172.21.15.94:0/4093674664 conn(0x558137ad9e40 msgr2=0x558137adc260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:49.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabddc2c000 1 -- 172.21.15.94:0/4093674664 shutdown_connections 2024-04-25T12:24:49.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabddc2c000 1 -- 172.21.15.94:0/4093674664 wait complete. 2024-04-25T12:24:49.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabddc2c000 1 -- start start 2024-04-25T12:24:49.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabddc2c000 1 Processor -- start 2024-04-25T12:24:49.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabddc2c000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2190 0x558137a9ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabddc2c000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x558137aa2ab0 0x558137a9f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabddc2c000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558137add5c0 0x558137a9f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabddc2c000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55813788bec0 con 0x558137aa2190 2024-04-25T12:24:49.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabddc2c000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55813796c120 con 0x558137add5c0 2024-04-25T12:24:49.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabddc2c000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x5581378f6350 con 0x558137aa2ab0 2024-04-25T12:24:49.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabddc2c000 10 client.0 _ll_register_callbacks cb 0x5581378c84d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:24:49.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabd8846640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2190 0x558137a9ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabd8846640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2190 0x558137a9ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57048/0 (socket says 172.21.15.94:57048) 2024-04-25T12:24:49.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabd8846640 1 -- 172.21.15.94:0/2499943986 learned_addr learned my addr 172.21.15.94:0/2499943986 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:49.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabd9047640 1 --2- 172.21.15.94:0/2499943986 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558137add5c0 0x558137a9f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabd3fff640 1 --2- 172.21.15.94:0/2499943986 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x558137aa2ab0 0x558137a9f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabd8846640 1 -- 172.21.15.94:0/2499943986 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x558137aa2ab0 msgr2=0x558137a9f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabd8846640 1 --2- 172.21.15.94:0/2499943986 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x558137aa2ab0 0x558137a9f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabd8846640 1 -- 172.21.15.94:0/2499943986 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558137add5c0 msgr2=0x558137a9f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabd8846640 1 --2- 172.21.15.94:0/2499943986 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558137add5c0 0x558137a9f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabd8846640 1 -- 172.21.15.94:0/2499943986 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558137930f80 con 0x558137aa2190 2024-04-25T12:24:49.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabd8846640 1 --2- 172.21.15.94:0/2499943986 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2190 0x558137a9ebd0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fabc4014d50 tx=0x7fabd406c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee0b3bb88eea0ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.114+0000 7fabb37fe640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-04-25T12:24:49.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabb37fe640 1 -- 172.21.15.94:0/2499943986 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc4025440 con 0x558137aa2190 2024-04-25T12:24:49.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabb37fe640 1 -- 172.21.15.94:0/2499943986 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fabc400fc60 con 0x558137aa2190 2024-04-25T12:24:49.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabddc2c000 1 -- 172.21.15.94:0/2499943986 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabc8053e60 con 0x558137aa2190 2024-04-25T12:24:49.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabb37fe640 1 -- 172.21.15.94:0/2499943986 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fabc400fe60 con 0x558137aa2190 2024-04-25T12:24:49.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabddc2c000 10 client.4932 fetch_fsmap learned FSMap version 19 2024-04-25T12:24:49.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabddc2c000 1 -- 172.21.15.94:0/2499943986 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5581378c4f00 con 0x558137aa2190 2024-04-25T12:24:49.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabb37fe640 1 -- 172.21.15.94:0/2499943986 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc8053e60 con 0x558137aa2190 2024-04-25T12:24:49.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabb37fe640 1 -- 172.21.15.94:0/2499943986 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7fabc400f4e0 con 0x558137aa2190 2024-04-25T12:24:49.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabddc2c000 10 client.4932 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T12:24:49.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabddc2c000 10 client.4932 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T12:24:49.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabddc2c000 20 client.4932 populate_metadata read hostname 'smithi094' 2024-04-25T12:24:49.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabddc2c000 1 --2- 172.21.15.94:0/2499943986 >> [v2:172.21.15.111:6834/3463503555,v1:172.21.15.111:6835/3463503555] conn(0x558137af1d90 0x558137af4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabddc2c000 4 client.4932 mds_command: new command op to 4229 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T12:24:49.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabddc2c000 1 -- 172.21.15.94:0/2499943986 --> [v2:172.21.15.111:6834/3463503555,v1:172.21.15.111:6835/3463503555] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558137884bc0 con 0x558137af1d90 2024-04-25T12:24:49.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabd3fff640 1 --2- 172.21.15.94:0/2499943986 >> [v2:172.21.15.111:6834/3463503555,v1:172.21.15.111:6835/3463503555] conn(0x558137af1d90 0x558137af4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabd3fff640 1 --2- 172.21.15.94:0/2499943986 >> [v2:172.21.15.111:6834/3463503555,v1:172.21.15.111:6835/3463503555] conn(0x558137af1d90 0x558137af4180 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=618ea809333ad9ea server_cookie=a79fc813b7948944 in_seq=0 out_seq=0 2024-04-25T12:24:49.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabb37fe640 10 client.4932 ms_handle_connect on v2:172.21.15.111:6834/3463503555 2024-04-25T12:24:49.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabb37fe640 1 -- 172.21.15.94:0/2499943986 <== mds.3 v2:172.21.15.111:6834/3463503555 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558137884bc0 con 0x558137af1d90 2024-04-25T12:24:49.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabb37fe640 10 client.4932 handle_command_reply: tid=0 2024-04-25T12:24:49.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabddc2c000 1 client.4932 shutdown 2024-04-25T12:24:49.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabddc2c000 1 -- 172.21.15.94:0/2499943986 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2190 msgr2=0x558137a9ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabddc2c000 1 --2- 172.21.15.94:0/2499943986 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2190 0x558137a9ebd0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fabc4014d50 tx=0x7fabd406c720 comp rx=0 tx=0).stop 2024-04-25T12:24:49.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabddc2c000 1 -- 172.21.15.94:0/2499943986 shutdown_connections 2024-04-25T12:24:49.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabddc2c000 1 --2- 172.21.15.94:0/2499943986 >> [v2:172.21.15.111:6834/3463503555,v1:172.21.15.111:6835/3463503555] conn(0x558137af1d90 0x558137af4180 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabddc2c000 1 --2- 172.21.15.94:0/2499943986 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x558137aa2ab0 0x558137a9f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabddc2c000 1 --2- 172.21.15.94:0/2499943986 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558137add5c0 0x558137a9f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabddc2c000 1 --2- 172.21.15.94:0/2499943986 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2190 0x558137a9ebd0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabb37fe640 0 client.4932 ms_handle_reset on v2:172.21.15.111:6834/3463503555 2024-04-25T12:24:49.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabddc2c000 1 -- 172.21.15.94:0/2499943986 >> 172.21.15.94:0/2499943986 conn(0x558137ad9e40 msgr2=0x558137adb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:49.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabddc2c000 1 -- 172.21.15.94:0/2499943986 shutdown_connections 2024-04-25T12:24:49.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabddc2c000 1 -- 172.21.15.94:0/2499943986 wait complete. 2024-04-25T12:24:49.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.118+0000 7fabddc2c000 20 client.4932 trim_cache size 0 max 16384 2024-04-25T12:24:49.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabddc2c000 1 Processor -- start 2024-04-25T12:24:49.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabddc2c000 1 -- start start 2024-04-25T12:24:49.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabddc2c000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2190 0x558137ad7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabddc2c000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558137aa2ab0 0x558137ad83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabddc2c000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x558137add5c0 0x558137af4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabddc2c000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fabd41fc9c0 con 0x558137aa2190 2024-04-25T12:24:49.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabddc2c000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fabd41fd090 con 0x558137aa2ab0 2024-04-25T12:24:49.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabddc2c000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fabd41f2a00 con 0x558137add5c0 2024-04-25T12:24:49.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabd8846640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2190 0x558137ad7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabd8846640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2190 0x558137ad7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57050/0 (socket says 172.21.15.94:57050) 2024-04-25T12:24:49.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabd8846640 1 -- 172.21.15.94:0/4270581225 learned_addr learned my addr 172.21.15.94:0/4270581225 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:49.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabd3fff640 1 --2- 172.21.15.94:0/4270581225 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558137aa2ab0 0x558137ad83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabd9047640 1 --2- 172.21.15.94:0/4270581225 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x558137add5c0 0x558137af4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabd8846640 1 -- 172.21.15.94:0/4270581225 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x558137add5c0 msgr2=0x558137af4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabd8846640 1 --2- 172.21.15.94:0/4270581225 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x558137add5c0 0x558137af4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabd8846640 1 -- 172.21.15.94:0/4270581225 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558137aa2ab0 msgr2=0x558137ad83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabd8846640 1 --2- 172.21.15.94:0/4270581225 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558137aa2ab0 0x558137ad83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabd8846640 1 -- 172.21.15.94:0/4270581225 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558137871e80 con 0x558137aa2190 2024-04-25T12:24:49.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabd8846640 1 --2- 172.21.15.94:0/4270581225 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2190 0x558137ad7e90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fabc4001b30 tx=0x7fabc4025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17f63eabef78a50 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabb9ffb640 1 -- 172.21.15.94:0/4270581225 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc403e020 con 0x558137aa2190 2024-04-25T12:24:49.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabb9ffb640 1 -- 172.21.15.94:0/4270581225 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc402a070 con 0x558137aa2190 2024-04-25T12:24:49.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabb9ffb640 1 -- 172.21.15.94:0/4270581225 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc400fc70 con 0x558137aa2190 2024-04-25T12:24:49.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabddc2c000 1 -- 172.21.15.94:0/4270581225 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2190 msgr2=0x558137ad7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabddc2c000 1 --2- 172.21.15.94:0/4270581225 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2190 0x558137ad7e90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fabc4001b30 tx=0x7fabc4025000 comp rx=0 tx=0).stop 2024-04-25T12:24:49.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabddc2c000 1 -- 172.21.15.94:0/4270581225 shutdown_connections 2024-04-25T12:24:49.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabddc2c000 1 --2- 172.21.15.94:0/4270581225 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x558137add5c0 0x558137af4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabddc2c000 1 --2- 172.21.15.94:0/4270581225 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558137aa2ab0 0x558137ad83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabddc2c000 1 --2- 172.21.15.94:0/4270581225 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2190 0x558137ad7e90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabddc2c000 1 -- 172.21.15.94:0/4270581225 >> 172.21.15.94:0/4270581225 conn(0x558137ad9e40 msgr2=0x558137a9bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:49.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabddc2c000 1 -- 172.21.15.94:0/4270581225 shutdown_connections 2024-04-25T12:24:49.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabddc2c000 1 -- 172.21.15.94:0/4270581225 wait complete. 2024-04-25T12:24:49.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabddc2c000 1 -- start start 2024-04-25T12:24:49.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.138+0000 7fabddc2c000 1 Processor -- start 2024-04-25T12:24:49.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x558137aa2190 0x558137af68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2ab0 0x558137b12d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558137add5c0 0x558137b132c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5581378ea730 con 0x558137aa2ab0 2024-04-25T12:24:49.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5581378b79e0 con 0x558137add5c0 2024-04-25T12:24:49.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x5581378efa50 con 0x558137aa2190 2024-04-25T12:24:49.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 10 client.0 _ll_register_callbacks cb 0x7fabc4000f60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:24:49.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabd3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2ab0 0x558137b12d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabd3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2ab0 0x558137b12d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57056/0 (socket says 172.21.15.94:57056) 2024-04-25T12:24:49.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabd3fff640 1 -- 172.21.15.94:0/2500800858 learned_addr learned my addr 172.21.15.94:0/2500800858 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:49.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabd8846640 1 --2- 172.21.15.94:0/2500800858 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x558137aa2190 0x558137af68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabd9047640 1 --2- 172.21.15.94:0/2500800858 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558137add5c0 0x558137b132c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabd3fff640 1 -- 172.21.15.94:0/2500800858 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x558137aa2190 msgr2=0x558137af68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabd3fff640 1 --2- 172.21.15.94:0/2500800858 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x558137aa2190 0x558137af68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabd3fff640 1 -- 172.21.15.94:0/2500800858 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558137add5c0 msgr2=0x558137b132c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabd3fff640 1 --2- 172.21.15.94:0/2500800858 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558137add5c0 0x558137b132c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabd3fff640 1 -- 172.21.15.94:0/2500800858 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581378b3b30 con 0x558137aa2ab0 2024-04-25T12:24:49.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabd9047640 1 --2- 172.21.15.94:0/2500800858 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558137add5c0 0x558137b132c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:49.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabd3fff640 1 --2- 172.21.15.94:0/2500800858 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2ab0 0x558137b12d80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fabc805bd60 tx=0x7fabc805b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa2e82261e0f2564 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabb37fe640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-04-25T12:24:49.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabb37fe640 1 -- 172.21.15.94:0/2500800858 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc80575c0 con 0x558137aa2ab0 2024-04-25T12:24:49.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabb37fe640 1 -- 172.21.15.94:0/2500800858 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fabc807cc50 con 0x558137aa2ab0 2024-04-25T12:24:49.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 1 -- 172.21.15.94:0/2500800858 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabc402a070 con 0x558137aa2ab0 2024-04-25T12:24:49.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabb37fe640 1 -- 172.21.15.94:0/2500800858 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fabc8053e60 con 0x558137aa2ab0 2024-04-25T12:24:49.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 10 client.4938 fetch_fsmap learned FSMap version 19 2024-04-25T12:24:49.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 1 -- 172.21.15.94:0/2500800858 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55813796c5b0 con 0x558137aa2ab0 2024-04-25T12:24:49.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabb37fe640 1 -- 172.21.15.94:0/2500800858 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc402a070 con 0x558137aa2ab0 2024-04-25T12:24:49.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabb37fe640 1 -- 172.21.15.94:0/2500800858 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7fabc805ffd0 con 0x558137aa2ab0 2024-04-25T12:24:49.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 10 client.4938 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T12:24:49.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 10 client.4938 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T12:24:49.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 20 client.4938 populate_metadata read hostname 'smithi094' 2024-04-25T12:24:49.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 1 --2- 172.21.15.94:0/2500800858 >> [v2:172.21.15.111:6834/3463503555,v1:172.21.15.111:6835/3463503555] conn(0x558137b52170 0x558137b52550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 4 client.4938 mds_command: new command op to 4229 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T12:24:49.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 1 -- 172.21.15.94:0/2500800858 --> [v2:172.21.15.111:6834/3463503555,v1:172.21.15.111:6835/3463503555] -- command(tid 0: {"prefix": "status"}) -- 0x5581378f8e40 con 0x558137b52170 2024-04-25T12:24:49.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabd8846640 1 --2- 172.21.15.94:0/2500800858 >> [v2:172.21.15.111:6834/3463503555,v1:172.21.15.111:6835/3463503555] conn(0x558137b52170 0x558137b52550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabd8846640 1 --2- 172.21.15.94:0/2500800858 >> [v2:172.21.15.111:6834/3463503555,v1:172.21.15.111:6835/3463503555] conn(0x558137b52170 0x558137b52550 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3ae5c154985a27f server_cookie=485544c68ad8c5ac in_seq=0 out_seq=0 2024-04-25T12:24:49.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabb37fe640 10 client.4938 ms_handle_connect on v2:172.21.15.111:6834/3463503555 2024-04-25T12:24:49.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabb37fe640 1 -- 172.21.15.94:0/2500800858 <== mds.3 v2:172.21.15.111:6834/3463503555 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5581378f8e40 con 0x558137b52170 2024-04-25T12:24:49.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabb37fe640 10 client.4938 handle_command_reply: tid=0 2024-04-25T12:24:49.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 1 client.4938 shutdown 2024-04-25T12:24:49.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 1 -- 172.21.15.94:0/2500800858 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2ab0 msgr2=0x558137b12d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 1 --2- 172.21.15.94:0/2500800858 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2ab0 0x558137b12d80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fabc805bd60 tx=0x7fabc805b000 comp rx=0 tx=0).stop 2024-04-25T12:24:49.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 1 -- 172.21.15.94:0/2500800858 shutdown_connections 2024-04-25T12:24:49.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 1 --2- 172.21.15.94:0/2500800858 >> [v2:172.21.15.111:6834/3463503555,v1:172.21.15.111:6835/3463503555] conn(0x558137b52170 0x558137b52550 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 1 --2- 172.21.15.94:0/2500800858 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558137add5c0 0x558137b132c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 1 --2- 172.21.15.94:0/2500800858 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x558137aa2ab0 0x558137b12d80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabb37fe640 0 client.4938 ms_handle_reset on v2:172.21.15.111:6834/3463503555 2024-04-25T12:24:49.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 1 --2- 172.21.15.94:0/2500800858 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x558137aa2190 0x558137af68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 1 -- 172.21.15.94:0/2500800858 >> 172.21.15.94:0/2500800858 conn(0x558137ad9e40 msgr2=0x558137ad7600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:49.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 1 -- 172.21.15.94:0/2500800858 shutdown_connections 2024-04-25T12:24:49.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 1 -- 172.21.15.94:0/2500800858 wait complete. 2024-04-25T12:24:49.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabddc2c000 20 client.4938 trim_cache size 0 max 16384 2024-04-25T12:24:49.155 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-25T12:24:49.155 INFO:teuthology.orchestra.run.smithi094.stdout: "cluster_fsid": "7059a9e2-aec4-4b84-b942-caf531e15da3", 2024-04-25T12:24:49.155 INFO:teuthology.orchestra.run.smithi094.stdout: "whoami": 3, 2024-04-25T12:24:49.155 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 4229, 2024-04-25T12:24:49.155 INFO:teuthology.orchestra.run.smithi094.stdout: "want_state": "up:active", 2024-04-25T12:24:49.155 INFO:teuthology.orchestra.run.smithi094.stdout: "state": "up:active", 2024-04-25T12:24:49.155 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs", 2024-04-25T12:24:49.155 INFO:teuthology.orchestra.run.smithi094.stdout: "rank_uptime": 16.261869520000001, 2024-04-25T12:24:49.155 INFO:teuthology.orchestra.run.smithi094.stdout: "mdsmap_epoch": 19, 2024-04-25T12:24:49.156 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch": 28, 2024-04-25T12:24:49.156 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch_barrier": 28, 2024-04-25T12:24:49.156 INFO:teuthology.orchestra.run.smithi094.stdout: "uptime": 181.99087225299999 2024-04-25T12:24:49.156 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-25T12:24:49.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabdaaaa640 1 -- 172.21.15.94:0/275246288 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fabc0068380 msgr2=0x7fabc006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabdaaaa640 1 --2- 172.21.15.94:0/275246288 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fabc0068380 0x7fabc006a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fabc4001060 tx=0x7fabc4009040 comp rx=0 tx=0).stop 2024-04-25T12:24:49.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabdaaaa640 1 -- 172.21.15.94:0/275246288 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fabd41df060 msgr2=0x7fabd41e3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabdaaaa640 1 --2- 172.21.15.94:0/275246288 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fabd41df060 0x7fabd41e3e10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fabc8007f30 tx=0x7fabc8011660 comp rx=0 tx=0).stop 2024-04-25T12:24:49.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabdaaaa640 1 -- 172.21.15.94:0/275246288 shutdown_connections 2024-04-25T12:24:49.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabdaaaa640 1 --2- 172.21.15.94:0/275246288 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fabc0068380 0x7fabc006a840 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabdaaaa640 1 --2- 172.21.15.94:0/275246288 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabd41e1ca0 0x7fabd41e2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabdaaaa640 1 --2- 172.21.15.94:0/275246288 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fabd41df060 0x7fabd41e3e10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabdaaaa640 1 --2- 172.21.15.94:0/275246288 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabbc004d50 0x7fabd41e32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabdaaaa640 1 -- 172.21.15.94:0/275246288 >> 172.21.15.94:0/275246288 conn(0x7fabd406b9d0 msgr2=0x7fabd414bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:49.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabdaaaa640 1 -- 172.21.15.94:0/275246288 shutdown_connections 2024-04-25T12:24:49.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.142+0000 7fabdaaaa640 1 -- 172.21.15.94:0/275246288 wait complete. 2024-04-25T12:24:49.165 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T12:24:49.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.274+0000 7fe762ab9640 1 Processor -- start 2024-04-25T12:24:49.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.274+0000 7fe762ab9640 1 -- start start 2024-04-25T12:24:49.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.274+0000 7fe762ab9640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe75c151f40 0x7fe75c0c9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.274+0000 7fe762ab9640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe75c072ae0 0x7fe75c15b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.274+0000 7fe762ab9640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe75c06cfd0 0x7fe75c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.274+0000 7fe762ab9640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fe75c157da0 con 0x7fe75c151f40 2024-04-25T12:24:49.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.274+0000 7fe762ab9640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fe75c0c89e0 con 0x7fe75c072ae0 2024-04-25T12:24:49.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.274+0000 7fe762ab9640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe75c0c8c80 con 0x7fe75c06cfd0 2024-04-25T12:24:49.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.274+0000 7fe760855640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe75c151f40 0x7fe75c0c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.274+0000 7fe760855640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe75c151f40 0x7fe75c0c9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57060/0 (socket says 172.21.15.94:57060) 2024-04-25T12:24:49.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.274+0000 7fe760855640 1 -- 172.21.15.94:0/334035170 learned_addr learned my addr 172.21.15.94:0/334035170 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:49.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.274+0000 7fe75bfff640 1 --2- 172.21.15.94:0/334035170 >> v2:172.21.15.111:3300/0 conn(0x7fe75c072ae0 0x7fe75c15b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.274+0000 7fe761056640 1 --2- 172.21.15.94:0/334035170 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe75c06cfd0 0x7fe75c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.274+0000 7fe760855640 1 -- 172.21.15.94:0/334035170 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe75c06cfd0 msgr2=0x7fe75c06d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.274+0000 7fe760855640 1 --2- 172.21.15.94:0/334035170 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe75c06cfd0 0x7fe75c06d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.274+0000 7fe760855640 1 -- 172.21.15.94:0/334035170 >> v2:172.21.15.111:3300/0 conn(0x7fe75c072ae0 msgr2=0x7fe75c15b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.274+0000 7fe760855640 1 --2- 172.21.15.94:0/334035170 >> v2:172.21.15.111:3300/0 conn(0x7fe75c072ae0 0x7fe75c15b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.274+0000 7fe760855640 1 -- 172.21.15.94:0/334035170 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe75c158020 con 0x7fe75c151f40 2024-04-25T12:24:49.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.274+0000 7fe761056640 1 --2- 172.21.15.94:0/334035170 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe75c06cfd0 0x7fe75c06d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:49.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.274+0000 7fe75bfff640 1 --2- 172.21.15.94:0/334035170 >> v2:172.21.15.111:3300/0 conn(0x7fe75c072ae0 0x7fe75c15b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:49.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.278+0000 7fe760855640 1 --2- 172.21.15.94:0/334035170 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe75c151f40 0x7fe75c0c9630 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe75c15c3f0 tx=0x7fe75401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7078b9e2ca06a03b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.278+0000 7fe75b7fe640 1 -- 172.21.15.94:0/334035170 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7540b5070 con 0x7fe75c151f40 2024-04-25T12:24:49.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.278+0000 7fe75b7fe640 1 -- 172.21.15.94:0/334035170 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7540a89d0 con 0x7fe75c151f40 2024-04-25T12:24:49.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.278+0000 7fe75b7fe640 1 -- 172.21.15.94:0/334035170 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7540a8da0 con 0x7fe75c151f40 2024-04-25T12:24:49.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.278+0000 7fe762ab9640 1 -- 172.21.15.94:0/334035170 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe75c151f40 msgr2=0x7fe75c0c9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.278+0000 7fe762ab9640 1 --2- 172.21.15.94:0/334035170 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe75c151f40 0x7fe75c0c9630 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe75c15c3f0 tx=0x7fe75401ed10 comp rx=0 tx=0).stop 2024-04-25T12:24:49.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.278+0000 7fe762ab9640 1 -- 172.21.15.94:0/334035170 shutdown_connections 2024-04-25T12:24:49.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.278+0000 7fe762ab9640 1 --2- 172.21.15.94:0/334035170 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe75c06cfd0 0x7fe75c06d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.278+0000 7fe762ab9640 1 --2- 172.21.15.94:0/334035170 >> v2:172.21.15.111:3300/0 conn(0x7fe75c072ae0 0x7fe75c15b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.278+0000 7fe762ab9640 1 --2- 172.21.15.94:0/334035170 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe75c151f40 0x7fe75c0c9630 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.278+0000 7fe762ab9640 1 -- 172.21.15.94:0/334035170 >> 172.21.15.94:0/334035170 conn(0x7fe75c0ca540 msgr2=0x7fe75c0ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:49.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.278+0000 7fe762ab9640 1 -- 172.21.15.94:0/334035170 shutdown_connections 2024-04-25T12:24:49.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.278+0000 7fe762ab9640 1 -- 172.21.15.94:0/334035170 wait complete. 2024-04-25T12:24:49.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.278+0000 7fe762ab9640 1 Processor -- start 2024-04-25T12:24:49.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.278+0000 7fe762ab9640 1 -- start start 2024-04-25T12:24:49.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe762ab9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe75c06cfd0 0x7fe75c1ef040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe762ab9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe75c072ae0 0x7fe75c14d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe762ab9640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe75c151f40 0x7fe75c0cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe762ab9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe75c0c9b70 con 0x7fe75c072ae0 2024-04-25T12:24:49.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe762ab9640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe75c1585e0 con 0x7fe75c06cfd0 2024-04-25T12:24:49.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe762ab9640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe75c0c9170 con 0x7fe75c151f40 2024-04-25T12:24:49.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe75bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe75c072ae0 0x7fe75c14d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe75bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe75c072ae0 0x7fe75c14d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57068/0 (socket says 172.21.15.94:57068) 2024-04-25T12:24:49.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe75bfff640 1 -- 172.21.15.94:0/3594561611 learned_addr learned my addr 172.21.15.94:0/3594561611 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:49.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe760855640 1 --2- 172.21.15.94:0/3594561611 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe75c06cfd0 0x7fe75c1ef040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe761056640 1 --2- 172.21.15.94:0/3594561611 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe75c151f40 0x7fe75c0cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe75bfff640 1 -- 172.21.15.94:0/3594561611 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe75c151f40 msgr2=0x7fe75c0cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe75bfff640 1 --2- 172.21.15.94:0/3594561611 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe75c151f40 0x7fe75c0cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe75bfff640 1 -- 172.21.15.94:0/3594561611 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe75c06cfd0 msgr2=0x7fe75c1ef040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe75bfff640 1 --2- 172.21.15.94:0/3594561611 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe75c06cfd0 0x7fe75c1ef040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe75bfff640 1 -- 172.21.15.94:0/3594561611 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe75c0cd3d0 con 0x7fe75c072ae0 2024-04-25T12:24:49.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe75bfff640 1 --2- 172.21.15.94:0/3594561611 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe75c072ae0 0x7fe75c14d0d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe74400c7f0 tx=0x7fe74400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe7597fa640 1 -- 172.21.15.94:0/3594561611 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe744007a30 con 0x7fe75c072ae0 2024-04-25T12:24:49.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe7597fa640 1 -- 172.21.15.94:0/3594561611 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe744007bd0 con 0x7fe75c072ae0 2024-04-25T12:24:49.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe762ab9640 1 -- 172.21.15.94:0/3594561611 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe75c0c6050 con 0x7fe75c072ae0 2024-04-25T12:24:49.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe7597fa640 1 -- 172.21.15.94:0/3594561611 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7440113f0 con 0x7fe75c072ae0 2024-04-25T12:24:49.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe762ab9640 1 -- 172.21.15.94:0/3594561611 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe75c0c6610 con 0x7fe75c072ae0 2024-04-25T12:24:49.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe7597fa640 1 -- 172.21.15.94:0/3594561611 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe744011590 con 0x7fe75c072ae0 2024-04-25T12:24:49.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe7597fa640 1 --2- 172.21.15.94:0/3594561611 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe73c0683b0 0x7fe73c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe7597fa640 1 -- 172.21.15.94:0/3594561611 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fe744086fc0 con 0x7fe75c072ae0 2024-04-25T12:24:49.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe760855640 1 --2- 172.21.15.94:0/3594561611 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe73c0683b0 0x7fe73c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe760855640 1 --2- 172.21.15.94:0/3594561611 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe73c0683b0 0x7fe73c06a870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe7540b2000 tx=0x7fe754008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe765c3b000 1 Processor -- start 2024-04-25T12:24:49.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.282+0000 7fe765c3b000 1 -- start start 2024-04-25T12:24:49.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe765c3b000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214841fd0 0x5632148423b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe765c3b000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563214846080 0x563214846460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe765c3b000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632148469a0 0x563214846d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe765c3b000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x563214654420 con 0x563214841fd0 2024-04-25T12:24:49.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe765c3b000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5632145eebf0 con 0x5632148469a0 2024-04-25T12:24:49.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe765c3b000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x5632146503e0 con 0x563214846080 2024-04-25T12:24:49.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe760855640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214841fd0 0x5632148423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe760855640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214841fd0 0x5632148423b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57072/0 (socket says 172.21.15.94:57072) 2024-04-25T12:24:49.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe760855640 1 -- 172.21.15.94:0/3856383165 learned_addr learned my addr 172.21.15.94:0/3856383165 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:49.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe75bfff640 1 --2- 172.21.15.94:0/3856383165 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563214846080 0x563214846460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe760855640 1 -- 172.21.15.94:0/3856383165 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563214846080 msgr2=0x563214846460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe760855640 1 --2- 172.21.15.94:0/3856383165 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563214846080 0x563214846460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe760855640 1 -- 172.21.15.94:0/3856383165 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632148469a0 msgr2=0x563214846d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe760855640 1 --2- 172.21.15.94:0/3856383165 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632148469a0 0x563214846d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe760855640 1 -- 172.21.15.94:0/3856383165 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632146fc450 con 0x563214841fd0 2024-04-25T12:24:49.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe75bfff640 1 --2- 172.21.15.94:0/3856383165 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563214846080 0x563214846460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:49.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe760855640 1 --2- 172.21.15.94:0/3856383165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214841fd0 0x5632148423b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe754008010 tx=0x7fe754004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa018d4deffffc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe7527fc640 1 -- 172.21.15.94:0/3856383165 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7540cb070 con 0x563214841fd0 2024-04-25T12:24:49.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe7527fc640 1 -- 172.21.15.94:0/3856383165 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7540b0500 con 0x563214841fd0 2024-04-25T12:24:49.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe7527fc640 1 -- 172.21.15.94:0/3856383165 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7540b5040 con 0x563214841fd0 2024-04-25T12:24:49.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe765c3b000 1 -- 172.21.15.94:0/3856383165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214841fd0 msgr2=0x5632148423b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe765c3b000 1 --2- 172.21.15.94:0/3856383165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214841fd0 0x5632148423b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe754008010 tx=0x7fe754004740 comp rx=0 tx=0).stop 2024-04-25T12:24:49.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe765c3b000 1 -- 172.21.15.94:0/3856383165 shutdown_connections 2024-04-25T12:24:49.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe765c3b000 1 --2- 172.21.15.94:0/3856383165 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563214846080 0x563214846460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe765c3b000 1 --2- 172.21.15.94:0/3856383165 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632148469a0 0x563214846d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe765c3b000 1 --2- 172.21.15.94:0/3856383165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214841fd0 0x5632148423b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe765c3b000 1 -- 172.21.15.94:0/3856383165 >> 172.21.15.94:0/3856383165 conn(0x563214842e40 msgr2=0x563214845260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:49.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe765c3b000 1 -- 172.21.15.94:0/3856383165 shutdown_connections 2024-04-25T12:24:49.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe765c3b000 1 -- 172.21.15.94:0/3856383165 wait complete. 2024-04-25T12:24:49.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe765c3b000 1 -- start start 2024-04-25T12:24:49.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe765c3b000 1 Processor -- start 2024-04-25T12:24:49.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe765c3b000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563214841fd0 0x5632148492a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe765c3b000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214846080 0x5632148497e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe765c3b000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632148469a0 0x563214849d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe765c3b000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x5632145f4ec0 con 0x563214846080 2024-04-25T12:24:49.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe765c3b000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5632146d5120 con 0x5632148469a0 2024-04-25T12:24:49.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe765c3b000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x56321465f350 con 0x563214841fd0 2024-04-25T12:24:49.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe765c3b000 10 client.0 _ll_register_callbacks cb 0x5632146314d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:24:49.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe75bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214846080 0x5632148497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe75bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214846080 0x5632148497e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57080/0 (socket says 172.21.15.94:57080) 2024-04-25T12:24:49.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe75bfff640 1 -- 172.21.15.94:0/190650603 learned_addr learned my addr 172.21.15.94:0/190650603 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:49.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe761056640 1 --2- 172.21.15.94:0/190650603 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632148469a0 0x563214849d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe75bfff640 1 -- 172.21.15.94:0/190650603 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563214841fd0 msgr2=0x5632148492a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe760855640 1 --2- 172.21.15.94:0/190650603 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563214841fd0 0x5632148492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe75bfff640 1 --2- 172.21.15.94:0/190650603 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563214841fd0 0x5632148492a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.286+0000 7fe75bfff640 1 -- 172.21.15.94:0/190650603 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632148469a0 msgr2=0x563214849d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe75bfff640 1 --2- 172.21.15.94:0/190650603 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632148469a0 0x563214849d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe75bfff640 1 -- 172.21.15.94:0/190650603 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563214699f80 con 0x563214846080 2024-04-25T12:24:49.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe75bfff640 1 --2- 172.21.15.94:0/190650603 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214846080 0x5632148497e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe744004780 tx=0x7fe744056b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aaf92d02ee18f35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe73b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-04-25T12:24:49.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe73b7fe640 1 -- 172.21.15.94:0/190650603 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74401e050 con 0x563214846080 2024-04-25T12:24:49.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe73b7fe640 1 -- 172.21.15.94:0/190650603 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fe744056050 con 0x563214846080 2024-04-25T12:24:49.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe765c3b000 1 -- 172.21.15.94:0/190650603 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7540b0500 con 0x563214846080 2024-04-25T12:24:49.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe73b7fe640 1 -- 172.21.15.94:0/190650603 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe744052750 con 0x563214846080 2024-04-25T12:24:49.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe765c3b000 10 client.4950 fetch_fsmap learned FSMap version 19 2024-04-25T12:24:49.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe765c3b000 1 -- 172.21.15.94:0/190650603 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x56321462df00 con 0x563214846080 2024-04-25T12:24:49.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe73b7fe640 1 -- 172.21.15.94:0/190650603 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7540b0500 con 0x563214846080 2024-04-25T12:24:49.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe73b7fe640 1 -- 172.21.15.94:0/190650603 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7fe744071030 con 0x563214846080 2024-04-25T12:24:49.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe765c3b000 10 client.4950 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T12:24:49.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe765c3b000 10 client.4950 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T12:24:49.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe765c3b000 20 client.4950 populate_metadata read hostname 'smithi094' 2024-04-25T12:24:49.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe765c3b000 1 --2- 172.21.15.94:0/190650603 >> [v2:172.21.15.94:6834/1182495659,v1:172.21.15.94:6837/1182495659] conn(0x56321484a730 0x5632148615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe765c3b000 4 client.4950 mds_command: new command op to 4254 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T12:24:49.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe765c3b000 1 -- 172.21.15.94:0/190650603 --> [v2:172.21.15.94:6834/1182495659,v1:172.21.15.94:6837/1182495659] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632145edbc0 con 0x56321484a730 2024-04-25T12:24:49.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe760855640 1 --2- 172.21.15.94:0/190650603 >> [v2:172.21.15.94:6834/1182495659,v1:172.21.15.94:6837/1182495659] conn(0x56321484a730 0x5632148615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe73b7fe640 10 client.4950 ms_handle_connect on v2:172.21.15.94:6834/1182495659 2024-04-25T12:24:49.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe760855640 1 --2- 172.21.15.94:0/190650603 >> [v2:172.21.15.94:6834/1182495659,v1:172.21.15.94:6837/1182495659] conn(0x56321484a730 0x5632148615e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=33f9152dfbd761e8 server_cookie=5bbd612b6d78bdc6 in_seq=0 out_seq=0 2024-04-25T12:24:49.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe73b7fe640 1 -- 172.21.15.94:0/190650603 <== mds.2 v2:172.21.15.94:6834/1182495659 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5632145edbc0 con 0x56321484a730 2024-04-25T12:24:49.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe73b7fe640 10 client.4950 handle_command_reply: tid=0 2024-04-25T12:24:49.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe765c3b000 1 client.4950 shutdown 2024-04-25T12:24:49.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe765c3b000 1 -- 172.21.15.94:0/190650603 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214846080 msgr2=0x5632148497e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe765c3b000 1 --2- 172.21.15.94:0/190650603 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214846080 0x5632148497e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe744004780 tx=0x7fe744056b40 comp rx=0 tx=0).stop 2024-04-25T12:24:49.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe765c3b000 1 -- 172.21.15.94:0/190650603 shutdown_connections 2024-04-25T12:24:49.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe765c3b000 1 --2- 172.21.15.94:0/190650603 >> [v2:172.21.15.94:6834/1182495659,v1:172.21.15.94:6837/1182495659] conn(0x56321484a730 0x5632148615e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe765c3b000 1 --2- 172.21.15.94:0/190650603 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632148469a0 0x563214849d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe765c3b000 1 --2- 172.21.15.94:0/190650603 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214846080 0x5632148497e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe73b7fe640 0 client.4950 ms_handle_reset on v2:172.21.15.94:6834/1182495659 2024-04-25T12:24:49.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe765c3b000 1 --2- 172.21.15.94:0/190650603 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563214841fd0 0x5632148492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe765c3b000 1 -- 172.21.15.94:0/190650603 >> 172.21.15.94:0/190650603 conn(0x563214842e40 msgr2=0x563214845230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:49.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe765c3b000 1 -- 172.21.15.94:0/190650603 shutdown_connections 2024-04-25T12:24:49.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe765c3b000 1 -- 172.21.15.94:0/190650603 wait complete. 2024-04-25T12:24:49.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.290+0000 7fe765c3b000 20 client.4950 trim_cache size 0 max 16384 2024-04-25T12:24:49.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.306+0000 7fe765c3b000 1 Processor -- start 2024-04-25T12:24:49.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.306+0000 7fe765c3b000 1 -- start start 2024-04-25T12:24:49.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.306+0000 7fe765c3b000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214841fd0 0x56321480b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.306+0000 7fe765c3b000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563214846080 0x56321480b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.306+0000 7fe765c3b000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5632148469a0 0x56321485f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.306+0000 7fe765c3b000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe75c1fa300 con 0x563214841fd0 2024-04-25T12:24:49.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.306+0000 7fe765c3b000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe75c1fa9d0 con 0x563214846080 2024-04-25T12:24:49.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.306+0000 7fe765c3b000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe75c1543e0 con 0x5632148469a0 2024-04-25T12:24:49.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.306+0000 7fe760855640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214841fd0 0x56321480b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.306+0000 7fe760855640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214841fd0 0x56321480b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57086/0 (socket says 172.21.15.94:57086) 2024-04-25T12:24:49.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.306+0000 7fe760855640 1 -- 172.21.15.94:0/1563406454 learned_addr learned my addr 172.21.15.94:0/1563406454 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:49.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.306+0000 7fe760855640 1 -- 172.21.15.94:0/1563406454 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5632148469a0 msgr2=0x56321485f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.306+0000 7fe760855640 1 --2- 172.21.15.94:0/1563406454 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5632148469a0 0x56321485f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.306+0000 7fe760855640 1 -- 172.21.15.94:0/1563406454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563214846080 msgr2=0x56321480b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.306+0000 7fe760855640 1 --2- 172.21.15.94:0/1563406454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563214846080 0x56321480b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.306+0000 7fe760855640 1 -- 172.21.15.94:0/1563406454 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632145dae80 con 0x563214841fd0 2024-04-25T12:24:49.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe760855640 1 --2- 172.21.15.94:0/1563406454 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214841fd0 0x56321480b060 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe754008010 tx=0x7fe754009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651dd7d980166156 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe751ffb640 1 -- 172.21.15.94:0/1563406454 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7540cb040 con 0x563214841fd0 2024-04-25T12:24:49.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe751ffb640 1 -- 172.21.15.94:0/1563406454 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7540b0890 con 0x563214841fd0 2024-04-25T12:24:49.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe751ffb640 1 -- 172.21.15.94:0/1563406454 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7540b5040 con 0x563214841fd0 2024-04-25T12:24:49.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 1 -- 172.21.15.94:0/1563406454 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214841fd0 msgr2=0x56321480b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 1 --2- 172.21.15.94:0/1563406454 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214841fd0 0x56321480b060 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe754008010 tx=0x7fe754009240 comp rx=0 tx=0).stop 2024-04-25T12:24:49.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 1 -- 172.21.15.94:0/1563406454 shutdown_connections 2024-04-25T12:24:49.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 1 --2- 172.21.15.94:0/1563406454 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5632148469a0 0x56321485f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 1 --2- 172.21.15.94:0/1563406454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563214846080 0x56321480b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 1 --2- 172.21.15.94:0/1563406454 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214841fd0 0x56321480b060 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 1 -- 172.21.15.94:0/1563406454 >> 172.21.15.94:0/1563406454 conn(0x563214842e40 msgr2=0x56321480a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:49.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 1 -- 172.21.15.94:0/1563406454 shutdown_connections 2024-04-25T12:24:49.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 1 -- 172.21.15.94:0/1563406454 wait complete. 2024-04-25T12:24:49.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 1 -- start start 2024-04-25T12:24:49.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 1 Processor -- start 2024-04-25T12:24:49.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214841fd0 0x5632148b9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563214846080 0x5632148b9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5632148469a0 0x563214862630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x563214653730 con 0x563214841fd0 2024-04-25T12:24:49.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5632146209e0 con 0x563214846080 2024-04-25T12:24:49.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x563214658a50 con 0x5632148469a0 2024-04-25T12:24:49.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 10 client.0 _ll_register_callbacks cb 0x7fe744052ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:24:49.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe760855640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214841fd0 0x5632148b9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe760855640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214841fd0 0x5632148b9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57088/0 (socket says 172.21.15.94:57088) 2024-04-25T12:24:49.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe760855640 1 -- 172.21.15.94:0/3952252912 learned_addr learned my addr 172.21.15.94:0/3952252912 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:49.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe75bfff640 1 --2- 172.21.15.94:0/3952252912 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563214846080 0x5632148b9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe760855640 1 -- 172.21.15.94:0/3952252912 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5632148469a0 msgr2=0x563214862630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe760855640 1 --2- 172.21.15.94:0/3952252912 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5632148469a0 0x563214862630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe760855640 1 -- 172.21.15.94:0/3952252912 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563214846080 msgr2=0x5632148b9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe760855640 1 --2- 172.21.15.94:0/3952252912 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563214846080 0x5632148b9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe760855640 1 -- 172.21.15.94:0/3952252912 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56321461cb30 con 0x563214841fd0 2024-04-25T12:24:49.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe760855640 1 --2- 172.21.15.94:0/3952252912 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214841fd0 0x5632148b9910 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe75401f5b0 tx=0x7fe75401d550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a3e497f55a84d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe73b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-04-25T12:24:49.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe73b7fe640 1 -- 172.21.15.94:0/3952252912 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7540cb070 con 0x563214841fd0 2024-04-25T12:24:49.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe73b7fe640 1 -- 172.21.15.94:0/3952252912 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fe7540b0ac0 con 0x563214841fd0 2024-04-25T12:24:49.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 1 -- 172.21.15.94:0/3952252912 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7540b0890 con 0x563214841fd0 2024-04-25T12:24:49.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe73b7fe640 1 -- 172.21.15.94:0/3952252912 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe7540dc050 con 0x563214841fd0 2024-04-25T12:24:49.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 10 client.4956 fetch_fsmap learned FSMap version 19 2024-04-25T12:24:49.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 1 -- 172.21.15.94:0/3952252912 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5632146d55b0 con 0x563214841fd0 2024-04-25T12:24:49.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe73b7fe640 1 -- 172.21.15.94:0/3952252912 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7540b0890 con 0x563214841fd0 2024-04-25T12:24:49.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe73b7fe640 1 -- 172.21.15.94:0/3952252912 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7fe7540df020 con 0x563214841fd0 2024-04-25T12:24:49.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 10 client.4956 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T12:24:49.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 10 client.4956 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T12:24:49.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 20 client.4956 populate_metadata read hostname 'smithi094' 2024-04-25T12:24:49.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 1 --2- 172.21.15.94:0/3952252912 >> [v2:172.21.15.94:6834/1182495659,v1:172.21.15.94:6837/1182495659] conn(0x563214862ff0 0x5632148633d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 4 client.4956 mds_command: new command op to 4254 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T12:24:49.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe765c3b000 1 -- 172.21.15.94:0/3952252912 --> [v2:172.21.15.94:6834/1182495659,v1:172.21.15.94:6837/1182495659] -- command(tid 0: {"prefix": "status"}) -- 0x563214661e40 con 0x563214862ff0 2024-04-25T12:24:49.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe75bfff640 1 --2- 172.21.15.94:0/3952252912 >> [v2:172.21.15.94:6834/1182495659,v1:172.21.15.94:6837/1182495659] conn(0x563214862ff0 0x5632148633d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe75bfff640 1 --2- 172.21.15.94:0/3952252912 >> [v2:172.21.15.94:6834/1182495659,v1:172.21.15.94:6837/1182495659] conn(0x563214862ff0 0x5632148633d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=191fcded89926a93 server_cookie=8daa1f128115cfb4 in_seq=0 out_seq=0 2024-04-25T12:24:49.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe73b7fe640 10 client.4956 ms_handle_connect on v2:172.21.15.94:6834/1182495659 2024-04-25T12:24:49.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe73b7fe640 1 -- 172.21.15.94:0/3952252912 <== mds.2 v2:172.21.15.94:6834/1182495659 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x563214661e40 con 0x563214862ff0 2024-04-25T12:24:49.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.310+0000 7fe73b7fe640 10 client.4956 handle_command_reply: tid=0 2024-04-25T12:24:49.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.314+0000 7fe765c3b000 1 client.4956 shutdown 2024-04-25T12:24:49.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.314+0000 7fe765c3b000 1 -- 172.21.15.94:0/3952252912 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214841fd0 msgr2=0x5632148b9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.314+0000 7fe765c3b000 1 --2- 172.21.15.94:0/3952252912 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214841fd0 0x5632148b9910 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe75401f5b0 tx=0x7fe75401d550 comp rx=0 tx=0).stop 2024-04-25T12:24:49.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.314+0000 7fe765c3b000 1 -- 172.21.15.94:0/3952252912 shutdown_connections 2024-04-25T12:24:49.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.314+0000 7fe765c3b000 1 --2- 172.21.15.94:0/3952252912 >> [v2:172.21.15.94:6834/1182495659,v1:172.21.15.94:6837/1182495659] conn(0x563214862ff0 0x5632148633d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.314+0000 7fe765c3b000 1 --2- 172.21.15.94:0/3952252912 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5632148469a0 0x563214862630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.314+0000 7fe765c3b000 1 --2- 172.21.15.94:0/3952252912 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563214846080 0x5632148b9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.314+0000 7fe73b7fe640 0 client.4956 ms_handle_reset on v2:172.21.15.94:6834/1182495659 2024-04-25T12:24:49.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.314+0000 7fe765c3b000 1 --2- 172.21.15.94:0/3952252912 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x563214841fd0 0x5632148b9910 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.314+0000 7fe765c3b000 1 -- 172.21.15.94:0/3952252912 >> 172.21.15.94:0/3952252912 conn(0x563214842e40 msgr2=0x56321485c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:49.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.314+0000 7fe765c3b000 1 -- 172.21.15.94:0/3952252912 shutdown_connections 2024-04-25T12:24:49.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.314+0000 7fe765c3b000 1 -- 172.21.15.94:0/3952252912 wait complete. 2024-04-25T12:24:49.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.314+0000 7fe765c3b000 20 client.4956 trim_cache size 0 max 16384 2024-04-25T12:24:49.329 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-25T12:24:49.329 INFO:teuthology.orchestra.run.smithi094.stdout: "cluster_fsid": "7059a9e2-aec4-4b84-b942-caf531e15da3", 2024-04-25T12:24:49.329 INFO:teuthology.orchestra.run.smithi094.stdout: "whoami": 2, 2024-04-25T12:24:49.329 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 4254, 2024-04-25T12:24:49.329 INFO:teuthology.orchestra.run.smithi094.stdout: "want_state": "up:active", 2024-04-25T12:24:49.329 INFO:teuthology.orchestra.run.smithi094.stdout: "state": "up:active", 2024-04-25T12:24:49.329 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs", 2024-04-25T12:24:49.329 INFO:teuthology.orchestra.run.smithi094.stdout: "rank_uptime": 23.100947301000001, 2024-04-25T12:24:49.329 INFO:teuthology.orchestra.run.smithi094.stdout: "mdsmap_epoch": 19, 2024-04-25T12:24:49.330 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch": 28, 2024-04-25T12:24:49.330 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch_barrier": 28, 2024-04-25T12:24:49.330 INFO:teuthology.orchestra.run.smithi094.stdout: "uptime": 182.29439206999999 2024-04-25T12:24:49.330 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-25T12:24:49.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.314+0000 7fe762ab9640 1 -- 172.21.15.94:0/3594561611 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe73c0683b0 msgr2=0x7fe73c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.314+0000 7fe762ab9640 1 --2- 172.21.15.94:0/3594561611 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe73c0683b0 0x7fe73c06a870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe7540b2000 tx=0x7fe754008040 comp rx=0 tx=0).stop 2024-04-25T12:24:49.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.314+0000 7fe762ab9640 1 -- 172.21.15.94:0/3594561611 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe75c072ae0 msgr2=0x7fe75c14d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.314+0000 7fe762ab9640 1 --2- 172.21.15.94:0/3594561611 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe75c072ae0 0x7fe75c14d0d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe74400c7f0 tx=0x7fe74400ccb0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.314+0000 7fe762ab9640 1 -- 172.21.15.94:0/3594561611 shutdown_connections 2024-04-25T12:24:49.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.314+0000 7fe762ab9640 1 --2- 172.21.15.94:0/3594561611 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fe73c0683b0 0x7fe73c06a870 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.314+0000 7fe762ab9640 1 --2- 172.21.15.94:0/3594561611 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe75c151f40 0x7fe75c0cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.314+0000 7fe762ab9640 1 --2- 172.21.15.94:0/3594561611 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe75c072ae0 0x7fe75c14d0d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.314+0000 7fe762ab9640 1 --2- 172.21.15.94:0/3594561611 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe75c06cfd0 0x7fe75c1ef040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.314+0000 7fe762ab9640 1 -- 172.21.15.94:0/3594561611 >> 172.21.15.94:0/3594561611 conn(0x7fe75c0ca540 msgr2=0x7fe75c0c7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:49.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.314+0000 7fe762ab9640 1 -- 172.21.15.94:0/3594561611 shutdown_connections 2024-04-25T12:24:49.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.314+0000 7fe762ab9640 1 -- 172.21.15.94:0/3594561611 wait complete. 2024-04-25T12:24:49.334 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T12:24:49.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.442+0000 7f5364f35640 1 Processor -- start 2024-04-25T12:24:49.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.442+0000 7f5364f35640 1 -- start start 2024-04-25T12:24:49.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.442+0000 7f5364f35640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f536006da80 0x7f536006de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.442+0000 7f5364f35640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f53600c33b0 0x7f53600c7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.442+0000 7f5364f35640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53600c2740 con 0x7f53600c7eb0 2024-04-25T12:24:49.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.442+0000 7f5364f35640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f536015bb70 con 0x7f536006da80 2024-04-25T12:24:49.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.442+0000 7f5364f35640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f5360067c00 con 0x7f53600c33b0 2024-04-25T12:24:49.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.442+0000 7f535e59c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f536006da80 0x7f536006de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.442+0000 7f535e59c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f536006da80 0x7f536006de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57100/0 (socket says 172.21.15.94:57100) 2024-04-25T12:24:49.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.442+0000 7f535e59c640 1 -- 172.21.15.94:0/1607972262 learned_addr learned my addr 172.21.15.94:0/1607972262 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:49.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.442+0000 7f535e59c640 1 -- 172.21.15.94:0/1607972262 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f53600c33b0 msgr2=0x7f53600c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.442+0000 7f535e59c640 1 --2- 172.21.15.94:0/1607972262 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f53600c33b0 0x7f53600c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.442+0000 7f535e59c640 1 -- 172.21.15.94:0/1607972262 >> v1:172.21.15.111:6789/0 conn(0x7f53600c7eb0 legacy=0x7f536015e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.442+0000 7f535e59c640 1 -- 172.21.15.94:0/1607972262 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53600676a0 con 0x7f536006da80 2024-04-25T12:24:49.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.446+0000 7f535e59c640 1 --2- 172.21.15.94:0/1607972262 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f536006da80 0x7f536006de60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5350009870 tx=0x7f535001eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e0b763b0cd1002c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.446+0000 7f535d59a640 1 -- 172.21.15.94:0/1607972262 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53500b5070 con 0x7f536006da80 2024-04-25T12:24:49.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.446+0000 7f535d59a640 1 -- 172.21.15.94:0/1607972262 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53500a87f0 con 0x7f536006da80 2024-04-25T12:24:49.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.446+0000 7f535d59a640 1 -- 172.21.15.94:0/1607972262 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53500a8bc0 con 0x7f536006da80 2024-04-25T12:24:49.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.446+0000 7f5364f35640 1 -- 172.21.15.94:0/1607972262 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f536006da80 msgr2=0x7f536006de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.446+0000 7f5364f35640 1 --2- 172.21.15.94:0/1607972262 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f536006da80 0x7f536006de60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5350009870 tx=0x7f535001eb30 comp rx=0 tx=0).stop 2024-04-25T12:24:49.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.446+0000 7f5364f35640 1 -- 172.21.15.94:0/1607972262 shutdown_connections 2024-04-25T12:24:49.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.446+0000 7f5364f35640 1 --2- 172.21.15.94:0/1607972262 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f53600c33b0 0x7f53600c7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.446+0000 7f5364f35640 1 --2- 172.21.15.94:0/1607972262 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f536006da80 0x7f536006de60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.446+0000 7f5364f35640 1 -- 172.21.15.94:0/1607972262 >> 172.21.15.94:0/1607972262 conn(0x7f53600c9a70 msgr2=0x7f53600c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:49.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.446+0000 7f5364f35640 1 -- 172.21.15.94:0/1607972262 shutdown_connections 2024-04-25T12:24:49.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.446+0000 7f5364f35640 1 -- 172.21.15.94:0/1607972262 wait complete. 2024-04-25T12:24:49.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.446+0000 7f5364f35640 1 Processor -- start 2024-04-25T12:24:49.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.446+0000 7f5364f35640 1 -- start start 2024-04-25T12:24:49.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.446+0000 7f5364f35640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f536006da80 0x7f5360153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.446+0000 7f5364f35640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f53600c33b0 0x7f536006f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.446+0000 7f5364f35640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f53600c7eb0 0x7f53601528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.446+0000 7f5364f35640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f536015c000 con 0x7f536006da80 2024-04-25T12:24:49.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.446+0000 7f5364f35640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f536015b280 con 0x7f53600c33b0 2024-04-25T12:24:49.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.446+0000 7f5364f35640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f536015b520 con 0x7f53600c7eb0 2024-04-25T12:24:49.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.450+0000 7f535e59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f536006da80 0x7f5360153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.450+0000 7f535e59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f536006da80 0x7f5360153b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57112/0 (socket says 172.21.15.94:57112) 2024-04-25T12:24:49.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.450+0000 7f535e59c640 1 -- 172.21.15.94:0/1712678008 learned_addr learned my addr 172.21.15.94:0/1712678008 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:49.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.450+0000 7f535ed9d640 1 --2- 172.21.15.94:0/1712678008 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f53600c7eb0 0x7f53601528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.450+0000 7f535e59c640 1 -- 172.21.15.94:0/1712678008 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f53600c7eb0 msgr2=0x7f53601528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.450+0000 7f535e59c640 1 --2- 172.21.15.94:0/1712678008 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f53600c7eb0 0x7f53601528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.450+0000 7f535dd9b640 1 --2- 172.21.15.94:0/1712678008 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f53600c33b0 0x7f536006f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.450+0000 7f535e59c640 1 -- 172.21.15.94:0/1712678008 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f53600c33b0 msgr2=0x7f536006f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.450+0000 7f535e59c640 1 --2- 172.21.15.94:0/1712678008 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f53600c33b0 0x7f536006f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.450+0000 7f535e59c640 1 -- 172.21.15.94:0/1712678008 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53601f11c0 con 0x7f536006da80 2024-04-25T12:24:49.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.450+0000 7f535e59c640 1 --2- 172.21.15.94:0/1712678008 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f536006da80 0x7f5360153b90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f535001d1e0 tx=0x7f535001b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.450+0000 7f534effd640 1 -- 172.21.15.94:0/1712678008 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53500b5040 con 0x7f536006da80 2024-04-25T12:24:49.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.450+0000 7f534effd640 1 -- 172.21.15.94:0/1712678008 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53500be070 con 0x7f536006da80 2024-04-25T12:24:49.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.450+0000 7f5364f35640 1 -- 172.21.15.94:0/1712678008 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53601f14a0 con 0x7f536006da80 2024-04-25T12:24:49.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.450+0000 7f534effd640 1 -- 172.21.15.94:0/1712678008 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53500b08e0 con 0x7f536006da80 2024-04-25T12:24:49.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.450+0000 7f5364f35640 1 -- 172.21.15.94:0/1712678008 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53601f1a60 con 0x7f536006da80 2024-04-25T12:24:49.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.450+0000 7f534effd640 1 -- 172.21.15.94:0/1712678008 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f53500b0a80 con 0x7f536006da80 2024-04-25T12:24:49.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.450+0000 7f534effd640 1 --2- 172.21.15.94:0/1712678008 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5340068380 0x7f534006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.450+0000 7f534effd640 1 -- 172.21.15.94:0/1712678008 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f53501241c0 con 0x7f536006da80 2024-04-25T12:24:49.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.450+0000 7f535dd9b640 1 --2- 172.21.15.94:0/1712678008 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5340068380 0x7f534006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.450+0000 7f535dd9b640 1 --2- 172.21.15.94:0/1712678008 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5340068380 0x7f534006a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f536015b9e0 tx=0x7f5354008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.450+0000 7f53680b7000 1 Processor -- start 2024-04-25T12:24:49.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.450+0000 7f53680b7000 1 -- start start 2024-04-25T12:24:49.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x560956cc1190 0x560956cc1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cc1ab0 0x560956cfc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560956cfc5c0 0x560956cfc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x560956b0a420 con 0x560956cc1ab0 2024-04-25T12:24:49.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x560956aa4bf0 con 0x560956cfc5c0 2024-04-25T12:24:49.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x560956b063e0 con 0x560956cc1190 2024-04-25T12:24:49.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f535dd9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cc1ab0 0x560956cfc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f535dd9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cc1ab0 0x560956cfc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57114/0 (socket says 172.21.15.94:57114) 2024-04-25T12:24:49.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f535dd9b640 1 -- 172.21.15.94:0/2341251728 learned_addr learned my addr 172.21.15.94:0/2341251728 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:49.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f535e59c640 1 --2- 172.21.15.94:0/2341251728 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x560956cc1190 0x560956cc1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f535ed9d640 1 --2- 172.21.15.94:0/2341251728 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560956cfc5c0 0x560956cfc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f535dd9b640 1 -- 172.21.15.94:0/2341251728 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x560956cc1190 msgr2=0x560956cc1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f535dd9b640 1 --2- 172.21.15.94:0/2341251728 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x560956cc1190 0x560956cc1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f535dd9b640 1 -- 172.21.15.94:0/2341251728 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560956cfc5c0 msgr2=0x560956cfc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f535dd9b640 1 --2- 172.21.15.94:0/2341251728 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560956cfc5c0 0x560956cfc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f535dd9b640 1 -- 172.21.15.94:0/2341251728 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560956bb2450 con 0x560956cc1ab0 2024-04-25T12:24:49.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f535dd9b640 1 --2- 172.21.15.94:0/2341251728 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cc1ab0 0x560956cfc080 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5354006ea0 tx=0x7f535400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a17ad32a8a352e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f533ffff640 1 -- 172.21.15.94:0/2341251728 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5354023070 con 0x560956cc1ab0 2024-04-25T12:24:49.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f533ffff640 1 -- 172.21.15.94:0/2341251728 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5354013db0 con 0x560956cc1ab0 2024-04-25T12:24:49.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f533ffff640 1 -- 172.21.15.94:0/2341251728 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535401e640 con 0x560956cc1ab0 2024-04-25T12:24:49.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 1 -- 172.21.15.94:0/2341251728 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cc1ab0 msgr2=0x560956cfc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 1 --2- 172.21.15.94:0/2341251728 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cc1ab0 0x560956cfc080 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5354006ea0 tx=0x7f535400f000 comp rx=0 tx=0).stop 2024-04-25T12:24:49.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 1 -- 172.21.15.94:0/2341251728 shutdown_connections 2024-04-25T12:24:49.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 1 --2- 172.21.15.94:0/2341251728 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560956cfc5c0 0x560956cfc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 1 --2- 172.21.15.94:0/2341251728 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cc1ab0 0x560956cfc080 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 1 --2- 172.21.15.94:0/2341251728 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x560956cc1190 0x560956cc1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 1 -- 172.21.15.94:0/2341251728 >> 172.21.15.94:0/2341251728 conn(0x560956cf8e40 msgr2=0x560956cfb260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:49.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 1 -- 172.21.15.94:0/2341251728 shutdown_connections 2024-04-25T12:24:49.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 1 -- 172.21.15.94:0/2341251728 wait complete. 2024-04-25T12:24:49.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 1 -- start start 2024-04-25T12:24:49.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 1 Processor -- start 2024-04-25T12:24:49.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cc1190 0x560956cbdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x560956cc1ab0 0x560956cbe160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560956cfc5c0 0x560956cbe6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x560956aaaec0 con 0x560956cc1190 2024-04-25T12:24:49.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x560956b8b120 con 0x560956cfc5c0 2024-04-25T12:24:49.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x560956b15350 con 0x560956cc1ab0 2024-04-25T12:24:49.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 10 client.0 _ll_register_callbacks cb 0x560956ae74d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:24:49.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f535e59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cc1190 0x560956cbdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f535e59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cc1190 0x560956cbdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57124/0 (socket says 172.21.15.94:57124) 2024-04-25T12:24:49.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f535e59c640 1 -- 172.21.15.94:0/1592329850 learned_addr learned my addr 172.21.15.94:0/1592329850 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:49.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f535e59c640 1 -- 172.21.15.94:0/1592329850 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x560956cc1ab0 msgr2=0x560956cbe160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f535e59c640 1 --2- 172.21.15.94:0/1592329850 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x560956cc1ab0 0x560956cbe160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f535e59c640 1 -- 172.21.15.94:0/1592329850 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560956cfc5c0 msgr2=0x560956cbe6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f535e59c640 1 --2- 172.21.15.94:0/1592329850 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560956cfc5c0 0x560956cbe6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f535e59c640 1 -- 172.21.15.94:0/1592329850 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560956b4ff80 con 0x560956cc1190 2024-04-25T12:24:49.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f535e59c640 1 --2- 172.21.15.94:0/1592329850 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cc1190 0x560956cbdc20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5350009960 tx=0x7f53500f3680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5ec8ea523637916 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f533d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-04-25T12:24:49.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f533d7fa640 1 -- 172.21.15.94:0/1592329850 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53500f3d20 con 0x560956cc1190 2024-04-25T12:24:49.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f533d7fa640 1 -- 172.21.15.94:0/1592329850 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f53500b0d70 con 0x560956cc1190 2024-04-25T12:24:49.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 1 -- 172.21.15.94:0/1592329850 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5354013db0 con 0x560956cc1190 2024-04-25T12:24:49.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f533d7fa640 1 -- 172.21.15.94:0/1592329850 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f53500f80d0 con 0x560956cc1190 2024-04-25T12:24:49.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 10 client.4968 fetch_fsmap learned FSMap version 19 2024-04-25T12:24:49.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.454+0000 7f53680b7000 1 -- 172.21.15.94:0/1592329850 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x560956ae3f00 con 0x560956cc1190 2024-04-25T12:24:49.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.458+0000 7f533d7fa640 1 -- 172.21.15.94:0/1592329850 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5354013db0 con 0x560956cc1190 2024-04-25T12:24:49.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.458+0000 7f533d7fa640 1 -- 172.21.15.94:0/1592329850 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f53500f3f80 con 0x560956cc1190 2024-04-25T12:24:49.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.458+0000 7f53680b7000 10 client.4968 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T12:24:49.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.458+0000 7f53680b7000 10 client.4968 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T12:24:49.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.458+0000 7f53680b7000 20 client.4968 populate_metadata read hostname 'smithi094' 2024-04-25T12:24:49.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.458+0000 7f53680b7000 1 --2- 172.21.15.94:0/1592329850 >> [v2:172.21.15.111:6832/2332499082,v1:172.21.15.111:6833/2332499082] conn(0x560956d10d90 0x560956d13180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.458+0000 7f53680b7000 4 client.4968 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T12:24:49.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.458+0000 7f53680b7000 1 -- 172.21.15.94:0/1592329850 --> [v2:172.21.15.111:6832/2332499082,v1:172.21.15.111:6833/2332499082] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560956aa3bc0 con 0x560956d10d90 2024-04-25T12:24:49.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.458+0000 7f535dd9b640 1 --2- 172.21.15.94:0/1592329850 >> [v2:172.21.15.111:6832/2332499082,v1:172.21.15.111:6833/2332499082] conn(0x560956d10d90 0x560956d13180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.458+0000 7f533d7fa640 10 client.4968 ms_handle_connect on v2:172.21.15.111:6832/2332499082 2024-04-25T12:24:49.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.458+0000 7f535dd9b640 1 --2- 172.21.15.94:0/1592329850 >> [v2:172.21.15.111:6832/2332499082,v1:172.21.15.111:6833/2332499082] conn(0x560956d10d90 0x560956d13180 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c56be727487f2e8 server_cookie=9fde415b71b3267a in_seq=0 out_seq=0 2024-04-25T12:24:49.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.458+0000 7f533d7fa640 1 -- 172.21.15.94:0/1592329850 <== mds.1 v2:172.21.15.111:6832/2332499082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560956aa3bc0 con 0x560956d10d90 2024-04-25T12:24:49.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.458+0000 7f533d7fa640 10 client.4968 handle_command_reply: tid=0 2024-04-25T12:24:49.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.458+0000 7f53680b7000 1 client.4968 shutdown 2024-04-25T12:24:49.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.458+0000 7f53680b7000 1 -- 172.21.15.94:0/1592329850 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cc1190 msgr2=0x560956cbdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.458+0000 7f53680b7000 1 --2- 172.21.15.94:0/1592329850 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cc1190 0x560956cbdc20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5350009960 tx=0x7f53500f3680 comp rx=0 tx=0).stop 2024-04-25T12:24:49.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.458+0000 7f53680b7000 1 -- 172.21.15.94:0/1592329850 shutdown_connections 2024-04-25T12:24:49.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.458+0000 7f53680b7000 1 --2- 172.21.15.94:0/1592329850 >> [v2:172.21.15.111:6832/2332499082,v1:172.21.15.111:6833/2332499082] conn(0x560956d10d90 0x560956d13180 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.458+0000 7f53680b7000 1 --2- 172.21.15.94:0/1592329850 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x560956cc1ab0 0x560956cbe160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.458+0000 7f53680b7000 1 --2- 172.21.15.94:0/1592329850 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560956cfc5c0 0x560956cbe6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.458+0000 7f53680b7000 1 --2- 172.21.15.94:0/1592329850 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cc1190 0x560956cbdc20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.458+0000 7f53680b7000 1 -- 172.21.15.94:0/1592329850 >> 172.21.15.94:0/1592329850 conn(0x560956cf8e40 msgr2=0x560956cfa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:49.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.458+0000 7f533d7fa640 0 client.4968 ms_handle_reset on v2:172.21.15.111:6832/2332499082 2024-04-25T12:24:49.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.458+0000 7f53680b7000 1 -- 172.21.15.94:0/1592329850 shutdown_connections 2024-04-25T12:24:49.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.458+0000 7f53680b7000 1 -- 172.21.15.94:0/1592329850 wait complete. 2024-04-25T12:24:49.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.458+0000 7f53680b7000 20 client.4968 trim_cache size 0 max 16384 2024-04-25T12:24:49.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f53680b7000 1 Processor -- start 2024-04-25T12:24:49.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f53680b7000 1 -- start start 2024-04-25T12:24:49.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f53680b7000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560956cc1190 0x560956cf6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f53680b7000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x560956cc1ab0 0x560956cf73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f53680b7000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cfc5c0 0x560956d6b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f53680b7000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f53601f5110 con 0x560956cfc5c0 2024-04-25T12:24:49.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f53680b7000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x560956ad69e0 con 0x560956cc1190 2024-04-25T12:24:49.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f53680b7000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x560956b09730 con 0x560956cc1ab0 2024-04-25T12:24:49.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f535ed9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cfc5c0 0x560956d6b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f535ed9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cfc5c0 0x560956d6b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57134/0 (socket says 172.21.15.94:57134) 2024-04-25T12:24:49.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f535ed9d640 1 -- 172.21.15.94:0/82378306 learned_addr learned my addr 172.21.15.94:0/82378306 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:49.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f535ed9d640 1 -- 172.21.15.94:0/82378306 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x560956cc1ab0 msgr2=0x560956cf73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f535ed9d640 1 --2- 172.21.15.94:0/82378306 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x560956cc1ab0 0x560956cf73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f535ed9d640 1 -- 172.21.15.94:0/82378306 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560956cc1190 msgr2=0x560956cf6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f535ed9d640 1 --2- 172.21.15.94:0/82378306 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560956cc1190 0x560956cf6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f535ed9d640 1 -- 172.21.15.94:0/82378306 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560956a90e80 con 0x560956cfc5c0 2024-04-25T12:24:49.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f535ed9d640 1 --2- 172.21.15.94:0/82378306 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cfc5c0 0x560956d6b2e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5358008ad0 tx=0x7f5358008f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ffbc890166b5453 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f533f7fe640 1 -- 172.21.15.94:0/82378306 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5358016030 con 0x560956cfc5c0 2024-04-25T12:24:49.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f533f7fe640 1 -- 172.21.15.94:0/82378306 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f535800d9a0 con 0x560956cfc5c0 2024-04-25T12:24:49.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f533f7fe640 1 -- 172.21.15.94:0/82378306 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535800dd90 con 0x560956cfc5c0 2024-04-25T12:24:49.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f53680b7000 1 -- 172.21.15.94:0/82378306 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cfc5c0 msgr2=0x560956d6b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f53680b7000 1 --2- 172.21.15.94:0/82378306 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cfc5c0 0x560956d6b2e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5358008ad0 tx=0x7f5358008f90 comp rx=0 tx=0).stop 2024-04-25T12:24:49.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f53680b7000 1 -- 172.21.15.94:0/82378306 shutdown_connections 2024-04-25T12:24:49.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f53680b7000 1 --2- 172.21.15.94:0/82378306 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x560956cc1ab0 0x560956cf73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f53680b7000 1 --2- 172.21.15.94:0/82378306 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cfc5c0 0x560956d6b2e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f53680b7000 1 --2- 172.21.15.94:0/82378306 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560956cc1190 0x560956cf6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f53680b7000 1 -- 172.21.15.94:0/82378306 >> 172.21.15.94:0/82378306 conn(0x560956cf8e40 msgr2=0x560956cbacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:49.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f53680b7000 1 -- 172.21.15.94:0/82378306 shutdown_connections 2024-04-25T12:24:49.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f53680b7000 1 -- 172.21.15.94:0/82378306 wait complete. 2024-04-25T12:24:49.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f53680b7000 1 -- start start 2024-04-25T12:24:49.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.478+0000 7f53680b7000 1 Processor -- start 2024-04-25T12:24:49.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560956cc1190 0x560956d6a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x560956cc1ab0 0x560956d10d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cfc5c0 0x560956d112d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x560956b17630 con 0x560956cfc5c0 2024-04-25T12:24:49.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x560956b0ea50 con 0x560956cc1190 2024-04-25T12:24:49.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x560956aaaa40 con 0x560956cc1ab0 2024-04-25T12:24:49.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 10 client.0 _ll_register_callbacks cb 0x7f53500069d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:24:49.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f535ed9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cfc5c0 0x560956d112d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f535ed9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cfc5c0 0x560956d112d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57142/0 (socket says 172.21.15.94:57142) 2024-04-25T12:24:49.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f535ed9d640 1 -- 172.21.15.94:0/1961466696 learned_addr learned my addr 172.21.15.94:0/1961466696 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:49.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f535dd9b640 1 --2- 172.21.15.94:0/1961466696 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x560956cc1ab0 0x560956d10d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f535e59c640 1 --2- 172.21.15.94:0/1961466696 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560956cc1190 0x560956d6a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f535ed9d640 1 -- 172.21.15.94:0/1961466696 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x560956cc1ab0 msgr2=0x560956d10d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f535ed9d640 1 --2- 172.21.15.94:0/1961466696 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x560956cc1ab0 0x560956d10d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f535ed9d640 1 -- 172.21.15.94:0/1961466696 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560956cc1190 msgr2=0x560956d6a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f535ed9d640 1 --2- 172.21.15.94:0/1961466696 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560956cc1190 0x560956d6a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f535ed9d640 1 -- 172.21.15.94:0/1961466696 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560956ad2b30 con 0x560956cfc5c0 2024-04-25T12:24:49.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f535e59c640 1 --2- 172.21.15.94:0/1961466696 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560956cc1190 0x560956d6a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:49.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f535ed9d640 1 --2- 172.21.15.94:0/1961466696 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cfc5c0 0x560956d112d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5358015040 tx=0x7f5358004a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3913928f83a889d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f533d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-04-25T12:24:49.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f533d7fa640 1 -- 172.21.15.94:0/1961466696 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5358004220 con 0x560956cfc5c0 2024-04-25T12:24:49.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f533d7fa640 1 -- 172.21.15.94:0/1961466696 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f53580043c0 con 0x560956cfc5c0 2024-04-25T12:24:49.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 1 -- 172.21.15.94:0/1961466696 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f535800d9a0 con 0x560956cfc5c0 2024-04-25T12:24:49.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f533d7fa640 1 -- 172.21.15.94:0/1961466696 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f535802d050 con 0x560956cfc5c0 2024-04-25T12:24:49.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 10 client.4974 fetch_fsmap learned FSMap version 19 2024-04-25T12:24:49.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 1 -- 172.21.15.94:0/1961466696 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x560956b8b5b0 con 0x560956cfc5c0 2024-04-25T12:24:49.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f533d7fa640 1 -- 172.21.15.94:0/1961466696 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f535800d9a0 con 0x560956cfc5c0 2024-04-25T12:24:49.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f533d7fa640 1 -- 172.21.15.94:0/1961466696 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f5358030020 con 0x560956cfc5c0 2024-04-25T12:24:49.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 10 client.4974 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T12:24:49.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 10 client.4974 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T12:24:49.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 20 client.4974 populate_metadata read hostname 'smithi094' 2024-04-25T12:24:49.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 1 --2- 172.21.15.94:0/1961466696 >> [v2:172.21.15.111:6832/2332499082,v1:172.21.15.111:6833/2332499082] conn(0x560956d71760 0x560956d71b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 4 client.4974 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T12:24:49.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 1 -- 172.21.15.94:0/1961466696 --> [v2:172.21.15.111:6832/2332499082,v1:172.21.15.111:6833/2332499082] -- command(tid 0: {"prefix": "status"}) -- 0x560956b17e40 con 0x560956d71760 2024-04-25T12:24:49.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f535e59c640 1 --2- 172.21.15.94:0/1961466696 >> [v2:172.21.15.111:6832/2332499082,v1:172.21.15.111:6833/2332499082] conn(0x560956d71760 0x560956d71b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f533d7fa640 10 client.4974 ms_handle_connect on v2:172.21.15.111:6832/2332499082 2024-04-25T12:24:49.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f535e59c640 1 --2- 172.21.15.94:0/1961466696 >> [v2:172.21.15.111:6832/2332499082,v1:172.21.15.111:6833/2332499082] conn(0x560956d71760 0x560956d71b40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cb134bcc1360adc3 server_cookie=2b0656312df0ac98 in_seq=0 out_seq=0 2024-04-25T12:24:49.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f533d7fa640 1 -- 172.21.15.94:0/1961466696 <== mds.1 v2:172.21.15.111:6832/2332499082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+320 (crc 0 0 0) 0x560956b17e40 con 0x560956d71760 2024-04-25T12:24:49.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f533d7fa640 10 client.4974 handle_command_reply: tid=0 2024-04-25T12:24:49.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 1 client.4974 shutdown 2024-04-25T12:24:49.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 1 -- 172.21.15.94:0/1961466696 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cfc5c0 msgr2=0x560956d112d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 1 --2- 172.21.15.94:0/1961466696 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cfc5c0 0x560956d112d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5358015040 tx=0x7f5358004a10 comp rx=0 tx=0).stop 2024-04-25T12:24:49.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 1 -- 172.21.15.94:0/1961466696 shutdown_connections 2024-04-25T12:24:49.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 1 --2- 172.21.15.94:0/1961466696 >> [v2:172.21.15.111:6832/2332499082,v1:172.21.15.111:6833/2332499082] conn(0x560956d71760 0x560956d71b40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 1 --2- 172.21.15.94:0/1961466696 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x560956cc1ab0 0x560956d10d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 1 --2- 172.21.15.94:0/1961466696 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560956cfc5c0 0x560956d112d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f533d7fa640 0 client.4974 ms_handle_reset on v2:172.21.15.111:6832/2332499082 2024-04-25T12:24:49.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 1 --2- 172.21.15.94:0/1961466696 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560956cc1190 0x560956d6a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 1 -- 172.21.15.94:0/1961466696 >> 172.21.15.94:0/1961466696 conn(0x560956cf8e40 msgr2=0x560956cf7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:49.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 1 -- 172.21.15.94:0/1961466696 shutdown_connections 2024-04-25T12:24:49.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 1 -- 172.21.15.94:0/1961466696 wait complete. 2024-04-25T12:24:49.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.482+0000 7f53680b7000 20 client.4974 trim_cache size 0 max 16384 2024-04-25T12:24:49.495 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-25T12:24:49.495 INFO:teuthology.orchestra.run.smithi094.stdout: "cluster_fsid": "7059a9e2-aec4-4b84-b942-caf531e15da3", 2024-04-25T12:24:49.495 INFO:teuthology.orchestra.run.smithi094.stdout: "whoami": 1, 2024-04-25T12:24:49.495 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 4276, 2024-04-25T12:24:49.496 INFO:teuthology.orchestra.run.smithi094.stdout: "want_state": "up:active", 2024-04-25T12:24:49.496 INFO:teuthology.orchestra.run.smithi094.stdout: "state": "up:active", 2024-04-25T12:24:49.496 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs", 2024-04-25T12:24:49.496 INFO:teuthology.orchestra.run.smithi094.stdout: "rank_uptime": 29.314971129, 2024-04-25T12:24:49.496 INFO:teuthology.orchestra.run.smithi094.stdout: "mdsmap_epoch": 19, 2024-04-25T12:24:49.496 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch": 28, 2024-04-25T12:24:49.496 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch_barrier": 28, 2024-04-25T12:24:49.496 INFO:teuthology.orchestra.run.smithi094.stdout: "uptime": 182.336223276 2024-04-25T12:24:49.496 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-25T12:24:49.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.486+0000 7f5364f35640 1 -- 172.21.15.94:0/1712678008 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5340068380 msgr2=0x7f534006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.486+0000 7f5364f35640 1 --2- 172.21.15.94:0/1712678008 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5340068380 0x7f534006a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f536015b9e0 tx=0x7f5354008040 comp rx=0 tx=0).stop 2024-04-25T12:24:49.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.486+0000 7f5364f35640 1 -- 172.21.15.94:0/1712678008 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f536006da80 msgr2=0x7f5360153b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.486+0000 7f5364f35640 1 --2- 172.21.15.94:0/1712678008 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f536006da80 0x7f5360153b90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f535001d1e0 tx=0x7f535001b8d0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.486+0000 7f5364f35640 1 -- 172.21.15.94:0/1712678008 shutdown_connections 2024-04-25T12:24:49.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.486+0000 7f5364f35640 1 --2- 172.21.15.94:0/1712678008 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5340068380 0x7f534006a840 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f536015b9e0 tx=0x7f5354008040 comp rx=0 tx=0).stop 2024-04-25T12:24:49.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.486+0000 7f5364f35640 1 --2- 172.21.15.94:0/1712678008 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f53600c7eb0 0x7f53601528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.486+0000 7f5364f35640 1 --2- 172.21.15.94:0/1712678008 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f53600c33b0 0x7f536006f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.486+0000 7f5364f35640 1 --2- 172.21.15.94:0/1712678008 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f536006da80 0x7f5360153b90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.486+0000 7f5364f35640 1 -- 172.21.15.94:0/1712678008 >> 172.21.15.94:0/1712678008 conn(0x7f53600c9a70 msgr2=0x7f5360074e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:49.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.486+0000 7f5364f35640 1 -- 172.21.15.94:0/1712678008 shutdown_connections 2024-04-25T12:24:49.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.486+0000 7f5364f35640 1 -- 172.21.15.94:0/1712678008 wait complete. 2024-04-25T12:24:49.505 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T12:24:49.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.606+0000 7f06ff5b9640 1 Processor -- start 2024-04-25T12:24:49.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.606+0000 7f06ff5b9640 1 -- start start 2024-04-25T12:24:49.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.606+0000 7f06ff5b9640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f06f80c85e0 0x7f06f80c3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.606+0000 7f06ff5b9640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f06f80c89c0 0x7f06f815b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.606+0000 7f06ff5b9640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06f8158af0 con 0x7f06f806c4f0 2024-04-25T12:24:49.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.606+0000 7f06ff5b9640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f06f80c3d30 con 0x7f06f80c89c0 2024-04-25T12:24:49.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.606+0000 7f06ff5b9640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f06f815b510 con 0x7f06f80c85e0 2024-04-25T12:24:49.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.606+0000 7f06fcb54640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f06f80c89c0 0x7f06f815b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.606+0000 7f06fcb54640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f06f80c89c0 0x7f06f815b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57156/0 (socket says 172.21.15.94:57156) 2024-04-25T12:24:49.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.606+0000 7f06fcb54640 1 -- 172.21.15.94:0/280337797 learned_addr learned my addr 172.21.15.94:0/280337797 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:49.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.606+0000 7f06fd355640 1 --2- 172.21.15.94:0/280337797 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f06f80c85e0 0x7f06f80c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.606+0000 7f06fcb54640 1 -- 172.21.15.94:0/280337797 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f06f80c85e0 msgr2=0x7f06f80c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.606+0000 7f06fcb54640 1 --2- 172.21.15.94:0/280337797 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f06f80c85e0 0x7f06f80c3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.606+0000 7f06fcb54640 1 -- 172.21.15.94:0/280337797 >> v1:172.21.15.111:6789/0 conn(0x7f06f806c4f0 legacy=0x7f06f8151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.606+0000 7f06fcb54640 1 -- 172.21.15.94:0/280337797 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f80c3f80 con 0x7f06f80c89c0 2024-04-25T12:24:49.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.606+0000 7f06fd355640 1 --2- 172.21.15.94:0/280337797 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f06f80c85e0 0x7f06f80c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:49.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06fcb54640 1 --2- 172.21.15.94:0/280337797 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06f80c89c0 0x7f06f815b9a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f06e8009870 tx=0x7f06e801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9229d34ba73917cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06effff640 1 -- 172.21.15.94:0/280337797 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e80b5070 con 0x7f06f80c89c0 2024-04-25T12:24:49.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06effff640 1 -- 172.21.15.94:0/280337797 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e80a89d0 con 0x7f06f80c89c0 2024-04-25T12:24:49.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06effff640 1 -- 172.21.15.94:0/280337797 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e80a8da0 con 0x7f06f80c89c0 2024-04-25T12:24:49.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06ff5b9640 1 -- 172.21.15.94:0/280337797 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06f80c89c0 msgr2=0x7f06f815b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06ff5b9640 1 --2- 172.21.15.94:0/280337797 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06f80c89c0 0x7f06f815b9a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f06e8009870 tx=0x7f06e801ed10 comp rx=0 tx=0).stop 2024-04-25T12:24:49.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06ff5b9640 1 -- 172.21.15.94:0/280337797 shutdown_connections 2024-04-25T12:24:49.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06ff5b9640 1 --2- 172.21.15.94:0/280337797 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06f80c89c0 0x7f06f815b9a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06ff5b9640 1 --2- 172.21.15.94:0/280337797 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f06f80c85e0 0x7f06f80c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06ff5b9640 1 -- 172.21.15.94:0/280337797 >> 172.21.15.94:0/280337797 conn(0x7f06f806b9d0 msgr2=0x7f06f806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:49.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06ff5b9640 1 -- 172.21.15.94:0/280337797 shutdown_connections 2024-04-25T12:24:49.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06ff5b9640 1 -- 172.21.15.94:0/280337797 wait complete. 2024-04-25T12:24:49.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06ff5b9640 1 Processor -- start 2024-04-25T12:24:49.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06ff5b9640 1 -- start start 2024-04-25T12:24:49.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06ff5b9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f06f806c4f0 0x7f06f81526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06ff5b9640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f06f80c85e0 0x7f06f81ef100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06ff5b9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06f80c89c0 0x7f06f8073980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06ff5b9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f06f80c8fd0 con 0x7f06f80c89c0 2024-04-25T12:24:49.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06ff5b9640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f06f81587d0 con 0x7f06f806c4f0 2024-04-25T12:24:49.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06ff5b9640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f06f81521f0 con 0x7f06f80c85e0 2024-04-25T12:24:49.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06fdb56640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06f80c89c0 0x7f06f8073980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06fdb56640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06f80c89c0 0x7f06f8073980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57164/0 (socket says 172.21.15.94:57164) 2024-04-25T12:24:49.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06fdb56640 1 -- 172.21.15.94:0/4111186026 learned_addr learned my addr 172.21.15.94:0/4111186026 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:49.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06fcb54640 1 --2- 172.21.15.94:0/4111186026 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f06f80c85e0 0x7f06f81ef100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06fd355640 1 --2- 172.21.15.94:0/4111186026 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f06f806c4f0 0x7f06f81526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06fdb56640 1 -- 172.21.15.94:0/4111186026 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f06f80c85e0 msgr2=0x7f06f81ef100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06fdb56640 1 --2- 172.21.15.94:0/4111186026 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f06f80c85e0 0x7f06f81ef100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06fdb56640 1 -- 172.21.15.94:0/4111186026 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f06f806c4f0 msgr2=0x7f06f81526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06fdb56640 1 --2- 172.21.15.94:0/4111186026 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f06f806c4f0 0x7f06f81526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06fdb56640 1 -- 172.21.15.94:0/4111186026 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f81f2b20 con 0x7f06f80c89c0 2024-04-25T12:24:49.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06fcb54640 1 --2- 172.21.15.94:0/4111186026 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f06f80c85e0 0x7f06f81ef100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:49.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.610+0000 7f06fd355640 1 --2- 172.21.15.94:0/4111186026 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f06f806c4f0 0x7f06f81526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:49.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.614+0000 7f06fdb56640 1 --2- 172.21.15.94:0/4111186026 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06f80c89c0 0x7f06f8073980 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f06f400c3f0 tx=0x7f06f400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.614+0000 7f06edffb640 1 -- 172.21.15.94:0/4111186026 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f4011790 con 0x7f06f80c89c0 2024-04-25T12:24:49.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.614+0000 7f06edffb640 1 -- 172.21.15.94:0/4111186026 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f4017070 con 0x7f06f80c89c0 2024-04-25T12:24:49.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.614+0000 7f06ff5b9640 1 -- 172.21.15.94:0/4111186026 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f80c5110 con 0x7f06f80c89c0 2024-04-25T12:24:49.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.614+0000 7f06edffb640 1 -- 172.21.15.94:0/4111186026 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f4011b70 con 0x7f06f80c89c0 2024-04-25T12:24:49.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.614+0000 7f06ff5b9640 1 -- 172.21.15.94:0/4111186026 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f81eebe0 con 0x7f06f80c89c0 2024-04-25T12:24:49.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.614+0000 7f06edffb640 1 -- 172.21.15.94:0/4111186026 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f06f4011d10 con 0x7f06f80c89c0 2024-04-25T12:24:49.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.614+0000 7f06edffb640 1 --2- 172.21.15.94:0/4111186026 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f06dc068380 0x7f06dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.614+0000 7f06edffb640 1 -- 172.21.15.94:0/4111186026 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f06f4086ba0 con 0x7f06f80c89c0 2024-04-25T12:24:49.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.614+0000 7f06fd355640 1 --2- 172.21.15.94:0/4111186026 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f06dc068380 0x7f06dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.614+0000 7f06fd355640 1 --2- 172.21.15.94:0/4111186026 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f06dc068380 0x7f06dc06a840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f06f000d430 tx=0x7f06f0007530 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.614+0000 7f070273b000 1 Processor -- start 2024-04-25T12:24:49.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.614+0000 7f070273b000 1 -- start start 2024-04-25T12:24:49.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.614+0000 7f070273b000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024581fd0 0x55f0245823b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.614+0000 7f070273b000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f024586080 0x55f024586460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.614+0000 7f070273b000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0245869a0 0x55f024586d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.614+0000 7f070273b000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55f024394420 con 0x55f024581fd0 2024-04-25T12:24:49.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.614+0000 7f070273b000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55f02432ebf0 con 0x55f0245869a0 2024-04-25T12:24:49.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.614+0000 7f070273b000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x55f0243903e0 con 0x55f024586080 2024-04-25T12:24:49.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.614+0000 7f06fd355640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024581fd0 0x55f0245823b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.614+0000 7f06fd355640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024581fd0 0x55f0245823b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57170/0 (socket says 172.21.15.94:57170) 2024-04-25T12:24:49.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.614+0000 7f06fd355640 1 -- 172.21.15.94:0/2813475769 learned_addr learned my addr 172.21.15.94:0/2813475769 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:49.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f06fd355640 1 -- 172.21.15.94:0/2813475769 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f024586080 msgr2=0x55f024586460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f06fd355640 1 --2- 172.21.15.94:0/2813475769 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f024586080 0x55f024586460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f06fd355640 1 -- 172.21.15.94:0/2813475769 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0245869a0 msgr2=0x55f024586d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f06fd355640 1 --2- 172.21.15.94:0/2813475769 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0245869a0 0x55f024586d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f06fd355640 1 -- 172.21.15.94:0/2813475769 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f02443c450 con 0x55f024581fd0 2024-04-25T12:24:49.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f06fd355640 1 --2- 172.21.15.94:0/2813475769 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024581fd0 0x55f0245823b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f06f000b6c0 tx=0x7f06f0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e2d038c41d44cb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f06e2ffd640 1 -- 172.21.15.94:0/2813475769 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f00187d0 con 0x55f024581fd0 2024-04-25T12:24:49.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f06e2ffd640 1 -- 172.21.15.94:0/2813475769 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f0018970 con 0x55f024581fd0 2024-04-25T12:24:49.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f06e2ffd640 1 -- 172.21.15.94:0/2813475769 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f0018d20 con 0x55f024581fd0 2024-04-25T12:24:49.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 1 -- 172.21.15.94:0/2813475769 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024581fd0 msgr2=0x55f0245823b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 1 --2- 172.21.15.94:0/2813475769 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024581fd0 0x55f0245823b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f06f000b6c0 tx=0x7f06f0010000 comp rx=0 tx=0).stop 2024-04-25T12:24:49.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 1 -- 172.21.15.94:0/2813475769 shutdown_connections 2024-04-25T12:24:49.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 1 --2- 172.21.15.94:0/2813475769 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f024586080 0x55f024586460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 1 --2- 172.21.15.94:0/2813475769 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0245869a0 0x55f024586d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 1 --2- 172.21.15.94:0/2813475769 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024581fd0 0x55f0245823b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 1 -- 172.21.15.94:0/2813475769 >> 172.21.15.94:0/2813475769 conn(0x55f024582e40 msgr2=0x55f024585260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:49.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 1 -- 172.21.15.94:0/2813475769 shutdown_connections 2024-04-25T12:24:49.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 1 -- 172.21.15.94:0/2813475769 wait complete. 2024-04-25T12:24:49.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 1 -- start start 2024-04-25T12:24:49.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 1 Processor -- start 2024-04-25T12:24:49.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024581fd0 0x55f0245892c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f024586080 0x55f024589800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f0245869a0 0x55f024589d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55f024334ec0 con 0x55f024581fd0 2024-04-25T12:24:49.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55f024415120 con 0x55f024586080 2024-04-25T12:24:49.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x55f02439f350 con 0x55f0245869a0 2024-04-25T12:24:49.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 10 client.0 _ll_register_callbacks cb 0x55f0243714d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:24:49.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f06fd355640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024581fd0 0x55f0245892c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f06fd355640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024581fd0 0x55f0245892c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57188/0 (socket says 172.21.15.94:57188) 2024-04-25T12:24:49.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f06fd355640 1 -- 172.21.15.94:0/740214782 learned_addr learned my addr 172.21.15.94:0/740214782 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:49.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f06fdb56640 1 --2- 172.21.15.94:0/740214782 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f0245869a0 0x55f024589d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f06fd355640 1 -- 172.21.15.94:0/740214782 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f0245869a0 msgr2=0x55f024589d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f06fd355640 1 --2- 172.21.15.94:0/740214782 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f0245869a0 0x55f024589d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f06fd355640 1 -- 172.21.15.94:0/740214782 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f024586080 msgr2=0x55f024589800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f06fd355640 1 --2- 172.21.15.94:0/740214782 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f024586080 0x55f024589800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f06fd355640 1 -- 172.21.15.94:0/740214782 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0243d9f80 con 0x55f024581fd0 2024-04-25T12:24:49.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f06fd355640 1 --2- 172.21.15.94:0/740214782 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024581fd0 0x55f0245892c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f06f000dfd0 tx=0x7f06f0004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01a4e975dd606b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f06d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-04-25T12:24:49.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f06d7fff640 1 -- 172.21.15.94:0/740214782 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f0031070 con 0x55f024581fd0 2024-04-25T12:24:49.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f06d7fff640 1 -- 172.21.15.94:0/740214782 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f06f002d640 con 0x55f024581fd0 2024-04-25T12:24:49.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 1 -- 172.21.15.94:0/740214782 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06f0018970 con 0x55f024581fd0 2024-04-25T12:24:49.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f06d7fff640 1 -- 172.21.15.94:0/740214782 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f06f003c050 con 0x55f024581fd0 2024-04-25T12:24:49.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 10 client.4986 fetch_fsmap learned FSMap version 19 2024-04-25T12:24:49.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 1 -- 172.21.15.94:0/740214782 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55f02436df00 con 0x55f024581fd0 2024-04-25T12:24:49.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f06d7fff640 1 -- 172.21.15.94:0/740214782 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f0018970 con 0x55f024581fd0 2024-04-25T12:24:49.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f06d7fff640 1 -- 172.21.15.94:0/740214782 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f06f003f020 con 0x55f024581fd0 2024-04-25T12:24:49.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 10 client.4986 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T12:24:49.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 10 client.4986 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T12:24:49.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 20 client.4986 populate_metadata read hostname 'smithi094' 2024-04-25T12:24:49.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 1 --2- 172.21.15.94:0/740214782 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x55f02458a750 0x55f0245a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 4 client.4986 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T12:24:49.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f070273b000 1 -- 172.21.15.94:0/740214782 --> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f02432dbc0 con 0x55f02458a750 2024-04-25T12:24:49.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.618+0000 7f06fcb54640 1 --2- 172.21.15.94:0/740214782 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x55f02458a750 0x55f0245a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.622+0000 7f06d7fff640 10 client.4986 ms_handle_connect on v2:172.21.15.111:6836/3560813143 2024-04-25T12:24:49.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.622+0000 7f06fcb54640 1 --2- 172.21.15.94:0/740214782 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x55f02458a750 0x55f0245a15e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b48c4ee9fcf97ba server_cookie=2a30f853c13b3136 in_seq=0 out_seq=0 2024-04-25T12:24:49.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.622+0000 7f06d7fff640 1 -- 172.21.15.94:0/740214782 <== mds.0 v2:172.21.15.111:6836/3560813143 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f02432dbc0 con 0x55f02458a750 2024-04-25T12:24:49.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.622+0000 7f06d7fff640 10 client.4986 handle_command_reply: tid=0 2024-04-25T12:24:49.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.622+0000 7f070273b000 1 client.4986 shutdown 2024-04-25T12:24:49.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.622+0000 7f070273b000 1 -- 172.21.15.94:0/740214782 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024581fd0 msgr2=0x55f0245892c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.622+0000 7f070273b000 1 --2- 172.21.15.94:0/740214782 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024581fd0 0x55f0245892c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f06f000dfd0 tx=0x7f06f0004ac0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.622+0000 7f070273b000 1 -- 172.21.15.94:0/740214782 shutdown_connections 2024-04-25T12:24:49.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.622+0000 7f070273b000 1 --2- 172.21.15.94:0/740214782 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x55f02458a750 0x55f0245a15e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.622+0000 7f070273b000 1 --2- 172.21.15.94:0/740214782 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f0245869a0 0x55f024589d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.622+0000 7f06d7fff640 0 client.4986 ms_handle_reset on v2:172.21.15.111:6836/3560813143 2024-04-25T12:24:49.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.622+0000 7f070273b000 1 --2- 172.21.15.94:0/740214782 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f024586080 0x55f024589800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.622+0000 7f070273b000 1 --2- 172.21.15.94:0/740214782 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024581fd0 0x55f0245892c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.622+0000 7f070273b000 1 -- 172.21.15.94:0/740214782 >> 172.21.15.94:0/740214782 conn(0x55f024582e40 msgr2=0x55f024585230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:49.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.622+0000 7f070273b000 1 -- 172.21.15.94:0/740214782 shutdown_connections 2024-04-25T12:24:49.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.622+0000 7f070273b000 1 -- 172.21.15.94:0/740214782 wait complete. 2024-04-25T12:24:49.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.622+0000 7f070273b000 20 client.4986 trim_cache size 0 max 16384 2024-04-25T12:24:49.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.638+0000 7f070273b000 1 Processor -- start 2024-04-25T12:24:49.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.638+0000 7f070273b000 1 -- start start 2024-04-25T12:24:49.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.638+0000 7f070273b000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f024581fd0 0x55f02454ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.638+0000 7f070273b000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024586080 0x55f02454b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.638+0000 7f070273b000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0245869a0 0x55f02459f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.638+0000 7f070273b000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f06f81fa960 con 0x55f024586080 2024-04-25T12:24:49.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.638+0000 7f070273b000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f06f8165220 con 0x55f0245869a0 2024-04-25T12:24:49.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.638+0000 7f070273b000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x55f0243609e0 con 0x55f024581fd0 2024-04-25T12:24:49.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06fcb54640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024586080 0x55f02454b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06fcb54640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024586080 0x55f02454b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57190/0 (socket says 172.21.15.94:57190) 2024-04-25T12:24:49.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06fcb54640 1 -- 172.21.15.94:0/2294821796 learned_addr learned my addr 172.21.15.94:0/2294821796 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:49.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06fcb54640 1 -- 172.21.15.94:0/2294821796 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f024581fd0 msgr2=0x55f02454ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06fcb54640 1 --2- 172.21.15.94:0/2294821796 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f024581fd0 0x55f02454ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06fcb54640 1 -- 172.21.15.94:0/2294821796 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0245869a0 msgr2=0x55f02459f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06fcb54640 1 --2- 172.21.15.94:0/2294821796 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0245869a0 0x55f02459f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06fcb54640 1 -- 172.21.15.94:0/2294821796 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f02431ae80 con 0x55f024586080 2024-04-25T12:24:49.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06fcb54640 1 --2- 172.21.15.94:0/2294821796 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024586080 0x55f02454b390 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f06e801d3c0 tx=0x7f06e80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e307c122995c68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06e27fc640 1 -- 172.21.15.94:0/2294821796 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e80b5040 con 0x55f024586080 2024-04-25T12:24:49.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06e27fc640 1 -- 172.21.15.94:0/2294821796 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e80a89d0 con 0x55f024586080 2024-04-25T12:24:49.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06e27fc640 1 -- 172.21.15.94:0/2294821796 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e80a8d80 con 0x55f024586080 2024-04-25T12:24:49.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 1 -- 172.21.15.94:0/2294821796 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024586080 msgr2=0x55f02454b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 1 --2- 172.21.15.94:0/2294821796 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024586080 0x55f02454b390 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f06e801d3c0 tx=0x7f06e80046d0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 1 -- 172.21.15.94:0/2294821796 shutdown_connections 2024-04-25T12:24:49.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 1 --2- 172.21.15.94:0/2294821796 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0245869a0 0x55f02459f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 1 --2- 172.21.15.94:0/2294821796 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024586080 0x55f02454b390 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 1 --2- 172.21.15.94:0/2294821796 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f024581fd0 0x55f02454ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 1 -- 172.21.15.94:0/2294821796 >> 172.21.15.94:0/2294821796 conn(0x55f024582e40 msgr2=0x55f02454a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:49.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 1 -- 172.21.15.94:0/2294821796 shutdown_connections 2024-04-25T12:24:49.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 1 -- 172.21.15.94:0/2294821796 wait complete. 2024-04-25T12:24:49.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 1 -- start start 2024-04-25T12:24:49.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 1 Processor -- start 2024-04-25T12:24:49.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f024581fd0 0x55f0245f9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024586080 0x55f0245f9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f0245869a0 0x55f0245a2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x55f024398a50 con 0x55f024586080 2024-04-25T12:24:49.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55f024393730 con 0x55f024581fd0 2024-04-25T12:24:49.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x55f0243a1630 con 0x55f0245869a0 2024-04-25T12:24:49.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 10 client.0 _ll_register_callbacks cb 0x7f06f000b5c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:24:49.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06fcb54640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024586080 0x55f0245f9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06fcb54640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024586080 0x55f0245f9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57194/0 (socket says 172.21.15.94:57194) 2024-04-25T12:24:49.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06fcb54640 1 -- 172.21.15.94:0/601185579 learned_addr learned my addr 172.21.15.94:0/601185579 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:49.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06fdb56640 1 --2- 172.21.15.94:0/601185579 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f0245869a0 0x55f0245a2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06fcb54640 1 -- 172.21.15.94:0/601185579 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f0245869a0 msgr2=0x55f0245a2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06fd355640 1 --2- 172.21.15.94:0/601185579 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f024581fd0 0x55f0245f9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06fcb54640 1 --2- 172.21.15.94:0/601185579 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f0245869a0 0x55f0245a2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06fcb54640 1 -- 172.21.15.94:0/601185579 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f024581fd0 msgr2=0x55f0245f9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:49.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06fcb54640 1 --2- 172.21.15.94:0/601185579 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f024581fd0 0x55f0245f9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06fcb54640 1 -- 172.21.15.94:0/601185579 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f02435cb30 con 0x55f024586080 2024-04-25T12:24:49.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06fdb56640 1 --2- 172.21.15.94:0/601185579 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f0245869a0 0x55f0245a2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:49.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06fcb54640 1 --2- 172.21.15.94:0/601185579 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024586080 0x55f0245f9e50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f06e801d3c0 tx=0x7f06e801d550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab238580a5b0720 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:49.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-04-25T12:24:49.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06d7fff640 1 -- 172.21.15.94:0/601185579 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e80b5070 con 0x55f024586080 2024-04-25T12:24:49.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06d7fff640 1 -- 172.21.15.94:0/601185579 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f06e8004040 con 0x55f024586080 2024-04-25T12:24:49.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 1 -- 172.21.15.94:0/601185579 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06e80a89d0 con 0x55f024586080 2024-04-25T12:24:49.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06d7fff640 1 -- 172.21.15.94:0/601185579 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f06e80cd050 con 0x55f024586080 2024-04-25T12:24:49.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 10 client.4992 fetch_fsmap learned FSMap version 19 2024-04-25T12:24:49.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 1 -- 172.21.15.94:0/601185579 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55f0244155b0 con 0x55f024586080 2024-04-25T12:24:49.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06d7fff640 1 -- 172.21.15.94:0/601185579 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e80a89d0 con 0x55f024586080 2024-04-25T12:24:49.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f06d7fff640 1 -- 172.21.15.94:0/601185579 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f06e80d0020 con 0x55f024586080 2024-04-25T12:24:49.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 10 client.4992 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T12:24:49.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 10 client.4992 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T12:24:49.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 20 client.4992 populate_metadata read hostname 'smithi094' 2024-04-25T12:24:49.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 1 --2- 172.21.15.94:0/601185579 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x55f02458a750 0x55f0245a34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:49.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 4 client.4992 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T12:24:49.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.642+0000 7f070273b000 1 -- 172.21.15.94:0/601185579 --> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] -- command(tid 0: {"prefix": "status"}) -- 0x55f0243a1e40 con 0x55f02458a750 2024-04-25T12:24:49.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f06fd355640 1 --2- 172.21.15.94:0/601185579 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x55f02458a750 0x55f0245a34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:49.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f06d7fff640 10 client.4992 ms_handle_connect on v2:172.21.15.111:6836/3560813143 2024-04-25T12:24:49.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f06fd355640 1 --2- 172.21.15.94:0/601185579 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x55f02458a750 0x55f0245a34d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bac563dd7f2c034c server_cookie=3f09699009be393b in_seq=0 out_seq=0 2024-04-25T12:24:49.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f06d7fff640 1 -- 172.21.15.94:0/601185579 <== mds.0 v2:172.21.15.111:6836/3560813143 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55f0243a1e40 con 0x55f02458a750 2024-04-25T12:24:49.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f06d7fff640 10 client.4992 handle_command_reply: tid=0 2024-04-25T12:24:49.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f070273b000 1 client.4992 shutdown 2024-04-25T12:24:49.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f070273b000 1 -- 172.21.15.94:0/601185579 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024586080 msgr2=0x55f0245f9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f070273b000 1 --2- 172.21.15.94:0/601185579 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024586080 0x55f0245f9e50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f06e801d3c0 tx=0x7f06e801d550 comp rx=0 tx=0).stop 2024-04-25T12:24:49.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f070273b000 1 -- 172.21.15.94:0/601185579 shutdown_connections 2024-04-25T12:24:49.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f070273b000 1 --2- 172.21.15.94:0/601185579 >> [v2:172.21.15.111:6836/3560813143,v1:172.21.15.111:6837/3560813143] conn(0x55f02458a750 0x55f0245a34d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f070273b000 1 --2- 172.21.15.94:0/601185579 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55f0245869a0 0x55f0245a2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f06d7fff640 0 client.4992 ms_handle_reset on v2:172.21.15.111:6836/3560813143 2024-04-25T12:24:49.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f070273b000 1 --2- 172.21.15.94:0/601185579 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f024586080 0x55f0245f9e50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f070273b000 1 --2- 172.21.15.94:0/601185579 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f024581fd0 0x55f0245f9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f070273b000 1 -- 172.21.15.94:0/601185579 >> 172.21.15.94:0/601185579 conn(0x55f024582e40 msgr2=0x55f02454adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:49.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f070273b000 1 -- 172.21.15.94:0/601185579 shutdown_connections 2024-04-25T12:24:49.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f070273b000 1 -- 172.21.15.94:0/601185579 wait complete. 2024-04-25T12:24:49.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f070273b000 20 client.4992 trim_cache size 0 max 16384 2024-04-25T12:24:49.658 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-25T12:24:49.658 INFO:teuthology.orchestra.run.smithi094.stdout: "cluster_fsid": "7059a9e2-aec4-4b84-b942-caf531e15da3", 2024-04-25T12:24:49.658 INFO:teuthology.orchestra.run.smithi094.stdout: "whoami": 0, 2024-04-25T12:24:49.658 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 4285, 2024-04-25T12:24:49.658 INFO:teuthology.orchestra.run.smithi094.stdout: "want_state": "up:active", 2024-04-25T12:24:49.658 INFO:teuthology.orchestra.run.smithi094.stdout: "state": "up:active", 2024-04-25T12:24:49.659 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs", 2024-04-25T12:24:49.659 INFO:teuthology.orchestra.run.smithi094.stdout: "rank_uptime": 175.45645415199999, 2024-04-25T12:24:49.659 INFO:teuthology.orchestra.run.smithi094.stdout: "mdsmap_epoch": 19, 2024-04-25T12:24:49.659 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch": 28, 2024-04-25T12:24:49.659 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch_barrier": 28, 2024-04-25T12:24:49.659 INFO:teuthology.orchestra.run.smithi094.stdout: "uptime": 182.48758231400001 2024-04-25T12:24:49.659 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-25T12:24:49.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f06ff5b9640 1 -- 172.21.15.94:0/4111186026 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f06dc068380 msgr2=0x7f06dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f06ff5b9640 1 --2- 172.21.15.94:0/4111186026 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f06dc068380 0x7f06dc06a840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f06f000d430 tx=0x7f06f0007530 comp rx=0 tx=0).stop 2024-04-25T12:24:49.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f06ff5b9640 1 -- 172.21.15.94:0/4111186026 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06f80c89c0 msgr2=0x7f06f8073980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:49.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f06ff5b9640 1 --2- 172.21.15.94:0/4111186026 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06f80c89c0 0x7f06f8073980 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f06f400c3f0 tx=0x7f06f400c8b0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f06ff5b9640 1 -- 172.21.15.94:0/4111186026 shutdown_connections 2024-04-25T12:24:49.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f06ff5b9640 1 --2- 172.21.15.94:0/4111186026 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f06dc068380 0x7f06dc06a840 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f06ff5b9640 1 --2- 172.21.15.94:0/4111186026 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f06f80c85e0 0x7f06f81ef100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f06ff5b9640 1 --2- 172.21.15.94:0/4111186026 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06f80c89c0 0x7f06f8073980 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f06ff5b9640 1 --2- 172.21.15.94:0/4111186026 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f06f806c4f0 0x7f06f81526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:49.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f06ff5b9640 1 -- 172.21.15.94:0/4111186026 >> 172.21.15.94:0/4111186026 conn(0x7f06f806b9d0 msgr2=0x7f06f80c9300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:49.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f06ff5b9640 1 -- 172.21.15.94:0/4111186026 shutdown_connections 2024-04-25T12:24:49.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:49.646+0000 7f06ff5b9640 1 -- 172.21.15.94:0/4111186026 wait complete. 2024-04-25T12:24:49.667 INFO:teuthology.run_tasks:Running task sequential... 2024-04-25T12:24:49.680 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-25T12:24:49.680 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-25T12:24:49.680 INFO:teuthology.task.print:Enabling mgr modules 2024-04-25T12:24:49.681 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-25T12:24:49.711 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-25T12:24:49.711 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-25T12:24:49.711 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-25T12:24:49.712 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T12:24:49.712 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T12:24:49.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:49.712 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2024-04-25T12:24:49.716 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-25T12:24:49.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:49.717 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T12:24:49.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:49.770 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link delete ceph-brx 2024-04-25T12:24:49.963 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-25T12:24:49.964 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T12:24:50.025 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:24:50.028 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:24:50.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.082+0000 7f0292d40640 1 Processor -- start 2024-04-25T12:24:50.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.082+0000 7f0292d40640 1 -- start start 2024-04-25T12:24:50.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.082+0000 7f0292d40640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f028c0c0a20 0x7f028c06c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:50.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.082+0000 7f0292d40640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f028c06e4b0 0x7f028c073a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:50.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.082+0000 7f0292d40640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f028c0677b0 con 0x7f028c153100 2024-04-25T12:24:50.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.082+0000 7f0292d40640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f028c06cb20 con 0x7f028c0c0a20 2024-04-25T12:24:50.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.082+0000 7f0292d40640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f028c067d70 con 0x7f028c06e4b0 2024-04-25T12:24:50.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.082+0000 7f028bfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f028c0c0a20 0x7f028c06c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:50.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.082+0000 7f0290adc640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f028c153100 0x7f028c159970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50248/0 (socket says 172.21.15.94:50248) 2024-04-25T12:24:50.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.082+0000 7f028bfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f028c0c0a20 0x7f028c06c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57210/0 (socket says 172.21.15.94:57210) 2024-04-25T12:24:50.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.082+0000 7f0290adc640 1 -- 172.21.15.94:0/2012650699 learned_addr learned my addr 172.21.15.94:0/2012650699 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:50.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.082+0000 7f02912dd640 1 --2- 172.21.15.94:0/2012650699 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f028c06e4b0 0x7f028c073a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:50.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.082+0000 7f028bfff640 1 -- 172.21.15.94:0/2012650699 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f028c06e4b0 msgr2=0x7f028c073a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:50.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.082+0000 7f028bfff640 1 --2- 172.21.15.94:0/2012650699 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f028c06e4b0 0x7f028c073a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:50.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.082+0000 7f028bfff640 1 -- 172.21.15.94:0/2012650699 >> v1:172.21.15.94:6789/0 conn(0x7f028c153100 legacy=0x7f028c159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:50.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.082+0000 7f028bfff640 1 -- 172.21.15.94:0/2012650699 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f028c067a90 con 0x7f028c0c0a20 2024-04-25T12:24:50.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.082+0000 7f02912dd640 1 --2- 172.21.15.94:0/2012650699 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f028c06e4b0 0x7f028c073a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:50.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.082+0000 7f028bfff640 1 --2- 172.21.15.94:0/2012650699 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f028c0c0a20 0x7f028c06c5e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f02800097c0 tx=0x7f028001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b10d71480edd599d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:50.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.082+0000 7f028b7fe640 1 -- 172.21.15.94:0/2012650699 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02800a7070 con 0x7f028c0c0a20 2024-04-25T12:24:50.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f028b7fe640 1 -- 172.21.15.94:0/2012650699 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02800b0070 con 0x7f028c0c0a20 2024-04-25T12:24:50.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f028b7fe640 1 -- 172.21.15.94:0/2012650699 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02800ab890 con 0x7f028c0c0a20 2024-04-25T12:24:50.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0292d40640 1 -- 172.21.15.94:0/2012650699 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f028c0c0a20 msgr2=0x7f028c06c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:50.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0292d40640 1 --2- 172.21.15.94:0/2012650699 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f028c0c0a20 0x7f028c06c5e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f02800097c0 tx=0x7f028001c470 comp rx=0 tx=0).stop 2024-04-25T12:24:50.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0292d40640 1 -- 172.21.15.94:0/2012650699 shutdown_connections 2024-04-25T12:24:50.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0292d40640 1 --2- 172.21.15.94:0/2012650699 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f028c06e4b0 0x7f028c073a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:50.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0292d40640 1 --2- 172.21.15.94:0/2012650699 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f028c0c0a20 0x7f028c06c5e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:50.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0292d40640 1 -- 172.21.15.94:0/2012650699 >> 172.21.15.94:0/2012650699 conn(0x7f028c06f280 msgr2=0x7f028c06f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:50.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0292d40640 1 -- 172.21.15.94:0/2012650699 shutdown_connections 2024-04-25T12:24:50.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0292d40640 1 -- 172.21.15.94:0/2012650699 wait complete. 2024-04-25T12:24:50.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0292d40640 1 Processor -- start 2024-04-25T12:24:50.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0292d40640 1 -- start start 2024-04-25T12:24:50.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0292d40640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f028c06e4b0 0x7f028c158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:50.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0292d40640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f028c0c0a20 0x7f028c1f47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:50.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0292d40640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f028c153100 0x7f028c1f4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:50.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0292d40640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f028c153660 con 0x7f028c06e4b0 2024-04-25T12:24:50.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0292d40640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f028c1534e0 con 0x7f028c153100 2024-04-25T12:24:50.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0292d40640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f028c1660e0 con 0x7f028c0c0a20 2024-04-25T12:24:50.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0290adc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f028c06e4b0 0x7f028c158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:50.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0290adc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f028c06e4b0 0x7f028c158540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57226/0 (socket says 172.21.15.94:57226) 2024-04-25T12:24:50.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0290adc640 1 -- 172.21.15.94:0/2803495520 learned_addr learned my addr 172.21.15.94:0/2803495520 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:50.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f028bfff640 1 --2- 172.21.15.94:0/2803495520 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f028c0c0a20 0x7f028c1f47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:50.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f02912dd640 1 --2- 172.21.15.94:0/2803495520 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f028c153100 0x7f028c1f4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:50.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0290adc640 1 -- 172.21.15.94:0/2803495520 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f028c0c0a20 msgr2=0x7f028c1f47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:50.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0290adc640 1 --2- 172.21.15.94:0/2803495520 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f028c0c0a20 0x7f028c1f47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:50.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0290adc640 1 -- 172.21.15.94:0/2803495520 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f028c153100 msgr2=0x7f028c1f4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:50.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0290adc640 1 --2- 172.21.15.94:0/2803495520 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f028c153100 0x7f028c1f4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:50.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0290adc640 1 -- 172.21.15.94:0/2803495520 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f028c072920 con 0x7f028c06e4b0 2024-04-25T12:24:50.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f02912dd640 1 --2- 172.21.15.94:0/2803495520 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f028c153100 0x7f028c1f4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:50.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0290adc640 1 --2- 172.21.15.94:0/2803495520 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f028c06e4b0 0x7f028c158540 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f027c00c3a0 tx=0x7f027c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:50.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f02897fa640 1 -- 172.21.15.94:0/2803495520 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027c017070 con 0x7f028c06e4b0 2024-04-25T12:24:50.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f02897fa640 1 -- 172.21.15.94:0/2803495520 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f027c005cf0 con 0x7f028c06e4b0 2024-04-25T12:24:50.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f02897fa640 1 -- 172.21.15.94:0/2803495520 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027c0072f0 con 0x7f028c06e4b0 2024-04-25T12:24:50.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0292d40640 1 -- 172.21.15.94:0/2803495520 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f028c071f90 con 0x7f028c06e4b0 2024-04-25T12:24:50.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.086+0000 7f0292d40640 1 -- 172.21.15.94:0/2803495520 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f028c163170 con 0x7f028c06e4b0 2024-04-25T12:24:50.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.090+0000 7f0292d40640 1 -- 172.21.15.94:0/2803495520 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f028c075df0 con 0x7f028c06e4b0 2024-04-25T12:24:50.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.090+0000 7f02897fa640 1 -- 172.21.15.94:0/2803495520 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f027c01a070 con 0x7f028c06e4b0 2024-04-25T12:24:50.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.090+0000 7f02897fa640 1 --2- 172.21.15.94:0/2803495520 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0278068380 0x7f027806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:50.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.090+0000 7f02897fa640 1 -- 172.21.15.94:0/2803495520 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f027c086050 con 0x7f028c06e4b0 2024-04-25T12:24:50.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.090+0000 7f028bfff640 1 --2- 172.21.15.94:0/2803495520 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0278068380 0x7f027806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:50.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.090+0000 7f028bfff640 1 --2- 172.21.15.94:0/2803495520 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0278068380 0x7f027806a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f02800af000 tx=0x7f02800a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:50.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.094+0000 7f02897fa640 1 -- 172.21.15.94:0/2803495520 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f027c0562b0 con 0x7f028c06e4b0 2024-04-25T12:24:50.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.290+0000 7f0292d40640 1 -- 172.21.15.94:0/2803495520 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f028c0c73d0 con 0x7f028c06e4b0 2024-04-25T12:24:50.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.294+0000 7f02897fa640 1 -- 172.21.15.94:0/2803495520 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) ==== 53+0+88 (secure 0 0 0) 0x7f027c055bb0 con 0x7f028c06e4b0 2024-04-25T12:24:50.299 INFO:teuthology.orchestra.run.smithi094.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T12:24:50.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.294+0000 7f0292d40640 1 -- 172.21.15.94:0/2803495520 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0278068380 msgr2=0x7f027806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:50.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.294+0000 7f0292d40640 1 --2- 172.21.15.94:0/2803495520 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0278068380 0x7f027806a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f02800af000 tx=0x7f02800a7000 comp rx=0 tx=0).stop 2024-04-25T12:24:50.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.294+0000 7f0292d40640 1 -- 172.21.15.94:0/2803495520 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f028c06e4b0 msgr2=0x7f028c158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:50.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.294+0000 7f0292d40640 1 --2- 172.21.15.94:0/2803495520 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f028c06e4b0 0x7f028c158540 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f027c00c3a0 tx=0x7f027c00c860 comp rx=0 tx=0).stop 2024-04-25T12:24:50.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.294+0000 7f0292d40640 1 -- 172.21.15.94:0/2803495520 shutdown_connections 2024-04-25T12:24:50.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.294+0000 7f0292d40640 1 --2- 172.21.15.94:0/2803495520 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0278068380 0x7f027806a840 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:50.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.294+0000 7f0292d40640 1 --2- 172.21.15.94:0/2803495520 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f028c0c0a20 0x7f028c1f47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:50.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.294+0000 7f0292d40640 1 --2- 172.21.15.94:0/2803495520 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f028c153100 0x7f028c1f4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:50.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.294+0000 7f0292d40640 1 --2- 172.21.15.94:0/2803495520 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f028c06e4b0 0x7f028c158540 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:50.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.294+0000 7f0292d40640 1 -- 172.21.15.94:0/2803495520 >> 172.21.15.94:0/2803495520 conn(0x7f028c06f280 msgr2=0x7f028c14fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:50.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.294+0000 7f0292d40640 1 -- 172.21.15.94:0/2803495520 shutdown_connections 2024-04-25T12:24:50.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50.294+0000 7f0292d40640 1 -- 172.21.15.94:0/2803495520 wait complete. 2024-04-25T12:24:50.315 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T12:24:50.315 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T12:24:50.315 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi094.front.sepia.ceph.com 2024-04-25T12:24:50.316 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T12:24:50.316 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T12:24:50.316 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T12:24:50.316 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T12:24:50.316 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T12:24:50.316 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T12:24:50.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:50.316 DEBUG:teuthology.orchestra.run.smithi094:> ip addr 2024-04-25T12:24:50.322 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T12:24:50.322 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T12:24:50.322 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T12:24:50.322 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-04-25T12:24:50.323 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2024-04-25T12:24:50.323 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-04-25T12:24:50.323 INFO:teuthology.orchestra.run.smithi094.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T12:24:50.323 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4c brd ff:ff:ff:ff:ff:ff 2024-04-25T12:24:50.323 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f0 2024-04-25T12:24:50.323 INFO:teuthology.orchestra.run.smithi094.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T12:24:50.323 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4d brd ff:ff:ff:ff:ff:ff 2024-04-25T12:24:50.323 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f1 2024-04-25T12:24:50.323 INFO:teuthology.orchestra.run.smithi094.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T12:24:50.323 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:62 brd ff:ff:ff:ff:ff:ff 2024-04-25T12:24:50.323 INFO:teuthology.orchestra.run.smithi094.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T12:24:50.323 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:63 brd ff:ff:ff:ff:ff:ff 2024-04-25T12:24:50.323 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.21.15.94/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T12:24:50.324 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft 42327sec preferred_lft 42327sec 2024-04-25T12:24:50.324 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::ec4:7aff:fe8f:d763/64 scope link 2024-04-25T12:24:50.324 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-04-25T12:24:50.324 INFO:teuthology.orchestra.run.smithi094.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T12:24:50.324 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 02:42:62:f0:0e:70 brd ff:ff:ff:ff:ff:ff 2024-04-25T12:24:50.324 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T12:24:50.324 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-04-25T12:24:50.324 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T12:24:50.324 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:24:50.325 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-04-25T12:24:50.325 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link add name ceph-brx type bridge 2024-04-25T12:24:50.325 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip addr flush dev ceph-brx 2024-04-25T12:24:50.325 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set ceph-brx up 2024-04-25T12:24:50.325 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T12:24:50.325 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-04-25T12:24:50.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:24:50.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:24:50.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:50.445 DEBUG:teuthology.orchestra.run.smithi094:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T12:24:50.494 INFO:teuthology.orchestra.run.smithi094.stdout:1 2024-04-25T12:24:50.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:50.495 DEBUG:teuthology.orchestra.run.smithi094:> route 2024-04-25T12:24:50.546 INFO:teuthology.orchestra.run.smithi094.stdout:Kernel IP routing table 2024-04-25T12:24:50.546 INFO:teuthology.orchestra.run.smithi094.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T12:24:50.546 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T12:24:50.546 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T12:24:50.546 INFO:teuthology.orchestra.run.smithi094.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T12:24:50.546 INFO:teuthology.orchestra.run.smithi094.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T12:24:50.546 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T12:24:50.547 INFO:teuthology.orchestra.run.smithi094.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T12:24:50.547 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T12:24:50.547 INFO:teuthology.orchestra.run.smithi094.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T12:24:50.547 INFO:teuthology.orchestra.run.smithi094.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T12:24:50.547 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:24:50.547 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-04-25T12:24:50.547 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T12:24:50.547 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T12:24:50.547 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T12:24:50.548 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-04-25T12:24:50.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:24:50.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:24:50.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:50.667 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2024-04-25T12:24:50.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:50.714 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list-id 2024-04-25T12:24:50.762 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:24:50.762 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-04-25T12:24:50.762 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T12:24:50.762 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T12:24:50.762 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-04-25T12:24:50.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:24:50.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:24:50.882 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T12:24:50.882 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:24:50.882 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-04-25T12:24:50.882 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T12:24:50.883 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T12:24:50.883 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T12:24:50.883 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T12:24:50.883 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T12:24:50.883 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-04-25T12:24:50.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:24:50.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:24:50.974 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:24:50.974 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-04-25T12:24:50.974 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set brx.0 up 2024-04-25T12:24:50.974 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T12:24:50.974 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-04-25T12:24:51.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:24:51.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:24:51.078 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-25T12:24:51.078 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T12:24:51.078 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T12:24:51.125 INFO:teuthology.orchestra.run.smithi094.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T12:24:51.126 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T12:24:51.126 DEBUG:teuthology.orchestra.run.smithi094:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T12:24:51.174 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-04-25T12:24:51.231 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T12:24:51.279 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-04-25T12:24:51.279 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-04-25T12:24:51.279 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-04-25T12:24:51.279 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-04-25T12:24:51.279 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-04-25T12:24:51.279 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-04-25T12:24:51.279 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-04-25T12:24:51.279 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-04-25T12:24:51.279 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-04-25T12:24:51.279 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-04-25T12:24:51.280 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-04-25T12:24:51.280 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-04-25T12:24:51.280 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T12:24:51.280 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-04-25T12:24:51.280 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-04-25T12:24:51.280 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-04-25T12:24:51.280 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-04-25T12:24:51.280 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-04-25T12:24:51.280 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-04-25T12:24:51.280 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-04-25T12:24:51.280 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T12:24:51.280 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-04-25T12:24:51.280 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-04-25T12:24:51.280 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-04-25T12:24:51.281 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T12:24:51.281 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T12:24:51.281 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T12:24:51.281 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T12:24:51.281 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-04-25T12:24:51.281 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T12:24:51.281 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T12:24:51.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:51.282 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-04-25T12:24:51.330 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T12:24:51.330 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-25T12:24:51.375 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-04-25T12:24:51.389 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T12:24:51.442 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-04-25T12:24:51.442 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-04-25T12:24:51.443 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-04-25T12:24:51.443 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-04-25T12:24:51.443 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-04-25T12:24:51.443 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-04-25T12:24:51.443 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-04-25T12:24:51.443 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-04-25T12:24:51.443 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-04-25T12:24:51.443 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-04-25T12:24:51.443 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-04-25T12:24:51.443 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-04-25T12:24:51.443 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T12:24:51.443 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-04-25T12:24:51.443 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-04-25T12:24:51.443 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-04-25T12:24:51.444 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-04-25T12:24:51.444 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-04-25T12:24:51.444 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-04-25T12:24:51.444 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-04-25T12:24:51.444 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T12:24:51.444 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-04-25T12:24:51.444 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-04-25T12:24:51.444 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-04-25T12:24:51.444 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T12:24:51.444 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T12:24:51.444 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T12:24:51.444 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T12:24:51.444 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-04-25T12:24:51.444 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T12:24:51.445 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T12:24:51.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:51.445 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-04-25T12:24:51.455 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:2024-04-25T12:24:51.450+0000 7f9f958df580 -1 init, newargv = 0x562fae1932f0 newargc=15 2024-04-25T12:24:51.455 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[35023]: starting ceph client 2024-04-25T12:24:51.475 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[35023]: starting fuse 2024-04-25T12:24:52.560 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2024-04-25T12:24:52.577 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T12:24:52.626 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2024-04-25T12:24:52.626 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2024-04-25T12:24:52.626 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2024-04-25T12:24:52.626 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2024-04-25T12:24:52.626 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2024-04-25T12:24:52.627 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2024-04-25T12:24:52.627 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2024-04-25T12:24:52.627 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2024-04-25T12:24:52.627 INFO:teuthology.orchestra.run.smithi094.stdout:/run/lock 2024-04-25T12:24:52.627 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2024-04-25T12:24:52.627 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2024-04-25T12:24:52.627 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2024-04-25T12:24:52.628 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T12:24:52.628 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2024-04-25T12:24:52.628 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2024-04-25T12:24:52.628 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2024-04-25T12:24:52.628 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2024-04-25T12:24:52.628 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/fs/nfsd 2024-04-25T12:24:52.628 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2024-04-25T12:24:52.628 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2024-04-25T12:24:52.629 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T12:24:52.629 INFO:teuthology.orchestra.run.smithi094.stdout:/run/rpc_pipefs 2024-04-25T12:24:52.629 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2024-04-25T12:24:52.629 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2024-04-25T12:24:52.629 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T12:24:52.629 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T12:24:52.630 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T12:24:52.630 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T12:24:52.630 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2024-04-25T12:24:52.630 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T12:24:52.630 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T12:24:52.630 INFO:teuthology.orchestra.run.smithi094.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-25T12:24:52.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:52.632 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2024-04-25T12:24:52.678 INFO:teuthology.orchestra.run.smithi094.stdout:45 2024-04-25T12:24:52.679 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-25T12:24:52.679 DEBUG:teuthology.orchestra.run.smithi094:> sudo stdin-killer -- python3 -c ' 2024-04-25T12:24:52.679 DEBUG:teuthology.orchestra.run.smithi094:> import glob 2024-04-25T12:24:52.679 DEBUG:teuthology.orchestra.run.smithi094:> import re 2024-04-25T12:24:52.679 DEBUG:teuthology.orchestra.run.smithi094:> import os 2024-04-25T12:24:52.679 DEBUG:teuthology.orchestra.run.smithi094:> import subprocess 2024-04-25T12:24:52.679 DEBUG:teuthology.orchestra.run.smithi094:> 2024-04-25T12:24:52.679 DEBUG:teuthology.orchestra.run.smithi094:> def _find_admin_socket(client_name): 2024-04-25T12:24:52.679 DEBUG:teuthology.orchestra.run.smithi094:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-25T12:24:52.679 DEBUG:teuthology.orchestra.run.smithi094:> files = glob.glob(asok_path) 2024-04-25T12:24:52.679 DEBUG:teuthology.orchestra.run.smithi094:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T12:24:52.679 DEBUG:teuthology.orchestra.run.smithi094:> 2024-04-25T12:24:52.679 DEBUG:teuthology.orchestra.run.smithi094:> # Given a non-glob path, it better be there 2024-04-25T12:24:52.680 DEBUG:teuthology.orchestra.run.smithi094:> if "*" not in asok_path: 2024-04-25T12:24:52.680 DEBUG:teuthology.orchestra.run.smithi094:> assert(len(files) == 1) 2024-04-25T12:24:52.680 DEBUG:teuthology.orchestra.run.smithi094:> return files[0] 2024-04-25T12:24:52.680 DEBUG:teuthology.orchestra.run.smithi094:> 2024-04-25T12:24:52.680 DEBUG:teuthology.orchestra.run.smithi094:> for f in files: 2024-04-25T12:24:52.680 DEBUG:teuthology.orchestra.run.smithi094:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T12:24:52.680 DEBUG:teuthology.orchestra.run.smithi094:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T12:24:52.680 DEBUG:teuthology.orchestra.run.smithi094:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T12:24:52.680 DEBUG:teuthology.orchestra.run.smithi094:> contents = proc_f.read() 2024-04-25T12:24:52.680 DEBUG:teuthology.orchestra.run.smithi094:> if mountpoint in contents: 2024-04-25T12:24:52.680 DEBUG:teuthology.orchestra.run.smithi094:> return f 2024-04-25T12:24:52.680 DEBUG:teuthology.orchestra.run.smithi094:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T12:24:52.680 DEBUG:teuthology.orchestra.run.smithi094:> 2024-04-25T12:24:52.680 DEBUG:teuthology.orchestra.run.smithi094:> print(_find_admin_socket("client.0")) 2024-04-25T12:24:52.680 DEBUG:teuthology.orchestra.run.smithi094:> ' 2024-04-25T12:24:52.805 INFO:teuthology.orchestra.run.smithi094.stdout:/var/run/ceph/ceph-client.0.35023.asok 2024-04-25T12:24:52.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:24:52.817 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.35023.asok 2024-04-25T12:24:52.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:52.817 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.35023.asok status 2024-04-25T12:24:52.972 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-25T12:24:52.973 INFO:teuthology.orchestra.run.smithi094.stdout: "metadata": { 2024-04-25T12:24:52.973 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_sha1": "d69f13d827952bb07bb9b7973bca14f97d764d6f", 2024-04-25T12:24:52.973 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_version": "ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev)", 2024-04-25T12:24:52.973 INFO:teuthology.orchestra.run.smithi094.stdout: "entity_id": "0", 2024-04-25T12:24:52.973 INFO:teuthology.orchestra.run.smithi094.stdout: "hostname": "smithi094", 2024-04-25T12:24:52.973 INFO:teuthology.orchestra.run.smithi094.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-25T12:24:52.973 INFO:teuthology.orchestra.run.smithi094.stdout: "pid": "35023", 2024-04-25T12:24:52.973 INFO:teuthology.orchestra.run.smithi094.stdout: "root": "/" 2024-04-25T12:24:52.973 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-25T12:24:52.973 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_count": 0, 2024-04-25T12:24:52.973 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_pinned_count": 0, 2024-04-25T12:24:52.974 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 5010, 2024-04-25T12:24:52.974 INFO:teuthology.orchestra.run.smithi094.stdout: "inst": { 2024-04-25T12:24:52.974 INFO:teuthology.orchestra.run.smithi094.stdout: "name": { 2024-04-25T12:24:52.974 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "client", 2024-04-25T12:24:52.974 INFO:teuthology.orchestra.run.smithi094.stdout: "num": 5010 2024-04-25T12:24:52.974 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-25T12:24:52.974 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-04-25T12:24:52.974 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-04-25T12:24:52.974 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2024-04-25T12:24:52.974 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 3172585866 2024-04-25T12:24:52.974 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-25T12:24:52.974 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-25T12:24:52.975 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2024-04-25T12:24:52.975 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-04-25T12:24:52.975 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2024-04-25T12:24:52.975 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 3172585866 2024-04-25T12:24:52.975 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-25T12:24:52.975 INFO:teuthology.orchestra.run.smithi094.stdout: "inst_str": "client.5010 192.168.0.1:0/3172585866", 2024-04-25T12:24:52.975 INFO:teuthology.orchestra.run.smithi094.stdout: "addr_str": "192.168.0.1:0/3172585866", 2024-04-25T12:24:52.975 INFO:teuthology.orchestra.run.smithi094.stdout: "inode_count": 1, 2024-04-25T12:24:52.975 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_epoch": 19, 2024-04-25T12:24:52.975 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch": 28, 2024-04-25T12:24:52.975 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch_barrier": 0, 2024-04-25T12:24:52.975 INFO:teuthology.orchestra.run.smithi094.stdout: "blocklisted": false, 2024-04-25T12:24:52.975 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs" 2024-04-25T12:24:52.976 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-25T12:24:52.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:52.987 DEBUG:teuthology.orchestra.run.smithi094:> stat --file-system '--printf=%T 2024-04-25T12:24:52.987 DEBUG:teuthology.orchestra.run.smithi094:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-25T12:24:52.993 INFO:teuthology.orchestra.run.smithi094.stdout:fuseblk 2024-04-25T12:24:52.993 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-25T12:24:52.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:52.994 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T12:24:53.050 INFO:teuthology.run_tasks:Running task quiescer... 2024-04-25T12:24:53.064 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_df40303764f976ac2e973c1ef2b40d1ebbda473b/qa/tasks/quiescer.py", line 386, in task cluster_name = ctx.config['cluster'] KeyError: 'cluster' 2024-04-25T12:24:53.311 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=c1dd077755d84951b23658a65e5caa2f Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_df40303764f976ac2e973c1ef2b40d1ebbda473b/qa/tasks/quiescer.py", line 386, in task cluster_name = ctx.config['cluster'] KeyError: 'cluster' 2024-04-25T12:24:53.312 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-04-25T12:24:53.321 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-25T12:24:53.359 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-25T12:24:53.360 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:24:53.360 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T12:24:53.374 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:24:53.374 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T12:24:53.419 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:24:53.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19f6b4a640 1 Processor -- start 2024-04-25T12:24:53.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19f6b4a640 1 -- start start 2024-04-25T12:24:53.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19f6b4a640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f19f00c5e90 0x7f19f0162ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:53.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19f6b4a640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19f00c8be0 con 0x7f19f00c4b40 2024-04-25T12:24:53.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19f6b4a640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19f00c4790 con 0x7f19f00c8800 2024-04-25T12:24:53.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19f6b4a640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f19f0158090 con 0x7f19f00c5e90 2024-04-25T12:24:53.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19effff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f19f00c4b40 0x7f19f00c5780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58374/0 (socket says 172.21.15.94:58374) 2024-04-25T12:24:53.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19effff640 1 -- 172.21.15.94:0/1699588423 learned_addr learned my addr 172.21.15.94:0/1699588423 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:53.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19f50e7640 1 --2- 172.21.15.94:0/1699588423 >> v2:172.21.15.111:3300/0 conn(0x7f19f00c5e90 0x7f19f0162ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:53.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19ef7fe640 1 -- 172.21.15.94:0/1699588423 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2938466121 0 0) 0x7f19f00c8be0 con 0x7f19f00c4b40 2024-04-25T12:24:53.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19ef7fe640 1 -- 172.21.15.94:0/1699588423 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19d8003530 con 0x7f19f00c4b40 2024-04-25T12:24:53.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19ef7fe640 1 -- 172.21.15.94:0/1699588423 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3225772972 0 0) 0x7f19d8003530 con 0x7f19f00c4b40 2024-04-25T12:24:53.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19ef7fe640 1 -- 172.21.15.94:0/1699588423 >> v2:172.21.15.111:3300/0 conn(0x7f19f00c5e90 msgr2=0x7f19f0162ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:53.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19ef7fe640 1 --2- 172.21.15.94:0/1699588423 >> v2:172.21.15.111:3300/0 conn(0x7f19f00c5e90 0x7f19f0162ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:53.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19ef7fe640 1 -- 172.21.15.94:0/1699588423 >> v1:172.21.15.111:6789/0 conn(0x7f19f00c8800 legacy=0x7f19f00c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:53.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19ef7fe640 1 -- 172.21.15.94:0/1699588423 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f01582e0 con 0x7f19f00c4b40 2024-04-25T12:24:53.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19ef7fe640 1 -- 172.21.15.94:0/1699588423 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7f19e4001680 con 0x7f19f00c4b40 2024-04-25T12:24:53.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19ef7fe640 1 -- 172.21.15.94:0/1699588423 >> v1:172.21.15.94:6789/0 conn(0x7f19f00c4b40 legacy=0x7f19f00c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:53.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19ef7fe640 1 --2- 172.21.15.94:0/1699588423 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f19d80039c0 0x7f19d8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:53.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19ef7fe640 1 --2- 172.21.15.94:0/1699588423 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f19d8004810 0x7f19d8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:53.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19ef7fe640 1 --2- 172.21.15.94:0/1699588423 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19d80051d0 0x7f19d800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:53.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19ef7fe640 1 -- 172.21.15.94:0/1699588423 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f19f0158090 con 0x7f19d80039c0 2024-04-25T12:24:53.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19ef7fe640 1 -- 172.21.15.94:0/1699588423 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f19d800c120 con 0x7f19d80051d0 2024-04-25T12:24:53.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19ef7fe640 1 -- 172.21.15.94:0/1699588423 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f19d800c320 con 0x7f19d8004810 2024-04-25T12:24:53.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19f48e6640 1 --2- 172.21.15.94:0/1699588423 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f19d80039c0 0x7f19d8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:53.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19f50e7640 1 --2- 172.21.15.94:0/1699588423 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19d80051d0 0x7f19d800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:53.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19f48e6640 1 -- 172.21.15.94:0/1699588423 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f19d8004810 msgr2=0x7f19d8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:53.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19effff640 1 --2- 172.21.15.94:0/1699588423 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f19d8004810 0x7f19d8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:53.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19f48e6640 1 --2- 172.21.15.94:0/1699588423 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f19d8004810 0x7f19d8004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:53.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19f48e6640 1 -- 172.21.15.94:0/1699588423 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19d80051d0 msgr2=0x7f19d800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:53.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19f48e6640 1 --2- 172.21.15.94:0/1699588423 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19d80051d0 0x7f19d800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:53.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19f48e6640 1 -- 172.21.15.94:0/1699588423 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d8003530 con 0x7f19d80039c0 2024-04-25T12:24:53.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19f50e7640 1 --2- 172.21.15.94:0/1699588423 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19d80051d0 0x7f19d800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:53.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.586+0000 7f19f50e7640 1 -- 172.21.15.94:0/1699588423 reap_dead start 2024-04-25T12:24:53.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.590+0000 7f19f48e6640 1 --2- 172.21.15.94:0/1699588423 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f19d80039c0 0x7f19d8003da0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f19e0001860 tx=0x7f19e001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b5dc80c2681629 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:53.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.590+0000 7f19ef7fe640 1 -- 172.21.15.94:0/1699588423 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e00b1070 con 0x7f19d80039c0 2024-04-25T12:24:53.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.590+0000 7f19ef7fe640 1 -- 172.21.15.94:0/1699588423 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19e00ac620 con 0x7f19d80039c0 2024-04-25T12:24:53.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.590+0000 7f19ef7fe640 1 -- 172.21.15.94:0/1699588423 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e0001460 con 0x7f19d80039c0 2024-04-25T12:24:53.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.590+0000 7f19f6b4a640 1 -- 172.21.15.94:0/1699588423 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f19d80039c0 msgr2=0x7f19d8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:53.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.590+0000 7f19f6b4a640 1 --2- 172.21.15.94:0/1699588423 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f19d80039c0 0x7f19d8003da0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f19e0001860 tx=0x7f19e001c500 comp rx=0 tx=0).stop 2024-04-25T12:24:53.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.590+0000 7f19f6b4a640 1 -- 172.21.15.94:0/1699588423 shutdown_connections 2024-04-25T12:24:53.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.590+0000 7f19f6b4a640 1 --2- 172.21.15.94:0/1699588423 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f19d80039c0 0x7f19d8003da0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:53.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.590+0000 7f19f6b4a640 1 -- 172.21.15.94:0/1699588423 >> 172.21.15.94:0/1699588423 conn(0x7f19f006b9d0 msgr2=0x7f19f006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:53.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.590+0000 7f19f6b4a640 1 -- 172.21.15.94:0/1699588423 shutdown_connections 2024-04-25T12:24:53.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.590+0000 7f19f6b4a640 1 -- 172.21.15.94:0/1699588423 wait complete. 2024-04-25T12:24:53.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.590+0000 7f19f6b4a640 1 Processor -- start 2024-04-25T12:24:53.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.590+0000 7f19f6b4a640 1 -- start start 2024-04-25T12:24:53.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19f6b4a640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f19d80039c0 0x7f19f01f2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:53.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19f6b4a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f19f014fde0 0x7f19f01505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:53.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19f6b4a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19f00cb6c0 0x7f19f014bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:53.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19f6b4a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f19f00c52f0 con 0x7f19f014fde0 2024-04-25T12:24:53.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19f6b4a640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f19f01585c0 con 0x7f19f00cb6c0 2024-04-25T12:24:53.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19f6b4a640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f19f0068610 con 0x7f19d80039c0 2024-04-25T12:24:53.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19effff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f19f014fde0 0x7f19f01505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:53.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19effff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f19f014fde0 0x7f19f01505c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35838/0 (socket says 172.21.15.94:35838) 2024-04-25T12:24:53.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19effff640 1 -- 172.21.15.94:0/2966510098 learned_addr learned my addr 172.21.15.94:0/2966510098 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:53.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19f48e6640 1 --2- 172.21.15.94:0/2966510098 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f19d80039c0 0x7f19f01f2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:53.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19f50e7640 1 --2- 172.21.15.94:0/2966510098 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19f00cb6c0 0x7f19f014bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:53.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19effff640 1 -- 172.21.15.94:0/2966510098 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f19d80039c0 msgr2=0x7f19f01f2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:53.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19effff640 1 --2- 172.21.15.94:0/2966510098 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f19d80039c0 0x7f19f01f2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:53.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19effff640 1 -- 172.21.15.94:0/2966510098 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19f00cb6c0 msgr2=0x7f19f014bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:53.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19effff640 1 --2- 172.21.15.94:0/2966510098 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19f00cb6c0 0x7f19f014bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:53.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19effff640 1 -- 172.21.15.94:0/2966510098 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f01e5f50 con 0x7f19f014fde0 2024-04-25T12:24:53.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19effff640 1 --2- 172.21.15.94:0/2966510098 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f19f014fde0 0x7f19f01505c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f19e40010f0 tx=0x7f19e400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:53.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19ed7fa640 1 -- 172.21.15.94:0/2966510098 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e4019070 con 0x7f19f014fde0 2024-04-25T12:24:53.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19ed7fa640 1 -- 172.21.15.94:0/2966510098 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19e400de50 con 0x7f19f014fde0 2024-04-25T12:24:53.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19ed7fa640 1 -- 172.21.15.94:0/2966510098 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e40047f0 con 0x7f19f014fde0 2024-04-25T12:24:53.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19f6b4a640 1 -- 172.21.15.94:0/2966510098 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f01e6230 con 0x7f19f014fde0 2024-04-25T12:24:53.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19f6b4a640 1 -- 172.21.15.94:0/2966510098 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f01f1e30 con 0x7f19f014fde0 2024-04-25T12:24:53.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19f6b4a640 1 -- 172.21.15.94:0/2966510098 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19f0075df0 con 0x7f19f014fde0 2024-04-25T12:24:53.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19ed7fa640 1 -- 172.21.15.94:0/2966510098 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f19e4004990 con 0x7f19f014fde0 2024-04-25T12:24:53.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19ed7fa640 1 --2- 172.21.15.94:0/2966510098 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f19dc0683b0 0x7f19dc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:53.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19ed7fa640 1 -- 172.21.15.94:0/2966510098 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f19e40866f0 con 0x7f19f014fde0 2024-04-25T12:24:53.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19f48e6640 1 --2- 172.21.15.94:0/2966510098 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f19dc0683b0 0x7f19dc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:53.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.594+0000 7f19f48e6640 1 --2- 172.21.15.94:0/2966510098 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f19dc0683b0 0x7f19dc06a870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f19e00ae000 tx=0x7f19e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:53.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.598+0000 7f19ed7fa640 1 -- 172.21.15.94:0/2966510098 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f19e40568c0 con 0x7f19f014fde0 2024-04-25T12:24:53.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.762+0000 7f19f6b4a640 1 -- 172.21.15.94:0/2966510098 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f19f006f840 con 0x7f19f014fde0 2024-04-25T12:24:53.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.766+0000 7f19ed7fa640 1 -- 172.21.15.94:0/2966510098 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18873 (secure 0 0 0) 0x7f19e40561c0 con 0x7f19f014fde0 2024-04-25T12:24:53.770 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:53.771 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"7059a9e2-aec4-4b84-b942-caf531e15da3","created":"2024-04-25T12:21:29.118508+0000","modified":"2024-04-25T12:22:34.871807+0000","last_up_change":"2024-04-25T12:21:40.912605+0000","last_in_change":"2024-04-25T12:21:31.372905+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:39.781011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:51.465886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:52.470540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:56.209936+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"640a65ef-0734-468a-a8f5-9ed70cf75c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6809","nonce":2553247564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6811","nonce":2553247564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6815","nonce":2553247564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6813","nonce":2553247564}]},"public_addr":"172.21.15.94:6809/2553247564","cluster_addr":"172.21.15.94:6811/2553247564","heartbeat_back_addr":"172.21.15.94:6815/2553247564","heartbeat_front_addr":"172.21.15.94:6813/2553247564","state":["exists","up"]},{"osd":1,"uuid":"d6e886e6-c8c1-4761-9a4c-abc6961c7c81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6818","nonce":2492806478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6822","nonce":2492806478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6830","nonce":2492806478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6826","nonce":2492806478}]},"public_addr":"172.21.15.94:6818/2492806478","cluster_addr":"172.21.15.94:6822/2492806478","heartbeat_back_addr":"172.21.15.94:6830/2492806478","heartbeat_front_addr":"172.21.15.94:6826/2492806478","state":["exists","up"]},{"osd":2,"uuid":"ba20f409-ed46-43b6-b16d-43dc4622c042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6801","nonce":1485061290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6803","nonce":1485061290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6807","nonce":1485061290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6805","nonce":1485061290}]},"public_addr":"172.21.15.94:6801/1485061290","cluster_addr":"172.21.15.94:6803/1485061290","heartbeat_back_addr":"172.21.15.94:6807/1485061290","heartbeat_front_addr":"172.21.15.94:6805/1485061290","state":["exists","up"]},{"osd":3,"uuid":"85816a2b-3a3f-4ec8-8373-8230d948396f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6819","nonce":1548488434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6823","nonce":1548488434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6829","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6831","nonce":1548488434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6827","nonce":1548488434}]},"public_addr":"172.21.15.94:6819/1548488434","cluster_addr":"172.21.15.94:6823/1548488434","heartbeat_back_addr":"172.21.15.94:6831/1548488434","heartbeat_front_addr":"172.21.15.94:6827/1548488434","state":["exists","up"]},{"osd":4,"uuid":"b4a953b7-01d6-4623-9324-63135fdaf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6811","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6814","nonce":4070977083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6817","nonce":4070977083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6823","nonce":4070977083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6819","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6821","nonce":4070977083}]},"public_addr":"172.21.15.111:6814/4070977083","cluster_addr":"172.21.15.111:6817/4070977083","heartbeat_back_addr":"172.21.15.111:6823/4070977083","heartbeat_front_addr":"172.21.15.111:6821/4070977083","state":["exists","up"]},{"osd":5,"uuid":"c0acc514-427d-41bf-a965-b8463cebf045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6803","nonce":1054925605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6809","nonce":1054925605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6820","nonce":1054925605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6815","nonce":1054925605}]},"public_addr":"172.21.15.111:6803/1054925605","cluster_addr":"172.21.15.111:6809/1054925605","heartbeat_back_addr":"172.21.15.111:6820/1054925605","heartbeat_front_addr":"172.21.15.111:6815/1054925605","state":["exists","up"]},{"osd":6,"uuid":"26ff742f-5a57-44a7-a095-f04d6e87f885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6825","nonce":3619235078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6827","nonce":3619235078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6831","nonce":3619235078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6829","nonce":3619235078}]},"public_addr":"172.21.15.111:6825/3619235078","cluster_addr":"172.21.15.111:6827/3619235078","heartbeat_back_addr":"172.21.15.111:6831/3619235078","heartbeat_front_addr":"172.21.15.111:6829/3619235078","state":["exists","up"]},{"osd":7,"uuid":"9c214cba-693a-4b25-aad7-05a5b0006e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6801","nonce":558758517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6805","nonce":558758517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6813","nonce":558758517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6807","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6808","nonce":558758517}]},"public_addr":"172.21.15.111:6801/558758517","cluster_addr":"172.21.15.111:6805/558758517","heartbeat_back_addr":"172.21.15.111:6813/558758517","heartbeat_front_addr":"172.21.15.111:6808/558758517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.664958+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.853375+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.654455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:37.033852+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.968691+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.856013+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.913496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.848565+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:24:53.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.766+0000 7f19f6b4a640 1 -- 172.21.15.94:0/2966510098 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f19dc0683b0 msgr2=0x7f19dc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:53.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.766+0000 7f19f6b4a640 1 --2- 172.21.15.94:0/2966510098 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f19dc0683b0 0x7f19dc06a870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f19e00ae000 tx=0x7f19e0009040 comp rx=0 tx=0).stop 2024-04-25T12:24:53.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.766+0000 7f19f6b4a640 1 -- 172.21.15.94:0/2966510098 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f19f014fde0 msgr2=0x7f19f01505c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:53.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.766+0000 7f19f6b4a640 1 --2- 172.21.15.94:0/2966510098 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f19f014fde0 0x7f19f01505c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f19e40010f0 tx=0x7f19e400dc00 comp rx=0 tx=0).stop 2024-04-25T12:24:53.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.766+0000 7f19f6b4a640 1 -- 172.21.15.94:0/2966510098 shutdown_connections 2024-04-25T12:24:53.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.766+0000 7f19f6b4a640 1 --2- 172.21.15.94:0/2966510098 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f19dc0683b0 0x7f19dc06a870 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:53.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.766+0000 7f19f6b4a640 1 --2- 172.21.15.94:0/2966510098 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19f00cb6c0 0x7f19f014bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:53.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.766+0000 7f19f6b4a640 1 --2- 172.21.15.94:0/2966510098 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f19f014fde0 0x7f19f01505c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:53.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.766+0000 7f19f6b4a640 1 --2- 172.21.15.94:0/2966510098 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f19d80039c0 0x7f19f01f2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:53.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.766+0000 7f19f6b4a640 1 -- 172.21.15.94:0/2966510098 >> 172.21.15.94:0/2966510098 conn(0x7f19f006b9d0 msgr2=0x7f19f006bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:53.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.766+0000 7f19f6b4a640 1 -- 172.21.15.94:0/2966510098 shutdown_connections 2024-04-25T12:24:53.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.766+0000 7f19f6b4a640 1 -- 172.21.15.94:0/2966510098 wait complete. 2024-04-25T12:24:53.789 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T12:21:39.781011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T12:21:51.465886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T12:21:52.470540+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T12:21:56.209936+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T12:24:53.790 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T12:24:53.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.906+0000 7fc36f41b640 1 Processor -- start 2024-04-25T12:24:53.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.906+0000 7fc36f41b640 1 -- start start 2024-04-25T12:24:53.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.910+0000 7fc36f41b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc36806cfd0 0x7fc36806d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:53.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.910+0000 7fc36f41b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc368157da0 con 0x7fc368151f40 2024-04-25T12:24:53.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.910+0000 7fc36f41b640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3680c89e0 con 0x7fc368072ae0 2024-04-25T12:24:53.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.910+0000 7fc36f41b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc3680c8c80 con 0x7fc36806cfd0 2024-04-25T12:24:53.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.910+0000 7fc36d9b8640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc36806cfd0 0x7fc36806d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:53.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.910+0000 7fc36d1b7640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc368151f40 0x7fc3680c9630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58376/0 (socket says 172.21.15.94:58376) 2024-04-25T12:24:53.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.910+0000 7fc36d1b7640 1 -- 172.21.15.94:0/218819814 learned_addr learned my addr 172.21.15.94:0/218819814 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:53.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.910+0000 7fc35ffff640 1 -- 172.21.15.94:0/218819814 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2063829899 0 0) 0x7fc364001120 con 0x7fc368151f40 2024-04-25T12:24:53.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.910+0000 7fc35ffff640 1 -- 172.21.15.94:0/218819814 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc354003530 con 0x7fc368151f40 2024-04-25T12:24:53.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.910+0000 7fc36d9b8640 1 -- 172.21.15.94:0/218819814 >> v1:172.21.15.111:6789/0 conn(0x7fc368072ae0 legacy=0x7fc36815b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:53.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.910+0000 7fc36d9b8640 1 -- 172.21.15.94:0/218819814 >> v1:172.21.15.94:6789/0 conn(0x7fc368151f40 legacy=0x7fc3680c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:53.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.910+0000 7fc36d9b8640 1 -- 172.21.15.94:0/218819814 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc368158020 con 0x7fc36806cfd0 2024-04-25T12:24:53.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.910+0000 7fc36d9b8640 1 --2- 172.21.15.94:0/218819814 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc36806cfd0 0x7fc36806d420 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc360009d90 tx=0x7fc36001f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372ebda5de8f7fe3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:53.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.910+0000 7fc35ffff640 1 -- 172.21.15.94:0/218819814 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3600b4070 con 0x7fc36806cfd0 2024-04-25T12:24:53.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.910+0000 7fc35ffff640 1 -- 172.21.15.94:0/218819814 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3600af600 con 0x7fc36806cfd0 2024-04-25T12:24:53.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.910+0000 7fc35ffff640 1 -- 172.21.15.94:0/218819814 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3600af9d0 con 0x7fc36806cfd0 2024-04-25T12:24:53.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.910+0000 7fc36f41b640 1 -- 172.21.15.94:0/218819814 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc36806cfd0 msgr2=0x7fc36806d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:53.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.910+0000 7fc36f41b640 1 --2- 172.21.15.94:0/218819814 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc36806cfd0 0x7fc36806d420 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc360009d90 tx=0x7fc36001f150 comp rx=0 tx=0).stop 2024-04-25T12:24:53.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc36f41b640 1 -- 172.21.15.94:0/218819814 shutdown_connections 2024-04-25T12:24:53.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc36f41b640 1 --2- 172.21.15.94:0/218819814 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc36806cfd0 0x7fc36806d420 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:53.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc36f41b640 1 -- 172.21.15.94:0/218819814 >> 172.21.15.94:0/218819814 conn(0x7fc3680ca540 msgr2=0x7fc3680ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:53.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc36f41b640 1 -- 172.21.15.94:0/218819814 shutdown_connections 2024-04-25T12:24:53.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc36f41b640 1 -- 172.21.15.94:0/218819814 wait complete. 2024-04-25T12:24:53.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc36f41b640 1 Processor -- start 2024-04-25T12:24:53.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc36f41b640 1 -- start start 2024-04-25T12:24:53.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc36f41b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc36806cfd0 0x7fc3681edc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:53.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc36f41b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc368072ae0 0x7fc368145ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:53.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc36f41b640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc368151f40 0x7fc368141f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:53.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc36f41b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc3680c9170 con 0x7fc36806cfd0 2024-04-25T12:24:53.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc36f41b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc3681585e0 con 0x7fc368072ae0 2024-04-25T12:24:53.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc36f41b640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fc368152320 con 0x7fc368151f40 2024-04-25T12:24:53.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc36d1b7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc36806cfd0 0x7fc3681edc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:53.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc36d1b7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc36806cfd0 0x7fc3681edc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35842/0 (socket says 172.21.15.94:35842) 2024-04-25T12:24:53.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc36d1b7640 1 -- 172.21.15.94:0/215301475 learned_addr learned my addr 172.21.15.94:0/215301475 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:53.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc36d1b7640 1 -- 172.21.15.94:0/215301475 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc368151f40 msgr2=0x7fc368141f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:53.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc36d1b7640 1 --2- 172.21.15.94:0/215301475 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc368151f40 0x7fc368141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:53.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc36d1b7640 1 -- 172.21.15.94:0/215301475 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc368072ae0 msgr2=0x7fc368145ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:53.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc36c9b6640 1 --2- 172.21.15.94:0/215301475 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc368072ae0 0x7fc368145ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:53.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc36d1b7640 1 --2- 172.21.15.94:0/215301475 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc368072ae0 0x7fc368145ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:53.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc36d1b7640 1 -- 172.21.15.94:0/215301475 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3681f1570 con 0x7fc36806cfd0 2024-04-25T12:24:53.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc36d1b7640 1 --2- 172.21.15.94:0/215301475 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc36806cfd0 0x7fc3681edc60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc36400c730 tx=0x7fc36400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:53.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc35dffb640 1 -- 172.21.15.94:0/215301475 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc364017070 con 0x7fc36806cfd0 2024-04-25T12:24:53.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc35dffb640 1 -- 172.21.15.94:0/215301475 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc364005ac0 con 0x7fc36806cfd0 2024-04-25T12:24:53.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc36f41b640 1 -- 172.21.15.94:0/215301475 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3681f1850 con 0x7fc36806cfd0 2024-04-25T12:24:53.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc35dffb640 1 -- 172.21.15.94:0/215301475 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc364007070 con 0x7fc36806cfd0 2024-04-25T12:24:53.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc36f41b640 1 -- 172.21.15.94:0/215301475 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3681f1e10 con 0x7fc36806cfd0 2024-04-25T12:24:53.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.914+0000 7fc36f41b640 1 -- 172.21.15.94:0/215301475 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc368075df0 con 0x7fc36806cfd0 2024-04-25T12:24:53.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.918+0000 7fc35dffb640 1 -- 172.21.15.94:0/215301475 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc36401a070 con 0x7fc36806cfd0 2024-04-25T12:24:53.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.918+0000 7fc35dffb640 1 --2- 172.21.15.94:0/215301475 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc34c0683b0 0x7fc34c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:53.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.918+0000 7fc35dffb640 1 -- 172.21.15.94:0/215301475 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fc364086120 con 0x7fc36806cfd0 2024-04-25T12:24:53.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.918+0000 7fc36c9b6640 1 --2- 172.21.15.94:0/215301475 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc34c0683b0 0x7fc34c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:53.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.918+0000 7fc36c9b6640 1 --2- 172.21.15.94:0/215301475 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc34c0683b0 0x7fc34c06a870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc368142ce0 tx=0x7fc358009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:53.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:53.922+0000 7fc35dffb640 1 -- 172.21.15.94:0/215301475 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc368157da0 con 0x7fc36806cfd0 2024-04-25T12:24:54.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.082+0000 7fc36f41b640 1 -- 172.21.15.94:0/215301475 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc368151770 con 0x7fc36806cfd0 2024-04-25T12:24:54.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.086+0000 7fc35dffb640 1 -- 172.21.15.94:0/215301475 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7fc3640562e0 con 0x7fc36806cfd0 2024-04-25T12:24:54.090 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2024-04-25T12:24:54.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.086+0000 7fc36f41b640 1 -- 172.21.15.94:0/215301475 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc34c0683b0 msgr2=0x7fc34c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:54.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.086+0000 7fc36f41b640 1 --2- 172.21.15.94:0/215301475 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc34c0683b0 0x7fc34c06a870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc368142ce0 tx=0x7fc358009040 comp rx=0 tx=0).stop 2024-04-25T12:24:54.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.086+0000 7fc36f41b640 1 -- 172.21.15.94:0/215301475 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc36806cfd0 msgr2=0x7fc3681edc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:54.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.086+0000 7fc36f41b640 1 --2- 172.21.15.94:0/215301475 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc36806cfd0 0x7fc3681edc60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc36400c730 tx=0x7fc36400cbf0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.086+0000 7fc36f41b640 1 -- 172.21.15.94:0/215301475 shutdown_connections 2024-04-25T12:24:54.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.086+0000 7fc36f41b640 1 --2- 172.21.15.94:0/215301475 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc34c0683b0 0x7fc34c06a870 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.086+0000 7fc36f41b640 1 --2- 172.21.15.94:0/215301475 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc368151f40 0x7fc368141f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.086+0000 7fc36f41b640 1 --2- 172.21.15.94:0/215301475 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc368072ae0 0x7fc368145ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.086+0000 7fc36f41b640 1 --2- 172.21.15.94:0/215301475 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc36806cfd0 0x7fc3681edc60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.086+0000 7fc36f41b640 1 -- 172.21.15.94:0/215301475 >> 172.21.15.94:0/215301475 conn(0x7fc3680ca540 msgr2=0x7fc368145110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:54.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.086+0000 7fc36f41b640 1 -- 172.21.15.94:0/215301475 shutdown_connections 2024-04-25T12:24:54.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.086+0000 7fc36f41b640 1 -- 172.21.15.94:0/215301475 wait complete. 2024-04-25T12:24:54.109 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T12:24:54.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.226+0000 7f0fdef25640 1 Processor -- start 2024-04-25T12:24:54.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.226+0000 7f0fdef25640 1 -- start start 2024-04-25T12:24:54.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.226+0000 7f0fdef25640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0fd8155350 0x7f0fd80c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:54.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.226+0000 7f0fdef25640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0fd815b0b0 0x7f0fd815b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:54.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.226+0000 7f0fdef25640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fd815beb0 con 0x7f0fd80cda50 2024-04-25T12:24:54.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.226+0000 7f0fdef25640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f0fd80cca40 con 0x7f0fd8155350 2024-04-25T12:24:54.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.226+0000 7f0fdef25640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f0fd80ccc90 con 0x7f0fd815b0b0 2024-04-25T12:24:54.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.226+0000 7f0fdccc1640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0fd8155350 0x7f0fd80c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:54.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.226+0000 7f0fd7fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f0fd80cda50 0x7f0fd80cb7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58380/0 (socket says 172.21.15.94:58380) 2024-04-25T12:24:54.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.226+0000 7f0fd7fff640 1 -- 172.21.15.94:0/3250181650 learned_addr learned my addr 172.21.15.94:0/3250181650 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:54.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.226+0000 7f0fd77fe640 1 -- 172.21.15.94:0/3250181650 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2730027121 0 0) 0x7f0fd815beb0 con 0x7f0fd80cda50 2024-04-25T12:24:54.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.226+0000 7f0fdd4c2640 1 --2- 172.21.15.94:0/3250181650 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0fd815b0b0 0x7f0fd815b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:54.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.226+0000 7f0fd77fe640 1 -- 172.21.15.94:0/3250181650 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fc0003530 con 0x7f0fd80cda50 2024-04-25T12:24:54.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.226+0000 7f0fdccc1640 1 -- 172.21.15.94:0/3250181650 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0fd815b0b0 msgr2=0x7f0fd815b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:54.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.226+0000 7f0fdccc1640 1 --2- 172.21.15.94:0/3250181650 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0fd815b0b0 0x7f0fd815b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.226+0000 7f0fdccc1640 1 -- 172.21.15.94:0/3250181650 >> v1:172.21.15.94:6789/0 conn(0x7f0fd80cda50 legacy=0x7f0fd80cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:54.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.226+0000 7f0fdccc1640 1 -- 172.21.15.94:0/3250181650 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fd80ccf70 con 0x7f0fd8155350 2024-04-25T12:24:54.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.226+0000 7f0fdd4c2640 1 --2- 172.21.15.94:0/3250181650 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0fd815b0b0 0x7f0fd815b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:54.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.230+0000 7f0fdccc1640 1 --2- 172.21.15.94:0/3250181650 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0fd8155350 0x7f0fd80c59c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0fc80097c0 tx=0x7f0fc801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed161dc7d9a5b924 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:54.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.230+0000 7f0fd77fe640 1 -- 172.21.15.94:0/3250181650 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc80b5070 con 0x7f0fd8155350 2024-04-25T12:24:54.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.230+0000 7f0fd77fe640 1 -- 172.21.15.94:0/3250181650 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fc80a8990 con 0x7f0fd8155350 2024-04-25T12:24:54.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.230+0000 7f0fd77fe640 1 -- 172.21.15.94:0/3250181650 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc80a8d60 con 0x7f0fd8155350 2024-04-25T12:24:54.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.230+0000 7f0fdef25640 1 -- 172.21.15.94:0/3250181650 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0fd8155350 msgr2=0x7f0fd80c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:54.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.230+0000 7f0fdef25640 1 --2- 172.21.15.94:0/3250181650 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0fd8155350 0x7f0fd80c59c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0fc80097c0 tx=0x7f0fc801ec90 comp rx=0 tx=0).stop 2024-04-25T12:24:54.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.230+0000 7f0fdef25640 1 -- 172.21.15.94:0/3250181650 shutdown_connections 2024-04-25T12:24:54.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.230+0000 7f0fdef25640 1 --2- 172.21.15.94:0/3250181650 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0fd815b0b0 0x7f0fd815b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.230+0000 7f0fdef25640 1 --2- 172.21.15.94:0/3250181650 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0fd8155350 0x7f0fd80c59c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.230+0000 7f0fdef25640 1 -- 172.21.15.94:0/3250181650 >> 172.21.15.94:0/3250181650 conn(0x7f0fd806cc30 msgr2=0x7f0fd806d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:54.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.230+0000 7f0fdef25640 1 -- 172.21.15.94:0/3250181650 shutdown_connections 2024-04-25T12:24:54.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.230+0000 7f0fdef25640 1 -- 172.21.15.94:0/3250181650 wait complete. 2024-04-25T12:24:54.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.230+0000 7f0fdef25640 1 Processor -- start 2024-04-25T12:24:54.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.230+0000 7f0fdef25640 1 -- start start 2024-04-25T12:24:54.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.230+0000 7f0fdef25640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0fd80cda50 0x7f0fd80b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:54.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.230+0000 7f0fdef25640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0fd8155350 0x7f0fd8153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:54.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.230+0000 7f0fdef25640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0fd815b0b0 0x7f0fd8143080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:54.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.230+0000 7f0fdef25640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd8155730 con 0x7f0fd80cda50 2024-04-25T12:24:54.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.230+0000 7f0fdef25640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd80cd530 con 0x7f0fd8155350 2024-04-25T12:24:54.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.230+0000 7f0fdef25640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f0fd815e860 con 0x7f0fd815b0b0 2024-04-25T12:24:54.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.230+0000 7f0fdccc1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0fd80cda50 0x7f0fd80b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:54.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.230+0000 7f0fdccc1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0fd80cda50 0x7f0fd80b4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35860/0 (socket says 172.21.15.94:35860) 2024-04-25T12:24:54.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.230+0000 7f0fdccc1640 1 -- 172.21.15.94:0/1757099956 learned_addr learned my addr 172.21.15.94:0/1757099956 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:54.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.234+0000 7f0fdccc1640 1 -- 172.21.15.94:0/1757099956 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0fd815b0b0 msgr2=0x7f0fd8143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:54.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.234+0000 7f0fdccc1640 1 --2- 172.21.15.94:0/1757099956 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0fd815b0b0 0x7f0fd8143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.234+0000 7f0fdccc1640 1 -- 172.21.15.94:0/1757099956 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0fd8155350 msgr2=0x7f0fd8153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:54.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.234+0000 7f0fdccc1640 1 --2- 172.21.15.94:0/1757099956 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0fd8155350 0x7f0fd8153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.234+0000 7f0fdccc1640 1 -- 172.21.15.94:0/1757099956 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fd81526e0 con 0x7f0fd80cda50 2024-04-25T12:24:54.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.234+0000 7f0fdccc1640 1 --2- 172.21.15.94:0/1757099956 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0fd80cda50 0x7f0fd80b4a70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0fc80b3040 tx=0x7f0fc801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:54.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.234+0000 7f0fd57fa640 1 -- 172.21.15.94:0/1757099956 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc80bf070 con 0x7f0fd80cda50 2024-04-25T12:24:54.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.234+0000 7f0fd57fa640 1 -- 172.21.15.94:0/1757099956 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fc80b07a0 con 0x7f0fd80cda50 2024-04-25T12:24:54.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.234+0000 7f0fdef25640 1 -- 172.21.15.94:0/1757099956 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fd81529c0 con 0x7f0fd80cda50 2024-04-25T12:24:54.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.234+0000 7f0fd57fa640 1 -- 172.21.15.94:0/1757099956 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc80b5040 con 0x7f0fd80cda50 2024-04-25T12:24:54.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.234+0000 7f0fdef25640 1 -- 172.21.15.94:0/1757099956 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fd8152f80 con 0x7f0fd80cda50 2024-04-25T12:24:54.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.234+0000 7f0fdef25640 1 -- 172.21.15.94:0/1757099956 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fd8075df0 con 0x7f0fd80cda50 2024-04-25T12:24:54.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.234+0000 7f0fd57fa640 1 -- 172.21.15.94:0/1757099956 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0fc80c2070 con 0x7f0fd80cda50 2024-04-25T12:24:54.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.234+0000 7f0fd57fa640 1 --2- 172.21.15.94:0/1757099956 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0fc4068380 0x7f0fc406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:54.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.234+0000 7f0fd57fa640 1 -- 172.21.15.94:0/1757099956 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f0fc81234a0 con 0x7f0fd80cda50 2024-04-25T12:24:54.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.234+0000 7f0fd7fff640 1 --2- 172.21.15.94:0/1757099956 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0fc4068380 0x7f0fc406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:54.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.234+0000 7f0fd7fff640 1 --2- 172.21.15.94:0/1757099956 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0fc4068380 0x7f0fc406a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc007fd0 tx=0x7f0fcc007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:54.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.238+0000 7f0fd57fa640 1 -- 172.21.15.94:0/1757099956 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0fc80187f0 con 0x7f0fd80cda50 2024-04-25T12:24:54.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.394+0000 7f0fdef25640 1 -- 172.21.15.94:0/1757099956 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0fd80cc610 con 0x7f0fd80cda50 2024-04-25T12:24:54.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.398+0000 7f0fd57fa640 1 -- 172.21.15.94:0/1757099956 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7f0fc80f3700 con 0x7f0fd80cda50 2024-04-25T12:24:54.402 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2024-04-25T12:24:54.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.398+0000 7f0fdef25640 1 -- 172.21.15.94:0/1757099956 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0fc4068380 msgr2=0x7f0fc406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:54.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.398+0000 7f0fdef25640 1 --2- 172.21.15.94:0/1757099956 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0fc4068380 0x7f0fc406a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc007fd0 tx=0x7f0fcc007900 comp rx=0 tx=0).stop 2024-04-25T12:24:54.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.398+0000 7f0fdef25640 1 -- 172.21.15.94:0/1757099956 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0fd80cda50 msgr2=0x7f0fd80b4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:54.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.398+0000 7f0fdef25640 1 --2- 172.21.15.94:0/1757099956 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0fd80cda50 0x7f0fd80b4a70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0fc80b3040 tx=0x7f0fc801ba30 comp rx=0 tx=0).stop 2024-04-25T12:24:54.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.398+0000 7f0fdef25640 1 -- 172.21.15.94:0/1757099956 shutdown_connections 2024-04-25T12:24:54.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.398+0000 7f0fdef25640 1 --2- 172.21.15.94:0/1757099956 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0fc4068380 0x7f0fc406a840 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.398+0000 7f0fdef25640 1 --2- 172.21.15.94:0/1757099956 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0fd815b0b0 0x7f0fd8143080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.398+0000 7f0fdef25640 1 --2- 172.21.15.94:0/1757099956 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0fd8155350 0x7f0fd8153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.398+0000 7f0fdef25640 1 --2- 172.21.15.94:0/1757099956 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0fd80cda50 0x7f0fd80b4a70 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.398+0000 7f0fdef25640 1 -- 172.21.15.94:0/1757099956 >> 172.21.15.94:0/1757099956 conn(0x7f0fd806cc30 msgr2=0x7f0fd80cb540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:54.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.398+0000 7f0fdef25640 1 -- 172.21.15.94:0/1757099956 shutdown_connections 2024-04-25T12:24:54.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.398+0000 7f0fdef25640 1 -- 172.21.15.94:0/1757099956 wait complete. 2024-04-25T12:24:54.419 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T12:24:54.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.526+0000 7f5626557640 1 Processor -- start 2024-04-25T12:24:54.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.526+0000 7f5626557640 1 -- start start 2024-04-25T12:24:54.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f5626557640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f562014ffa0 0x7f562006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:54.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f5626557640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56200c5d70 con 0x7f5620074100 2024-04-25T12:24:54.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f5626557640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56200c6050 con 0x7f562014fbc0 2024-04-25T12:24:54.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f5626557640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f56200c6330 con 0x7f562014ffa0 2024-04-25T12:24:54.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f5624af4640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f5620074100 0x7f56200c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58388/0 (socket says 172.21.15.94:58388) 2024-04-25T12:24:54.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f5624af4640 1 -- 172.21.15.94:0/3332918165 learned_addr learned my addr 172.21.15.94:0/3332918165 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:54.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f561f7fe640 1 --2- 172.21.15.94:0/3332918165 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f562014ffa0 0x7f562006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:54.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f561effd640 1 -- 172.21.15.94:0/3332918165 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2132705942 0 0) 0x7f56200c5d70 con 0x7f5620074100 2024-04-25T12:24:54.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f561effd640 1 -- 172.21.15.94:0/3332918165 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5608003530 con 0x7f5620074100 2024-04-25T12:24:54.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f561effd640 1 -- 172.21.15.94:0/3332918165 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3219801132 0 0) 0x7f5608003530 con 0x7f5620074100 2024-04-25T12:24:54.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f561effd640 1 -- 172.21.15.94:0/3332918165 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f562014ffa0 msgr2=0x7f562006f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:54.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f561effd640 1 --2- 172.21.15.94:0/3332918165 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f562014ffa0 0x7f562006f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f561effd640 1 -- 172.21.15.94:0/3332918165 >> v1:172.21.15.111:6789/0 conn(0x7f562014fbc0 legacy=0x7f56200c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:54.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f561effd640 1 -- 172.21.15.94:0/3332918165 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56200c6610 con 0x7f5620074100 2024-04-25T12:24:54.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f561effd640 1 -- 172.21.15.94:0/3332918165 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7f5618001a00 con 0x7f5620074100 2024-04-25T12:24:54.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f561effd640 1 -- 172.21.15.94:0/3332918165 >> v1:172.21.15.94:6789/0 conn(0x7f5620074100 legacy=0x7f56200c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:54.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f561effd640 1 --2- 172.21.15.94:0/3332918165 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f562014ffa0 0x7f56080039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:54.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f561effd640 1 --2- 172.21.15.94:0/3332918165 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5608003f70 0x7f5608004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:54.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f561effd640 1 --2- 172.21.15.94:0/3332918165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5608004d50 0x7f56080051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:54.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f561effd640 1 -- 172.21.15.94:0/3332918165 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f56200c6330 con 0x7f5608004d50 2024-04-25T12:24:54.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f561effd640 1 -- 172.21.15.94:0/3332918165 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f560800bab0 con 0x7f5608003f70 2024-04-25T12:24:54.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f561effd640 1 -- 172.21.15.94:0/3332918165 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f560800bcb0 con 0x7f562014ffa0 2024-04-25T12:24:54.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f5624af4640 1 --2- 172.21.15.94:0/3332918165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5608004d50 0x7f56080051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:54.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f561f7fe640 1 --2- 172.21.15.94:0/3332918165 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5608003f70 0x7f5608004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:54.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f561ffff640 1 --2- 172.21.15.94:0/3332918165 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f562014ffa0 0x7f56080039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:54.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f5624af4640 1 -- 172.21.15.94:0/3332918165 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f562014ffa0 msgr2=0x7f56080039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:54.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f5624af4640 1 --2- 172.21.15.94:0/3332918165 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f562014ffa0 0x7f56080039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f5624af4640 1 -- 172.21.15.94:0/3332918165 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5608003f70 msgr2=0x7f5608004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:54.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f5624af4640 1 --2- 172.21.15.94:0/3332918165 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5608003f70 0x7f5608004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f5624af4640 1 -- 172.21.15.94:0/3332918165 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5608003530 con 0x7f5608004d50 2024-04-25T12:24:54.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f561ffff640 1 --2- 172.21.15.94:0/3332918165 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f562014ffa0 0x7f56080039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:54.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f5624af4640 1 --2- 172.21.15.94:0/3332918165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5608004d50 0x7f56080051d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f561800a810 tx=0x7f561801d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97038c1a77bb7c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:54.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.530+0000 7f561effd640 1 -- 172.21.15.94:0/3332918165 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561800a460 con 0x7f5608004d50 2024-04-25T12:24:54.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f561effd640 1 -- 172.21.15.94:0/3332918165 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56180ad650 con 0x7f5608004d50 2024-04-25T12:24:54.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f561effd640 1 -- 172.21.15.94:0/3332918165 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56180ada40 con 0x7f5608004d50 2024-04-25T12:24:54.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f5626557640 1 -- 172.21.15.94:0/3332918165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5608004d50 msgr2=0x7f56080051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:54.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f5626557640 1 --2- 172.21.15.94:0/3332918165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5608004d50 0x7f56080051d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f561800a810 tx=0x7f561801d340 comp rx=0 tx=0).stop 2024-04-25T12:24:54.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f5624af4640 1 -- 172.21.15.94:0/3332918165 reap_dead start 2024-04-25T12:24:54.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f5626557640 1 -- 172.21.15.94:0/3332918165 shutdown_connections 2024-04-25T12:24:54.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f5626557640 1 -- 172.21.15.94:0/3332918165 >> 172.21.15.94:0/3332918165 conn(0x7f562006b9d0 msgr2=0x7f562006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:54.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f5626557640 1 -- 172.21.15.94:0/3332918165 shutdown_connections 2024-04-25T12:24:54.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f5626557640 1 -- 172.21.15.94:0/3332918165 wait complete. 2024-04-25T12:24:54.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f5626557640 1 Processor -- start 2024-04-25T12:24:54.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f5626557640 1 -- start start 2024-04-25T12:24:54.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f5626557640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5620143680 0x7f56201f4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:54.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f5626557640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5620143a60 0x7f5620157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:54.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f5626557640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56200c3250 0x7f5620158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:54.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f5626557640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5620068350 con 0x7f56200c3250 2024-04-25T12:24:54.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f5626557640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f56200681d0 con 0x7f5620143a60 2024-04-25T12:24:54.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f5626557640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f56200c8930 con 0x7f5620143680 2024-04-25T12:24:54.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f5624af4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56200c3250 0x7f5620158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:54.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f5624af4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56200c3250 0x7f5620158210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35878/0 (socket says 172.21.15.94:35878) 2024-04-25T12:24:54.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f5624af4640 1 -- 172.21.15.94:0/817916364 learned_addr learned my addr 172.21.15.94:0/817916364 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:54.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f561ffff640 1 --2- 172.21.15.94:0/817916364 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5620143680 0x7f56201f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:54.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f561f7fe640 1 --2- 172.21.15.94:0/817916364 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5620143a60 0x7f5620157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:54.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f5624af4640 1 -- 172.21.15.94:0/817916364 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5620143680 msgr2=0x7f56201f4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:54.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f5624af4640 1 --2- 172.21.15.94:0/817916364 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5620143680 0x7f56201f4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f5624af4640 1 -- 172.21.15.94:0/817916364 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5620143a60 msgr2=0x7f5620157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:54.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f5624af4640 1 --2- 172.21.15.94:0/817916364 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5620143a60 0x7f5620157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f5624af4640 1 -- 172.21.15.94:0/817916364 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5620159450 con 0x7f56200c3250 2024-04-25T12:24:54.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f5624af4640 1 --2- 172.21.15.94:0/817916364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56200c3250 0x7f5620158210 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f561800a810 tx=0x7f5608005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:54.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f561cff9640 1 -- 172.21.15.94:0/817916364 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56180ba070 con 0x7f56200c3250 2024-04-25T12:24:54.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f561cff9640 1 -- 172.21.15.94:0/817916364 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5618001800 con 0x7f56200c3250 2024-04-25T12:24:54.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f5626557640 1 -- 172.21.15.94:0/817916364 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5620159710 con 0x7f56200c3250 2024-04-25T12:24:54.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f561cff9640 1 -- 172.21.15.94:0/817916364 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5618001210 con 0x7f56200c3250 2024-04-25T12:24:54.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.534+0000 7f5626557640 1 -- 172.21.15.94:0/817916364 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56201f44c0 con 0x7f56200c3250 2024-04-25T12:24:54.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.538+0000 7f5626557640 1 -- 172.21.15.94:0/817916364 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5620075df0 con 0x7f56200c3250 2024-04-25T12:24:54.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.538+0000 7f561cff9640 1 -- 172.21.15.94:0/817916364 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f56180bd070 con 0x7f56200c3250 2024-04-25T12:24:54.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.538+0000 7f561cff9640 1 --2- 172.21.15.94:0/817916364 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f560c068380 0x7f560c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:54.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.538+0000 7f561ffff640 1 --2- 172.21.15.94:0/817916364 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f560c068380 0x7f560c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:54.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.538+0000 7f561cff9640 1 -- 172.21.15.94:0/817916364 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f56181207f0 con 0x7f56200c3250 2024-04-25T12:24:54.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.538+0000 7f561ffff640 1 --2- 172.21.15.94:0/817916364 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f560c068380 0x7f560c06a840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5610001760 tx=0x7f5610009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:54.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.542+0000 7f561cff9640 1 -- 172.21.15.94:0/817916364 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5618017050 con 0x7f56200c3250 2024-04-25T12:24:54.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.702+0000 7f5626557640 1 -- 172.21.15.94:0/817916364 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f56200c7df0 con 0x7f56200c3250 2024-04-25T12:24:54.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.702+0000 7f561cff9640 1 -- 172.21.15.94:0/817916364 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7f56180f0370 con 0x7f56200c3250 2024-04-25T12:24:54.708 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2024-04-25T12:24:54.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.706+0000 7f5626557640 1 -- 172.21.15.94:0/817916364 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f560c068380 msgr2=0x7f560c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:54.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.706+0000 7f5626557640 1 --2- 172.21.15.94:0/817916364 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f560c068380 0x7f560c06a840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5610001760 tx=0x7f5610009040 comp rx=0 tx=0).stop 2024-04-25T12:24:54.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.706+0000 7f5626557640 1 -- 172.21.15.94:0/817916364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56200c3250 msgr2=0x7f5620158210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:54.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.706+0000 7f5626557640 1 --2- 172.21.15.94:0/817916364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56200c3250 0x7f5620158210 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f561800a810 tx=0x7f5608005840 comp rx=0 tx=0).stop 2024-04-25T12:24:54.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.706+0000 7f5626557640 1 -- 172.21.15.94:0/817916364 shutdown_connections 2024-04-25T12:24:54.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.706+0000 7f5626557640 1 --2- 172.21.15.94:0/817916364 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f560c068380 0x7f560c06a840 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.706+0000 7f5626557640 1 --2- 172.21.15.94:0/817916364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56200c3250 0x7f5620158210 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.706+0000 7f5626557640 1 --2- 172.21.15.94:0/817916364 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5620143a60 0x7f5620157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.706+0000 7f5626557640 1 --2- 172.21.15.94:0/817916364 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5620143680 0x7f56201f4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.706+0000 7f5626557640 1 -- 172.21.15.94:0/817916364 >> 172.21.15.94:0/817916364 conn(0x7f562006b9d0 msgr2=0x7f56200ca3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:54.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.706+0000 7f5626557640 1 -- 172.21.15.94:0/817916364 shutdown_connections 2024-04-25T12:24:54.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.706+0000 7f5626557640 1 -- 172.21.15.94:0/817916364 wait complete. 2024-04-25T12:24:54.727 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T12:24:54.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.834+0000 7f28e0141640 1 Processor -- start 2024-04-25T12:24:54.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.834+0000 7f28e0141640 1 -- start start 2024-04-25T12:24:54.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.834+0000 7f28e0141640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f28d8155350 0x7f28d80c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:54.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.834+0000 7f28e0141640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f28d815b0b0 0x7f28d815b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:54.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.834+0000 7f28e0141640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28d815beb0 con 0x7f28d80cda50 2024-04-25T12:24:54.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.834+0000 7f28e0141640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f28d80cca40 con 0x7f28d8155350 2024-04-25T12:24:54.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.834+0000 7f28e0141640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f28d80ccc90 con 0x7f28d815b0b0 2024-04-25T12:24:54.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.834+0000 7f28ddedd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f28d8155350 0x7f28d80c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:54.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.834+0000 7f28dd6dc640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f28d80cda50 0x7f28d80cb7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58404/0 (socket says 172.21.15.94:58404) 2024-04-25T12:24:54.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.834+0000 7f28dd6dc640 1 -- 172.21.15.94:0/1873539900 learned_addr learned my addr 172.21.15.94:0/1873539900 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:54.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.834+0000 7f28ddedd640 1 -- 172.21.15.94:0/1873539900 >> v2:172.21.15.111:3300/0 conn(0x7f28d815b0b0 msgr2=0x7f28d815b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:54.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.834+0000 7f28de6de640 1 --2- 172.21.15.94:0/1873539900 >> v2:172.21.15.111:3300/0 conn(0x7f28d815b0b0 0x7f28d815b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:54.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.834+0000 7f28dcedb640 1 -- 172.21.15.94:0/1873539900 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 73854021 0 0) 0x7f28d815beb0 con 0x7f28d80cda50 2024-04-25T12:24:54.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.834+0000 7f28ddedd640 1 --2- 172.21.15.94:0/1873539900 >> v2:172.21.15.111:3300/0 conn(0x7f28d815b0b0 0x7f28d815b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.834+0000 7f28ddedd640 1 -- 172.21.15.94:0/1873539900 >> v1:172.21.15.94:6789/0 conn(0x7f28d80cda50 legacy=0x7f28d80cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:54.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.834+0000 7f28ddedd640 1 -- 172.21.15.94:0/1873539900 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d80ccf70 con 0x7f28d8155350 2024-04-25T12:24:54.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.834+0000 7f28de6de640 1 --2- 172.21.15.94:0/1873539900 >> v2:172.21.15.111:3300/0 conn(0x7f28d815b0b0 0x7f28d815b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:54.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28ddedd640 1 --2- 172.21.15.94:0/1873539900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28d8155350 0x7f28d80c59c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f28d80b44e0 tx=0x7f28d401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bfcd050f5af0f5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:54.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28dcedb640 1 -- 172.21.15.94:0/1873539900 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d40b5070 con 0x7f28d8155350 2024-04-25T12:24:54.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28dcedb640 1 -- 172.21.15.94:0/1873539900 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d40a8970 con 0x7f28d8155350 2024-04-25T12:24:54.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28dcedb640 1 -- 172.21.15.94:0/1873539900 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d40a8d40 con 0x7f28d8155350 2024-04-25T12:24:54.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28e0141640 1 -- 172.21.15.94:0/1873539900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28d8155350 msgr2=0x7f28d80c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:54.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28e0141640 1 --2- 172.21.15.94:0/1873539900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28d8155350 0x7f28d80c59c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f28d80b44e0 tx=0x7f28d401ec70 comp rx=0 tx=0).stop 2024-04-25T12:24:54.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28e0141640 1 -- 172.21.15.94:0/1873539900 shutdown_connections 2024-04-25T12:24:54.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28e0141640 1 --2- 172.21.15.94:0/1873539900 >> v2:172.21.15.111:3300/0 conn(0x7f28d815b0b0 0x7f28d815b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28e0141640 1 --2- 172.21.15.94:0/1873539900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28d8155350 0x7f28d80c59c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28e0141640 1 -- 172.21.15.94:0/1873539900 >> 172.21.15.94:0/1873539900 conn(0x7f28d806cc30 msgr2=0x7f28d806d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:54.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28e0141640 1 -- 172.21.15.94:0/1873539900 shutdown_connections 2024-04-25T12:24:54.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28e0141640 1 -- 172.21.15.94:0/1873539900 wait complete. 2024-04-25T12:24:54.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28e0141640 1 Processor -- start 2024-04-25T12:24:54.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28e0141640 1 -- start start 2024-04-25T12:24:54.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28e0141640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f28d80cda50 0x7f28d81e5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:54.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28e0141640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f28d8155350 0x7f28d8153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:54.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28e0141640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28d815b0b0 0x7f28d81e6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:54.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28e0141640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f28d8155730 con 0x7f28d815b0b0 2024-04-25T12:24:54.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28e0141640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f28d80cd530 con 0x7f28d8155350 2024-04-25T12:24:54.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28e0141640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f28d815e860 con 0x7f28d80cda50 2024-04-25T12:24:54.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28de6de640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28d815b0b0 0x7f28d81e6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:54.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28de6de640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28d815b0b0 0x7f28d81e6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35900/0 (socket says 172.21.15.94:35900) 2024-04-25T12:24:54.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28de6de640 1 -- 172.21.15.94:0/3115291179 learned_addr learned my addr 172.21.15.94:0/3115291179 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:54.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28dd6dc640 1 --2- 172.21.15.94:0/3115291179 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f28d8155350 0x7f28d8153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:54.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28ddedd640 1 --2- 172.21.15.94:0/3115291179 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f28d80cda50 0x7f28d81e5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:54.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28de6de640 1 -- 172.21.15.94:0/3115291179 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f28d80cda50 msgr2=0x7f28d81e5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:54.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28de6de640 1 --2- 172.21.15.94:0/3115291179 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f28d80cda50 0x7f28d81e5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28de6de640 1 -- 172.21.15.94:0/3115291179 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f28d8155350 msgr2=0x7f28d8153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:54.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28de6de640 1 --2- 172.21.15.94:0/3115291179 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f28d8155350 0x7f28d8153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:54.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28de6de640 1 -- 172.21.15.94:0/3115291179 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d81e6440 con 0x7f28d815b0b0 2024-04-25T12:24:54.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28de6de640 1 --2- 172.21.15.94:0/3115291179 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28d815b0b0 0x7f28d81e6bd0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f28d000cca0 tx=0x7f28d000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:54.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28ce7fc640 1 -- 172.21.15.94:0/3115291179 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d000f680 con 0x7f28d815b0b0 2024-04-25T12:24:54.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28ce7fc640 1 -- 172.21.15.94:0/3115291179 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d000f840 con 0x7f28d815b0b0 2024-04-25T12:24:54.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28e0141640 1 -- 172.21.15.94:0/3115291179 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28d81e4450 con 0x7f28d815b0b0 2024-04-25T12:24:54.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28ce7fc640 1 -- 172.21.15.94:0/3115291179 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d000fc30 con 0x7f28d815b0b0 2024-04-25T12:24:54.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.838+0000 7f28e0141640 1 -- 172.21.15.94:0/3115291179 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28d81e4a10 con 0x7f28d815b0b0 2024-04-25T12:24:54.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.842+0000 7f28e0141640 1 -- 172.21.15.94:0/3115291179 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28d8075df0 con 0x7f28d815b0b0 2024-04-25T12:24:54.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.842+0000 7f28ce7fc640 1 -- 172.21.15.94:0/3115291179 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f28d00213f0 con 0x7f28d815b0b0 2024-04-25T12:24:54.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.842+0000 7f28ce7fc640 1 --2- 172.21.15.94:0/3115291179 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f28bc068380 0x7f28bc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:54.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.842+0000 7f28ce7fc640 1 -- 172.21.15.94:0/3115291179 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f28d0087b30 con 0x7f28d815b0b0 2024-04-25T12:24:54.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.842+0000 7f28ddedd640 1 --2- 172.21.15.94:0/3115291179 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f28bc068380 0x7f28bc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:54.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.842+0000 7f28ddedd640 1 --2- 172.21.15.94:0/3115291179 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f28bc068380 0x7f28bc06a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f28d40b2000 tx=0x7f28d40aa070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:54.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.846+0000 7f28ce7fc640 1 -- 172.21.15.94:0/3115291179 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f28d0014030 con 0x7f28d815b0b0 2024-04-25T12:24:55.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.998+0000 7f28e0141640 1 -- 172.21.15.94:0/3115291179 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f28d80ce8c0 con 0x7f28d815b0b0 2024-04-25T12:24:55.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.998+0000 7f28ce7fc640 1 -- 172.21.15.94:0/3115291179 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7f28d0057c60 con 0x7f28d815b0b0 2024-04-25T12:24:55.004 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2024-04-25T12:24:55.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.998+0000 7f28e0141640 1 -- 172.21.15.94:0/3115291179 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f28bc068380 msgr2=0x7f28bc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:55.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.998+0000 7f28e0141640 1 --2- 172.21.15.94:0/3115291179 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f28bc068380 0x7f28bc06a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f28d40b2000 tx=0x7f28d40aa070 comp rx=0 tx=0).stop 2024-04-25T12:24:55.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.998+0000 7f28e0141640 1 -- 172.21.15.94:0/3115291179 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28d815b0b0 msgr2=0x7f28d81e6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:55.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:54.998+0000 7f28e0141640 1 --2- 172.21.15.94:0/3115291179 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28d815b0b0 0x7f28d81e6bd0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f28d000cca0 tx=0x7f28d000a650 comp rx=0 tx=0).stop 2024-04-25T12:24:55.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.002+0000 7f28e0141640 1 -- 172.21.15.94:0/3115291179 shutdown_connections 2024-04-25T12:24:55.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.002+0000 7f28e0141640 1 --2- 172.21.15.94:0/3115291179 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f28bc068380 0x7f28bc06a840 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.002+0000 7f28e0141640 1 --2- 172.21.15.94:0/3115291179 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28d815b0b0 0x7f28d81e6bd0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.002+0000 7f28e0141640 1 --2- 172.21.15.94:0/3115291179 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f28d8155350 0x7f28d8153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.002+0000 7f28e0141640 1 --2- 172.21.15.94:0/3115291179 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f28d80cda50 0x7f28d81e5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.002+0000 7f28e0141640 1 -- 172.21.15.94:0/3115291179 >> 172.21.15.94:0/3115291179 conn(0x7f28d806cc30 msgr2=0x7f28d80cfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:55.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.002+0000 7f28e0141640 1 -- 172.21.15.94:0/3115291179 shutdown_connections 2024-04-25T12:24:55.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.002+0000 7f28e0141640 1 -- 172.21.15.94:0/3115291179 wait complete. 2024-04-25T12:24:55.021 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T12:24:55.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.134+0000 7efcb8861640 1 Processor -- start 2024-04-25T12:24:55.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.134+0000 7efcb8861640 1 -- start start 2024-04-25T12:24:55.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.134+0000 7efcb8861640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7efcb414fbc0 0x7efcb406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:55.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.134+0000 7efcb8861640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7efcb4074100 0x7efcb40c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:55.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.134+0000 7efcb8861640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcb40c5d70 con 0x7efcb414ffa0 2024-04-25T12:24:55.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.134+0000 7efcb8861640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7efcb40c6050 con 0x7efcb414fbc0 2024-04-25T12:24:55.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.134+0000 7efcb8861640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7efcb40c6330 con 0x7efcb4074100 2024-04-25T12:24:55.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.134+0000 7efcb259c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7efcb414fbc0 0x7efcb406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:55.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.134+0000 7efcb259c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7efcb414fbc0 0x7efcb406f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35908/0 (socket says 172.21.15.94:35908) 2024-04-25T12:24:55.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.134+0000 7efcb259c640 1 -- 172.21.15.94:0/675885765 learned_addr learned my addr 172.21.15.94:0/675885765 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:55.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.134+0000 7efcb2d9d640 1 --2- 172.21.15.94:0/675885765 >> v2:172.21.15.111:3300/0 conn(0x7efcb4074100 0x7efcb40c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:55.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.134+0000 7efcb259c640 1 -- 172.21.15.94:0/675885765 >> v2:172.21.15.111:3300/0 conn(0x7efcb4074100 msgr2=0x7efcb40c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:55.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.134+0000 7efcb259c640 1 --2- 172.21.15.94:0/675885765 >> v2:172.21.15.111:3300/0 conn(0x7efcb4074100 0x7efcb40c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.134+0000 7efcb259c640 1 -- 172.21.15.94:0/675885765 >> v1:172.21.15.111:6789/0 conn(0x7efcb414ffa0 legacy=0x7efcb40c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:55.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.134+0000 7efcb259c640 1 -- 172.21.15.94:0/675885765 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb40c6610 con 0x7efcb414fbc0 2024-04-25T12:24:55.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb259c640 1 --2- 172.21.15.94:0/675885765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efcb414fbc0 0x7efcb406f700 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efca4009870 tx=0x7efca401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d748ebd30bc4914f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:55.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb159a640 1 -- 172.21.15.94:0/675885765 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca40aa660 con 0x7efcb414fbc0 2024-04-25T12:24:55.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb159a640 1 -- 172.21.15.94:0/675885765 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efca40af070 con 0x7efcb414fbc0 2024-04-25T12:24:55.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb159a640 1 -- 172.21.15.94:0/675885765 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca40aaa20 con 0x7efcb414fbc0 2024-04-25T12:24:55.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb8861640 1 -- 172.21.15.94:0/675885765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efcb414fbc0 msgr2=0x7efcb406f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:55.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb8861640 1 --2- 172.21.15.94:0/675885765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efcb414fbc0 0x7efcb406f700 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efca4009870 tx=0x7efca401c4e0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb8861640 1 -- 172.21.15.94:0/675885765 shutdown_connections 2024-04-25T12:24:55.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb8861640 1 --2- 172.21.15.94:0/675885765 >> v2:172.21.15.111:3300/0 conn(0x7efcb4074100 0x7efcb40c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb8861640 1 --2- 172.21.15.94:0/675885765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efcb414fbc0 0x7efcb406f700 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb8861640 1 -- 172.21.15.94:0/675885765 >> 172.21.15.94:0/675885765 conn(0x7efcb406b9d0 msgr2=0x7efcb406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:55.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb8861640 1 -- 172.21.15.94:0/675885765 shutdown_connections 2024-04-25T12:24:55.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb8861640 1 -- 172.21.15.94:0/675885765 wait complete. 2024-04-25T12:24:55.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb8861640 1 Processor -- start 2024-04-25T12:24:55.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb8861640 1 -- start start 2024-04-25T12:24:55.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb8861640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efcb4074100 0x7efcb40cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:55.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb8861640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efcb414fbc0 0x7efcb415b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:55.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb8861640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efcb414ffa0 0x7efcb414b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:55.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb8861640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7efcb40c8ab0 con 0x7efcb4074100 2024-04-25T12:24:55.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb8861640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7efcb40c8930 con 0x7efcb414ffa0 2024-04-25T12:24:55.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb8861640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7efcb4166090 con 0x7efcb414fbc0 2024-04-25T12:24:55.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efcb4074100 0x7efcb40cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:55.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efcb4074100 0x7efcb40cbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35922/0 (socket says 172.21.15.94:35922) 2024-04-25T12:24:55.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb259c640 1 -- 172.21.15.94:0/3690774649 learned_addr learned my addr 172.21.15.94:0/3690774649 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:55.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb2d9d640 1 --2- 172.21.15.94:0/3690774649 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efcb414ffa0 0x7efcb414b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:55.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb259c640 1 -- 172.21.15.94:0/3690774649 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efcb414fbc0 msgr2=0x7efcb415b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:55.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb259c640 1 --2- 172.21.15.94:0/3690774649 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efcb414fbc0 0x7efcb415b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb259c640 1 -- 172.21.15.94:0/3690774649 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efcb414ffa0 msgr2=0x7efcb414b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:55.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb259c640 1 --2- 172.21.15.94:0/3690774649 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efcb414ffa0 0x7efcb414b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb259c640 1 -- 172.21.15.94:0/3690774649 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb4153070 con 0x7efcb4074100 2024-04-25T12:24:55.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.138+0000 7efcb2d9d640 1 --2- 172.21.15.94:0/3690774649 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efcb414ffa0 0x7efcb414b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:55.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.142+0000 7efcb259c640 1 --2- 172.21.15.94:0/3690774649 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efcb4074100 0x7efcb40cbcd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7efca40ac040 tx=0x7efca401ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:55.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.142+0000 7efca2ffd640 1 -- 172.21.15.94:0/3690774649 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca40bd5f0 con 0x7efcb4074100 2024-04-25T12:24:55.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.142+0000 7efca2ffd640 1 -- 172.21.15.94:0/3690774649 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efca40bd7b0 con 0x7efcb4074100 2024-04-25T12:24:55.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.142+0000 7efca2ffd640 1 -- 172.21.15.94:0/3690774649 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca40bdba0 con 0x7efcb4074100 2024-04-25T12:24:55.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.142+0000 7efcb8861640 1 -- 172.21.15.94:0/3690774649 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcb41f53e0 con 0x7efcb4074100 2024-04-25T12:24:55.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.142+0000 7efcb8861640 1 -- 172.21.15.94:0/3690774649 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcb41f59a0 con 0x7efcb4074100 2024-04-25T12:24:55.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.142+0000 7efcb8861640 1 -- 172.21.15.94:0/3690774649 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb4075df0 con 0x7efcb4074100 2024-04-25T12:24:55.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.142+0000 7efca2ffd640 1 -- 172.21.15.94:0/3690774649 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efca40b33f0 con 0x7efcb4074100 2024-04-25T12:24:55.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.142+0000 7efca2ffd640 1 --2- 172.21.15.94:0/3690774649 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7efc94068380 0x7efc9406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:55.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.142+0000 7efca2ffd640 1 -- 172.21.15.94:0/3690774649 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7efca41213f0 con 0x7efcb4074100 2024-04-25T12:24:55.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.142+0000 7efcb1d9b640 1 --2- 172.21.15.94:0/3690774649 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7efc94068380 0x7efc9406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:55.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.142+0000 7efcb1d9b640 1 --2- 172.21.15.94:0/3690774649 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7efc94068380 0x7efc9406a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efcb414c4e0 tx=0x7efca8006bd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:55.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.146+0000 7efca2ffd640 1 -- 172.21.15.94:0/3690774649 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efca40c3060 con 0x7efcb4074100 2024-04-25T12:24:55.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.310+0000 7efcb8861640 1 -- 172.21.15.94:0/3690774649 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7efcb40c7df0 con 0x7efcb4074100 2024-04-25T12:24:55.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.310+0000 7efca2ffd640 1 -- 172.21.15.94:0/3690774649 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7efca40160d0 con 0x7efcb4074100 2024-04-25T12:24:55.317 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2024-04-25T12:24:55.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.314+0000 7efcb8861640 1 -- 172.21.15.94:0/3690774649 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7efc94068380 msgr2=0x7efc9406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:55.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.314+0000 7efcb8861640 1 --2- 172.21.15.94:0/3690774649 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7efc94068380 0x7efc9406a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efcb414c4e0 tx=0x7efca8006bd0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.314+0000 7efcb8861640 1 -- 172.21.15.94:0/3690774649 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efcb4074100 msgr2=0x7efcb40cbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:55.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.314+0000 7efcb8861640 1 --2- 172.21.15.94:0/3690774649 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efcb4074100 0x7efcb40cbcd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7efca40ac040 tx=0x7efca401ad20 comp rx=0 tx=0).stop 2024-04-25T12:24:55.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.314+0000 7efcb8861640 1 -- 172.21.15.94:0/3690774649 shutdown_connections 2024-04-25T12:24:55.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.314+0000 7efcb8861640 1 --2- 172.21.15.94:0/3690774649 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7efc94068380 0x7efc9406a840 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.314+0000 7efcb8861640 1 --2- 172.21.15.94:0/3690774649 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efcb414fbc0 0x7efcb415b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.314+0000 7efcb8861640 1 --2- 172.21.15.94:0/3690774649 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efcb414ffa0 0x7efcb414b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.314+0000 7efcb8861640 1 --2- 172.21.15.94:0/3690774649 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efcb4074100 0x7efcb40cbcd0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.314+0000 7efcb8861640 1 -- 172.21.15.94:0/3690774649 >> 172.21.15.94:0/3690774649 conn(0x7efcb406b9d0 msgr2=0x7efcb406e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:55.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.314+0000 7efcb8861640 1 -- 172.21.15.94:0/3690774649 shutdown_connections 2024-04-25T12:24:55.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.314+0000 7efcb8861640 1 -- 172.21.15.94:0/3690774649 wait complete. 2024-04-25T12:24:55.334 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-25T12:24:55.334 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T12:24:55.340 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:24:55.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.482+0000 7f034b0a9640 1 Processor -- start 2024-04-25T12:24:55.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.482+0000 7f034b0a9640 1 -- start start 2024-04-25T12:24:55.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.486+0000 7f034b0a9640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f03440c4b40 0x7f03440c5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:55.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.486+0000 7f034b0a9640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f03440c5cc0 0x7f0344161eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:55.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.486+0000 7f034b0a9640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03440c6150 con 0x7f03440c8800 2024-04-25T12:24:55.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.486+0000 7f034b0a9640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f0344158090 con 0x7f03440c5cc0 2024-04-25T12:24:55.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.486+0000 7f034b0a9640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f03441585c0 con 0x7f03440c4b40 2024-04-25T12:24:55.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.486+0000 7f0349646640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f03440c5cc0 0x7f0344161eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:55.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.486+0000 7f0349646640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f03440c5cc0 0x7f0344161eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35934/0 (socket says 172.21.15.94:35934) 2024-04-25T12:24:55.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.486+0000 7f0349646640 1 -- 172.21.15.94:0/595108022 learned_addr learned my addr 172.21.15.94:0/595108022 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:55.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.486+0000 7f0343fff640 1 --2- 172.21.15.94:0/595108022 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f03440c4b40 0x7f03440c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:55.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.486+0000 7f0349646640 1 -- 172.21.15.94:0/595108022 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f03440c4b40 msgr2=0x7f03440c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:55.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.486+0000 7f0349646640 1 --2- 172.21.15.94:0/595108022 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f03440c4b40 0x7f03440c5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.486+0000 7f0349646640 1 -- 172.21.15.94:0/595108022 >> v1:172.21.15.111:6789/0 conn(0x7f03440c8800 legacy=0x7f03440c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:55.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.486+0000 7f0349646640 1 -- 172.21.15.94:0/595108022 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03440c8be0 con 0x7f03440c5cc0 2024-04-25T12:24:55.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.486+0000 7f0349646640 1 --2- 172.21.15.94:0/595108022 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f03440c5cc0 0x7f0344161eb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f033c009e50 tx=0x7f033c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142b10355dbe664e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:55.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.486+0000 7f03437fe640 1 -- 172.21.15.94:0/595108022 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c0a5770 con 0x7f03440c5cc0 2024-04-25T12:24:55.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.486+0000 7f03437fe640 1 -- 172.21.15.94:0/595108022 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f033c0a5910 con 0x7f03440c5cc0 2024-04-25T12:24:55.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.486+0000 7f03437fe640 1 -- 172.21.15.94:0/595108022 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c0a5ce0 con 0x7f03440c5cc0 2024-04-25T12:24:55.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.486+0000 7f034b0a9640 1 -- 172.21.15.94:0/595108022 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f03440c5cc0 msgr2=0x7f0344161eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:55.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.486+0000 7f034b0a9640 1 --2- 172.21.15.94:0/595108022 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f03440c5cc0 0x7f0344161eb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f033c009e50 tx=0x7f033c01c910 comp rx=0 tx=0).stop 2024-04-25T12:24:55.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.486+0000 7f034b0a9640 1 -- 172.21.15.94:0/595108022 shutdown_connections 2024-04-25T12:24:55.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.486+0000 7f034b0a9640 1 --2- 172.21.15.94:0/595108022 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f03440c5cc0 0x7f0344161eb0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.486+0000 7f034b0a9640 1 --2- 172.21.15.94:0/595108022 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f03440c4b40 0x7f03440c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.486+0000 7f034b0a9640 1 -- 172.21.15.94:0/595108022 >> 172.21.15.94:0/595108022 conn(0x7f034406b9d0 msgr2=0x7f034406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:55.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.486+0000 7f034b0a9640 1 -- 172.21.15.94:0/595108022 shutdown_connections 2024-04-25T12:24:55.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.486+0000 7f034b0a9640 1 -- 172.21.15.94:0/595108022 wait complete. 2024-04-25T12:24:55.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.490+0000 7f034b0a9640 1 Processor -- start 2024-04-25T12:24:55.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.490+0000 7f034b0a9640 1 -- start start 2024-04-25T12:24:55.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.490+0000 7f034b0a9640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f03440c4b40 0x7f03440724e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:55.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.490+0000 7f034b0a9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f03440c5cc0 0x7f03440c3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:55.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.490+0000 7f034b0a9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f03440c8800 0x7f03440bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:55.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.490+0000 7f034b0a9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0344074280 con 0x7f03440c8800 2024-04-25T12:24:55.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.490+0000 7f034b0a9640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f03440c52f0 con 0x7f03440c5cc0 2024-04-25T12:24:55.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.490+0000 7f034b0a9640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f0344068610 con 0x7f03440c4b40 2024-04-25T12:24:55.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.490+0000 7f0349646640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f03440c8800 0x7f03440bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:55.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.490+0000 7f0349646640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f03440c8800 0x7f03440bfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35944/0 (socket says 172.21.15.94:35944) 2024-04-25T12:24:55.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.490+0000 7f0349646640 1 -- 172.21.15.94:0/366203933 learned_addr learned my addr 172.21.15.94:0/366203933 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:55.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.490+0000 7f0343fff640 1 --2- 172.21.15.94:0/366203933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f03440c5cc0 0x7f03440c3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:55.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.490+0000 7f0348e45640 1 --2- 172.21.15.94:0/366203933 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f03440c4b40 0x7f03440724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:55.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.490+0000 7f0349646640 1 -- 172.21.15.94:0/366203933 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f03440c4b40 msgr2=0x7f03440724e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:55.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.490+0000 7f0349646640 1 --2- 172.21.15.94:0/366203933 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f03440c4b40 0x7f03440724e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.490+0000 7f0349646640 1 -- 172.21.15.94:0/366203933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f03440c5cc0 msgr2=0x7f03440c3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:55.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.490+0000 7f0349646640 1 --2- 172.21.15.94:0/366203933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f03440c5cc0 0x7f03440c3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.490+0000 7f0349646640 1 -- 172.21.15.94:0/366203933 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03441f3e60 con 0x7f03440c8800 2024-04-25T12:24:55.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.490+0000 7f0349646640 1 --2- 172.21.15.94:0/366203933 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f03440c8800 0x7f03440bfef0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f033c009e50 tx=0x7f033c0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:55.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.490+0000 7f03417fa640 1 -- 172.21.15.94:0/366203933 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c0bc020 con 0x7f03440c8800 2024-04-25T12:24:55.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.490+0000 7f03417fa640 1 -- 172.21.15.94:0/366203933 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f033c0b8880 con 0x7f03440c8800 2024-04-25T12:24:55.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.490+0000 7f034b0a9640 1 -- 172.21.15.94:0/366203933 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03441f4140 con 0x7f03440c8800 2024-04-25T12:24:55.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.490+0000 7f03417fa640 1 -- 172.21.15.94:0/366203933 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c009510 con 0x7f03440c8800 2024-04-25T12:24:55.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.490+0000 7f034b0a9640 1 -- 172.21.15.94:0/366203933 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03441f4700 con 0x7f03440c8800 2024-04-25T12:24:55.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.490+0000 7f034b0a9640 1 -- 172.21.15.94:0/366203933 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0344075df0 con 0x7f03440c8800 2024-04-25T12:24:55.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.490+0000 7f03417fa640 1 -- 172.21.15.94:0/366203933 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f033c0bf020 con 0x7f03440c8800 2024-04-25T12:24:55.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.494+0000 7f03417fa640 1 --2- 172.21.15.94:0/366203933 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0328068380 0x7f032806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:55.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.494+0000 7f03417fa640 1 -- 172.21.15.94:0/366203933 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f033c121dc0 con 0x7f03440c8800 2024-04-25T12:24:55.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.494+0000 7f0348e45640 1 --2- 172.21.15.94:0/366203933 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0328068380 0x7f032806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:55.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.494+0000 7f0348e45640 1 --2- 172.21.15.94:0/366203933 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0328068380 0x7f032806a840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f03380015b0 tx=0x7f0338009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:55.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.498+0000 7f03417fa640 1 -- 172.21.15.94:0/366203933 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f033c0c6030 con 0x7f03440c8800 2024-04-25T12:24:55.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.658+0000 7f034b0a9640 1 -- 172.21.15.94:0/366203933 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f034406f840 con 0x7f03440c8800 2024-04-25T12:24:55.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.658+0000 7f03417fa640 1 -- 172.21.15.94:0/366203933 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18873 (secure 0 0 0) 0x7f033c016620 con 0x7f03440c8800 2024-04-25T12:24:55.665 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:55.665 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"7059a9e2-aec4-4b84-b942-caf531e15da3","created":"2024-04-25T12:21:29.118508+0000","modified":"2024-04-25T12:22:34.871807+0000","last_up_change":"2024-04-25T12:21:40.912605+0000","last_in_change":"2024-04-25T12:21:31.372905+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:39.781011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:51.465886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:52.470540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:56.209936+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"640a65ef-0734-468a-a8f5-9ed70cf75c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6809","nonce":2553247564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6811","nonce":2553247564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6815","nonce":2553247564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6813","nonce":2553247564}]},"public_addr":"172.21.15.94:6809/2553247564","cluster_addr":"172.21.15.94:6811/2553247564","heartbeat_back_addr":"172.21.15.94:6815/2553247564","heartbeat_front_addr":"172.21.15.94:6813/2553247564","state":["exists","up"]},{"osd":1,"uuid":"d6e886e6-c8c1-4761-9a4c-abc6961c7c81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6818","nonce":2492806478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6822","nonce":2492806478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6830","nonce":2492806478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6826","nonce":2492806478}]},"public_addr":"172.21.15.94:6818/2492806478","cluster_addr":"172.21.15.94:6822/2492806478","heartbeat_back_addr":"172.21.15.94:6830/2492806478","heartbeat_front_addr":"172.21.15.94:6826/2492806478","state":["exists","up"]},{"osd":2,"uuid":"ba20f409-ed46-43b6-b16d-43dc4622c042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6801","nonce":1485061290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6803","nonce":1485061290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6807","nonce":1485061290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6805","nonce":1485061290}]},"public_addr":"172.21.15.94:6801/1485061290","cluster_addr":"172.21.15.94:6803/1485061290","heartbeat_back_addr":"172.21.15.94:6807/1485061290","heartbeat_front_addr":"172.21.15.94:6805/1485061290","state":["exists","up"]},{"osd":3,"uuid":"85816a2b-3a3f-4ec8-8373-8230d948396f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6819","nonce":1548488434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6823","nonce":1548488434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6829","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6831","nonce":1548488434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6827","nonce":1548488434}]},"public_addr":"172.21.15.94:6819/1548488434","cluster_addr":"172.21.15.94:6823/1548488434","heartbeat_back_addr":"172.21.15.94:6831/1548488434","heartbeat_front_addr":"172.21.15.94:6827/1548488434","state":["exists","up"]},{"osd":4,"uuid":"b4a953b7-01d6-4623-9324-63135fdaf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6811","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6814","nonce":4070977083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6817","nonce":4070977083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6823","nonce":4070977083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6819","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6821","nonce":4070977083}]},"public_addr":"172.21.15.111:6814/4070977083","cluster_addr":"172.21.15.111:6817/4070977083","heartbeat_back_addr":"172.21.15.111:6823/4070977083","heartbeat_front_addr":"172.21.15.111:6821/4070977083","state":["exists","up"]},{"osd":5,"uuid":"c0acc514-427d-41bf-a965-b8463cebf045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6803","nonce":1054925605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6809","nonce":1054925605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6820","nonce":1054925605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6815","nonce":1054925605}]},"public_addr":"172.21.15.111:6803/1054925605","cluster_addr":"172.21.15.111:6809/1054925605","heartbeat_back_addr":"172.21.15.111:6820/1054925605","heartbeat_front_addr":"172.21.15.111:6815/1054925605","state":["exists","up"]},{"osd":6,"uuid":"26ff742f-5a57-44a7-a095-f04d6e87f885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6825","nonce":3619235078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6827","nonce":3619235078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6831","nonce":3619235078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6829","nonce":3619235078}]},"public_addr":"172.21.15.111:6825/3619235078","cluster_addr":"172.21.15.111:6827/3619235078","heartbeat_back_addr":"172.21.15.111:6831/3619235078","heartbeat_front_addr":"172.21.15.111:6829/3619235078","state":["exists","up"]},{"osd":7,"uuid":"9c214cba-693a-4b25-aad7-05a5b0006e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6801","nonce":558758517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6805","nonce":558758517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6813","nonce":558758517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6807","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6808","nonce":558758517}]},"public_addr":"172.21.15.111:6801/558758517","cluster_addr":"172.21.15.111:6805/558758517","heartbeat_back_addr":"172.21.15.111:6813/558758517","heartbeat_front_addr":"172.21.15.111:6808/558758517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.664958+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.853375+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.654455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:37.033852+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.968691+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.856013+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.913496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.848565+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:24:55.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.662+0000 7f034b0a9640 1 -- 172.21.15.94:0/366203933 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0328068380 msgr2=0x7f032806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:55.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.662+0000 7f034b0a9640 1 --2- 172.21.15.94:0/366203933 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0328068380 0x7f032806a840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f03380015b0 tx=0x7f0338009040 comp rx=0 tx=0).stop 2024-04-25T12:24:55.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.662+0000 7f034b0a9640 1 -- 172.21.15.94:0/366203933 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f03440c8800 msgr2=0x7f03440bfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:55.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.662+0000 7f034b0a9640 1 --2- 172.21.15.94:0/366203933 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f03440c8800 0x7f03440bfef0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f033c009e50 tx=0x7f033c0196b0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.662+0000 7f034b0a9640 1 -- 172.21.15.94:0/366203933 shutdown_connections 2024-04-25T12:24:55.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.662+0000 7f034b0a9640 1 --2- 172.21.15.94:0/366203933 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f0328068380 0x7f032806a840 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.662+0000 7f034b0a9640 1 --2- 172.21.15.94:0/366203933 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f03440c8800 0x7f03440bfef0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.662+0000 7f034b0a9640 1 --2- 172.21.15.94:0/366203933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f03440c5cc0 0x7f03440c3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.662+0000 7f034b0a9640 1 --2- 172.21.15.94:0/366203933 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f03440c4b40 0x7f03440724e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.662+0000 7f034b0a9640 1 -- 172.21.15.94:0/366203933 >> 172.21.15.94:0/366203933 conn(0x7f034406b9d0 msgr2=0x7f0344150170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:55.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.662+0000 7f034b0a9640 1 -- 172.21.15.94:0/366203933 shutdown_connections 2024-04-25T12:24:55.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.662+0000 7f034b0a9640 1 -- 172.21.15.94:0/366203933 wait complete. 2024-04-25T12:24:55.684 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T12:21:39.781011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T12:21:51.465886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T12:21:52.470540+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T12:21:56.209936+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T12:24:55.684 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T12:24:55.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.802+0000 7f4be9b1a640 1 Processor -- start 2024-04-25T12:24:55.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.802+0000 7f4be9b1a640 1 -- start start 2024-04-25T12:24:55.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.806+0000 7f4be9b1a640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f4be414ffa0 0x7f4be406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:55.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.806+0000 7f4be9b1a640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4be4074100 0x7f4be40c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:55.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.806+0000 7f4be9b1a640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4be40c5d70 con 0x7f4be414fbc0 2024-04-25T12:24:55.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.806+0000 7f4be9b1a640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f4be40c6050 con 0x7f4be414ffa0 2024-04-25T12:24:55.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.806+0000 7f4be9b1a640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f4be40c6330 con 0x7f4be4074100 2024-04-25T12:24:55.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.806+0000 7f4be2ffd640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f4be414ffa0 0x7f4be406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:55.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.806+0000 7f4be3fff640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4be4074100 0x7f4be40c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:55.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.806+0000 7f4be37fe640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f4be414fbc0 0x7f4be40c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.94:53196/0 (socket says 172.21.15.94:53196) 2024-04-25T12:24:55.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.806+0000 7f4be2ffd640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f4be414ffa0 0x7f4be406f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.94:39126/0 (socket says 172.21.15.94:39126) 2024-04-25T12:24:55.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.806+0000 7f4be37fe640 1 -- 172.21.15.94:0/2834989834 learned_addr learned my addr 172.21.15.94:0/2834989834 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:55.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.806+0000 7f4be2ffd640 1 -- 172.21.15.94:0/2834989834 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4be4074100 msgr2=0x7f4be40c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:55.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.806+0000 7f4be2ffd640 1 --2- 172.21.15.94:0/2834989834 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4be4074100 0x7f4be40c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.806+0000 7f4be2ffd640 1 -- 172.21.15.94:0/2834989834 >> v1:172.21.15.111:6789/0 conn(0x7f4be414fbc0 legacy=0x7f4be40c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:55.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.806+0000 7f4be2ffd640 1 -- 172.21.15.94:0/2834989834 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be40c6610 con 0x7f4be414ffa0 2024-04-25T12:24:55.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.806+0000 7f4be2ffd640 1 --2- 172.21.15.94:0/2834989834 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4be414ffa0 0x7f4be406f700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80097c0 tx=0x7f4bd801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=985761f64065dc90 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:55.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be27fc640 1 -- 172.21.15.94:0/2834989834 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd80aa620 con 0x7f4be414ffa0 2024-04-25T12:24:55.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be27fc640 1 -- 172.21.15.94:0/2834989834 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bd80af070 con 0x7f4be414ffa0 2024-04-25T12:24:55.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be27fc640 1 -- 172.21.15.94:0/2834989834 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd80aa9e0 con 0x7f4be414ffa0 2024-04-25T12:24:55.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be9b1a640 1 -- 172.21.15.94:0/2834989834 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4be414ffa0 msgr2=0x7f4be406f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:55.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be9b1a640 1 --2- 172.21.15.94:0/2834989834 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4be414ffa0 0x7f4be406f700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80097c0 tx=0x7f4bd801c4a0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be9b1a640 1 -- 172.21.15.94:0/2834989834 shutdown_connections 2024-04-25T12:24:55.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be9b1a640 1 --2- 172.21.15.94:0/2834989834 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4be4074100 0x7f4be40c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be9b1a640 1 --2- 172.21.15.94:0/2834989834 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4be414ffa0 0x7f4be406f700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be9b1a640 1 -- 172.21.15.94:0/2834989834 >> 172.21.15.94:0/2834989834 conn(0x7f4be406b9d0 msgr2=0x7f4be406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:55.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be9b1a640 1 -- 172.21.15.94:0/2834989834 shutdown_connections 2024-04-25T12:24:55.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be9b1a640 1 -- 172.21.15.94:0/2834989834 wait complete. 2024-04-25T12:24:55.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be9b1a640 1 Processor -- start 2024-04-25T12:24:55.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be9b1a640 1 -- start start 2024-04-25T12:24:55.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be9b1a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4be4074100 0x7f4be41f3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:55.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be9b1a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4be414fbc0 0x7f4be41f3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:55.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be9b1a640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4be414ffa0 0x7f4be4141fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:55.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be9b1a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4be40c8ab0 con 0x7f4be4074100 2024-04-25T12:24:55.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be9b1a640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f4be40c8930 con 0x7f4be414fbc0 2024-04-25T12:24:55.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be9b1a640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f4be4166090 con 0x7f4be414ffa0 2024-04-25T12:24:55.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be37fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4be4074100 0x7f4be41f3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:55.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be37fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4be4074100 0x7f4be41f3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35950/0 (socket says 172.21.15.94:35950) 2024-04-25T12:24:55.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be37fe640 1 -- 172.21.15.94:0/2970314653 learned_addr learned my addr 172.21.15.94:0/2970314653 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:55.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be2ffd640 1 --2- 172.21.15.94:0/2970314653 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4be414fbc0 0x7f4be41f3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:55.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be3fff640 1 --2- 172.21.15.94:0/2970314653 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4be414ffa0 0x7f4be4141fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:55.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be37fe640 1 -- 172.21.15.94:0/2970314653 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4be414ffa0 msgr2=0x7f4be4141fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:55.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be37fe640 1 --2- 172.21.15.94:0/2970314653 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4be414ffa0 0x7f4be4141fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be37fe640 1 -- 172.21.15.94:0/2970314653 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4be414fbc0 msgr2=0x7f4be41f3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:55.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be37fe640 1 --2- 172.21.15.94:0/2970314653 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4be414fbc0 0x7f4be41f3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be37fe640 1 -- 172.21.15.94:0/2970314653 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be415af70 con 0x7f4be4074100 2024-04-25T12:24:55.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be37fe640 1 --2- 172.21.15.94:0/2970314653 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4be4074100 0x7f4be41f3550 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400c450 tx=0x7f4bd400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:55.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4bcbfff640 1 -- 172.21.15.94:0/2970314653 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4017070 con 0x7f4be4074100 2024-04-25T12:24:55.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4bcbfff640 1 -- 172.21.15.94:0/2970314653 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bd4005cf0 con 0x7f4be4074100 2024-04-25T12:24:55.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4bcbfff640 1 -- 172.21.15.94:0/2970314653 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4007290 con 0x7f4be4074100 2024-04-25T12:24:55.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.810+0000 7f4be9b1a640 1 -- 172.21.15.94:0/2970314653 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4be415b220 con 0x7f4be4074100 2024-04-25T12:24:55.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.814+0000 7f4be9b1a640 1 -- 172.21.15.94:0/2970314653 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4be415b7e0 con 0x7f4be4074100 2024-04-25T12:24:55.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.814+0000 7f4be9b1a640 1 -- 172.21.15.94:0/2970314653 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4be4075df0 con 0x7f4be4074100 2024-04-25T12:24:55.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.814+0000 7f4bcbfff640 1 -- 172.21.15.94:0/2970314653 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4bd401a070 con 0x7f4be4074100 2024-04-25T12:24:55.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.814+0000 7f4bcbfff640 1 --2- 172.21.15.94:0/2970314653 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f4bd0068380 0x7f4bd006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:55.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.814+0000 7f4bcbfff640 1 -- 172.21.15.94:0/2970314653 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f4bd40860d0 con 0x7f4be4074100 2024-04-25T12:24:55.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.814+0000 7f4be2ffd640 1 --2- 172.21.15.94:0/2970314653 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f4bd0068380 0x7f4bd006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:55.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.814+0000 7f4be2ffd640 1 --2- 172.21.15.94:0/2970314653 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f4bd0068380 0x7f4bd006a840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80ae000 tx=0x7f4bd80b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:55.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.818+0000 7f4bcbfff640 1 -- 172.21.15.94:0/2970314653 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4bd40562a0 con 0x7f4be4074100 2024-04-25T12:24:55.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.982+0000 7f4be9b1a640 1 -- 172.21.15.94:0/2970314653 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4be41f31b0 con 0x7f4be4074100 2024-04-25T12:24:55.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.982+0000 7f4bcbfff640 1 -- 172.21.15.94:0/2970314653 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7f4bd4055ba0 con 0x7f4be4074100 2024-04-25T12:24:55.987 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2024-04-25T12:24:55.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.982+0000 7f4be9b1a640 1 -- 172.21.15.94:0/2970314653 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f4bd0068380 msgr2=0x7f4bd006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:55.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.982+0000 7f4be9b1a640 1 --2- 172.21.15.94:0/2970314653 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f4bd0068380 0x7f4bd006a840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80ae000 tx=0x7f4bd80b5040 comp rx=0 tx=0).stop 2024-04-25T12:24:55.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.982+0000 7f4be9b1a640 1 -- 172.21.15.94:0/2970314653 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4be4074100 msgr2=0x7f4be41f3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:55.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.982+0000 7f4be9b1a640 1 --2- 172.21.15.94:0/2970314653 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4be4074100 0x7f4be41f3550 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400c450 tx=0x7f4bd400c910 comp rx=0 tx=0).stop 2024-04-25T12:24:55.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.982+0000 7f4be9b1a640 1 -- 172.21.15.94:0/2970314653 shutdown_connections 2024-04-25T12:24:55.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.982+0000 7f4be9b1a640 1 --2- 172.21.15.94:0/2970314653 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f4bd0068380 0x7f4bd006a840 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.982+0000 7f4be9b1a640 1 --2- 172.21.15.94:0/2970314653 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4be414ffa0 0x7f4be4141fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.982+0000 7f4be9b1a640 1 --2- 172.21.15.94:0/2970314653 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4be414fbc0 0x7f4be41f3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.982+0000 7f4be9b1a640 1 --2- 172.21.15.94:0/2970314653 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4be4074100 0x7f4be41f3550 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:55.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.982+0000 7f4be9b1a640 1 -- 172.21.15.94:0/2970314653 >> 172.21.15.94:0/2970314653 conn(0x7f4be406b9d0 msgr2=0x7f4be406ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:55.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.982+0000 7f4be9b1a640 1 -- 172.21.15.94:0/2970314653 shutdown_connections 2024-04-25T12:24:55.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:55.982+0000 7f4be9b1a640 1 -- 172.21.15.94:0/2970314653 wait complete. 2024-04-25T12:24:56.006 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T12:24:56.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.118+0000 7f44a3b73640 1 Processor -- start 2024-04-25T12:24:56.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.118+0000 7f44a3b73640 1 -- start start 2024-04-25T12:24:56.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.122+0000 7f44a3b73640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f449c155300 0x7f449c0c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:56.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.122+0000 7f44a3b73640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f449c06f700 0x7f449c15e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:56.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.122+0000 7f44a3b73640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f449c15ec50 0x7f449c0c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:56.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.122+0000 7f44a3b73640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f449c0c4230 con 0x7f449c155300 2024-04-25T12:24:56.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.122+0000 7f44a3b73640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f449c15f0e0 con 0x7f449c15ec50 2024-04-25T12:24:56.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.122+0000 7f44a3b73640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f449c0c5770 con 0x7f449c06f700 2024-04-25T12:24:56.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.122+0000 7f44a190f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f449c155300 0x7f449c0c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:56.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.122+0000 7f44a190f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f449c155300 0x7f449c0c3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35952/0 (socket says 172.21.15.94:35952) 2024-04-25T12:24:56.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.122+0000 7f44a190f640 1 -- 172.21.15.94:0/1374227914 learned_addr learned my addr 172.21.15.94:0/1374227914 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:56.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.122+0000 7f44a110e640 1 --2- 172.21.15.94:0/1374227914 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f449c06f700 0x7f449c15e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:56.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.122+0000 7f44a2110640 1 --2- 172.21.15.94:0/1374227914 >> v2:172.21.15.111:3300/0 conn(0x7f449c15ec50 0x7f449c0c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:56.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.122+0000 7f44a190f640 1 -- 172.21.15.94:0/1374227914 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f449c06f700 msgr2=0x7f449c15e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:56.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.122+0000 7f44a190f640 1 --2- 172.21.15.94:0/1374227914 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f449c06f700 0x7f449c15e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.122+0000 7f44a190f640 1 -- 172.21.15.94:0/1374227914 >> v2:172.21.15.111:3300/0 conn(0x7f449c15ec50 msgr2=0x7f449c0c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:56.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.122+0000 7f44a190f640 1 --2- 172.21.15.94:0/1374227914 >> v2:172.21.15.111:3300/0 conn(0x7f449c15ec50 0x7f449c0c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.122+0000 7f44a190f640 1 -- 172.21.15.94:0/1374227914 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f449c0c4e80 con 0x7f449c155300 2024-04-25T12:24:56.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.122+0000 7f44a2110640 1 --2- 172.21.15.94:0/1374227914 >> v2:172.21.15.111:3300/0 conn(0x7f449c15ec50 0x7f449c0c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:56.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.122+0000 7f44a190f640 1 --2- 172.21.15.94:0/1374227914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f449c155300 0x7f449c0c3cf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f449c06dd80 tx=0x7f449001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ce05f9e6a0747c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:56.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.122+0000 7f44a090d640 1 -- 172.21.15.94:0/1374227914 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44900b0070 con 0x7f449c155300 2024-04-25T12:24:56.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.122+0000 7f44a090d640 1 -- 172.21.15.94:0/1374227914 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44900ab600 con 0x7f449c155300 2024-04-25T12:24:56.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.122+0000 7f44a090d640 1 -- 172.21.15.94:0/1374227914 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44900ab9d0 con 0x7f449c155300 2024-04-25T12:24:56.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a3b73640 1 -- 172.21.15.94:0/1374227914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f449c155300 msgr2=0x7f449c0c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:56.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a3b73640 1 --2- 172.21.15.94:0/1374227914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f449c155300 0x7f449c0c3cf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f449c06dd80 tx=0x7f449001c520 comp rx=0 tx=0).stop 2024-04-25T12:24:56.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a3b73640 1 -- 172.21.15.94:0/1374227914 shutdown_connections 2024-04-25T12:24:56.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a3b73640 1 --2- 172.21.15.94:0/1374227914 >> v2:172.21.15.111:3300/0 conn(0x7f449c15ec50 0x7f449c0c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a3b73640 1 --2- 172.21.15.94:0/1374227914 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f449c06f700 0x7f449c15e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a3b73640 1 --2- 172.21.15.94:0/1374227914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f449c155300 0x7f449c0c3cf0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a3b73640 1 -- 172.21.15.94:0/1374227914 >> 172.21.15.94:0/1374227914 conn(0x7f449c06b9d0 msgr2=0x7f449c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:56.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a3b73640 1 -- 172.21.15.94:0/1374227914 shutdown_connections 2024-04-25T12:24:56.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a3b73640 1 -- 172.21.15.94:0/1374227914 wait complete. 2024-04-25T12:24:56.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a3b73640 1 Processor -- start 2024-04-25T12:24:56.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a3b73640 1 -- start start 2024-04-25T12:24:56.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a3b73640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f449c06f700 0x7f449c1f3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:56.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a3b73640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f449c155300 0x7f449c158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:56.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a3b73640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f449c15ec50 0x7f449c1f30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:56.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a3b73640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f449c15f600 con 0x7f449c155300 2024-04-25T12:24:56.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a3b73640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f449c0c78c0 con 0x7f449c15ec50 2024-04-25T12:24:56.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a3b73640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f449c0681d0 con 0x7f449c06f700 2024-04-25T12:24:56.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a110e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f449c155300 0x7f449c158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:56.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a110e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f449c155300 0x7f449c158420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35958/0 (socket says 172.21.15.94:35958) 2024-04-25T12:24:56.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a110e640 1 -- 172.21.15.94:0/3548999950 learned_addr learned my addr 172.21.15.94:0/3548999950 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:56.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a190f640 1 --2- 172.21.15.94:0/3548999950 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f449c06f700 0x7f449c1f3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:56.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a110e640 1 -- 172.21.15.94:0/3548999950 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f449c06f700 msgr2=0x7f449c1f3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:56.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a2110640 1 --2- 172.21.15.94:0/3548999950 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f449c15ec50 0x7f449c1f30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:56.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a110e640 1 --2- 172.21.15.94:0/3548999950 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f449c06f700 0x7f449c1f3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a110e640 1 -- 172.21.15.94:0/3548999950 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f449c15ec50 msgr2=0x7f449c1f30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:56.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a110e640 1 --2- 172.21.15.94:0/3548999950 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f449c15ec50 0x7f449c1f30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a110e640 1 -- 172.21.15.94:0/3548999950 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f449c1f1d50 con 0x7f449c155300 2024-04-25T12:24:56.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a110e640 1 --2- 172.21.15.94:0/3548999950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f449c155300 0x7f449c158420 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f449800c820 tx=0x7f449800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:56.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f448e7fc640 1 -- 172.21.15.94:0/3548999950 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4498015070 con 0x7f449c155300 2024-04-25T12:24:56.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f448e7fc640 1 -- 172.21.15.94:0/3548999950 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4498004220 con 0x7f449c155300 2024-04-25T12:24:56.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a3b73640 1 -- 172.21.15.94:0/3548999950 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f449c1f2030 con 0x7f449c155300 2024-04-25T12:24:56.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f448e7fc640 1 -- 172.21.15.94:0/3548999950 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449800ce10 con 0x7f449c155300 2024-04-25T12:24:56.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a3b73640 1 -- 172.21.15.94:0/3548999950 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f449c1f25f0 con 0x7f449c155300 2024-04-25T12:24:56.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.126+0000 7f44a3b73640 1 -- 172.21.15.94:0/3548999950 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f449c075df0 con 0x7f449c155300 2024-04-25T12:24:56.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.130+0000 7f448e7fc640 1 -- 172.21.15.94:0/3548999950 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4498007830 con 0x7f449c155300 2024-04-25T12:24:56.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.130+0000 7f448e7fc640 1 --2- 172.21.15.94:0/3548999950 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f4480068380 0x7f448006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:56.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.130+0000 7f448e7fc640 1 -- 172.21.15.94:0/3548999950 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f4498086c40 con 0x7f449c155300 2024-04-25T12:24:56.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.130+0000 7f44a190f640 1 --2- 172.21.15.94:0/3548999950 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f4480068380 0x7f448006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:56.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.130+0000 7f44a190f640 1 --2- 172.21.15.94:0/3548999950 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f4480068380 0x7f448006a840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f44900ad000 tx=0x7f4490008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:56.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.134+0000 7f448e7fc640 1 -- 172.21.15.94:0/3548999950 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4498056d80 con 0x7f449c155300 2024-04-25T12:24:56.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.286+0000 7f44a3b73640 1 -- 172.21.15.94:0/3548999950 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f449c06c4f0 con 0x7f449c155300 2024-04-25T12:24:56.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.286+0000 7f448e7fc640 1 -- 172.21.15.94:0/3548999950 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7f4498056680 con 0x7f449c155300 2024-04-25T12:24:56.293 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2024-04-25T12:24:56.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.290+0000 7f44a3b73640 1 -- 172.21.15.94:0/3548999950 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f4480068380 msgr2=0x7f448006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:56.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.290+0000 7f44a3b73640 1 --2- 172.21.15.94:0/3548999950 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f4480068380 0x7f448006a840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f44900ad000 tx=0x7f4490008040 comp rx=0 tx=0).stop 2024-04-25T12:24:56.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.290+0000 7f44a3b73640 1 -- 172.21.15.94:0/3548999950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f449c155300 msgr2=0x7f449c158420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:56.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.290+0000 7f44a3b73640 1 --2- 172.21.15.94:0/3548999950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f449c155300 0x7f449c158420 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f449800c820 tx=0x7f449800cce0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.290+0000 7f44a3b73640 1 -- 172.21.15.94:0/3548999950 shutdown_connections 2024-04-25T12:24:56.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.290+0000 7f44a3b73640 1 --2- 172.21.15.94:0/3548999950 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f4480068380 0x7f448006a840 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.290+0000 7f44a3b73640 1 --2- 172.21.15.94:0/3548999950 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f449c15ec50 0x7f449c1f30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.290+0000 7f44a3b73640 1 --2- 172.21.15.94:0/3548999950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f449c155300 0x7f449c158420 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.290+0000 7f44a3b73640 1 --2- 172.21.15.94:0/3548999950 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f449c06f700 0x7f449c1f3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.290+0000 7f44a3b73640 1 -- 172.21.15.94:0/3548999950 >> 172.21.15.94:0/3548999950 conn(0x7f449c06b9d0 msgr2=0x7f449c0c7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:56.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.290+0000 7f44a3b73640 1 -- 172.21.15.94:0/3548999950 shutdown_connections 2024-04-25T12:24:56.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.290+0000 7f44a3b73640 1 -- 172.21.15.94:0/3548999950 wait complete. 2024-04-25T12:24:56.310 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T12:24:56.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.422+0000 7f152c9d9640 1 Processor -- start 2024-04-25T12:24:56.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.422+0000 7f152c9d9640 1 -- start start 2024-04-25T12:24:56.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f152c9d9640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f152814fbc0 0x7f152806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:56.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f152c9d9640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f1528074100 0x7f15280c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:56.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f152c9d9640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15280c5d70 con 0x7f152814ffa0 2024-04-25T12:24:56.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f152c9d9640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f15280c6050 con 0x7f152814fbc0 2024-04-25T12:24:56.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f152c9d9640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f15280c6330 con 0x7f1528074100 2024-04-25T12:24:56.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f152659c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f152814fbc0 0x7f152806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:56.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f152659c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f152814fbc0 0x7f152806f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35964/0 (socket says 172.21.15.94:35964) 2024-04-25T12:24:56.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f152659c640 1 -- 172.21.15.94:0/1067258913 learned_addr learned my addr 172.21.15.94:0/1067258913 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:56.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f152659c640 1 -- 172.21.15.94:0/1067258913 >> v2:172.21.15.111:3300/0 conn(0x7f1528074100 msgr2=0x7f15280c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:56.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f1526d9d640 1 --2- 172.21.15.94:0/1067258913 >> v2:172.21.15.111:3300/0 conn(0x7f1528074100 0x7f15280c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:56.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f152659c640 1 --2- 172.21.15.94:0/1067258913 >> v2:172.21.15.111:3300/0 conn(0x7f1528074100 0x7f15280c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f152659c640 1 -- 172.21.15.94:0/1067258913 >> v1:172.21.15.94:6789/0 conn(0x7f152814ffa0 legacy=0x7f15280c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:56.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f152559a640 1 -- 172.21.15.94:0/1067258913 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3153604517 0 0) 0x7f15280c5d70 con 0x7f152814ffa0 2024-04-25T12:24:56.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f152659c640 1 -- 172.21.15.94:0/1067258913 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15280c6610 con 0x7f152814fbc0 2024-04-25T12:24:56.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f1526d9d640 1 --2- 172.21.15.94:0/1067258913 >> v2:172.21.15.111:3300/0 conn(0x7f1528074100 0x7f15280c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:56.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f152659c640 1 --2- 172.21.15.94:0/1067258913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f152814fbc0 0x7f152806f700 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1520009e50 tx=0x7f152001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c77fc27e0b9237b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:56.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f152559a640 1 -- 172.21.15.94:0/1067258913 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15200a58e0 con 0x7f152814fbc0 2024-04-25T12:24:56.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f152559a640 1 -- 172.21.15.94:0/1067258913 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15200a5a80 con 0x7f152814fbc0 2024-04-25T12:24:56.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f152559a640 1 -- 172.21.15.94:0/1067258913 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15200a5e50 con 0x7f152814fbc0 2024-04-25T12:24:56.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f152c9d9640 1 -- 172.21.15.94:0/1067258913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f152814fbc0 msgr2=0x7f152806f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:56.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f152c9d9640 1 --2- 172.21.15.94:0/1067258913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f152814fbc0 0x7f152806f700 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1520009e50 tx=0x7f152001c9f0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f152c9d9640 1 -- 172.21.15.94:0/1067258913 shutdown_connections 2024-04-25T12:24:56.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f152c9d9640 1 --2- 172.21.15.94:0/1067258913 >> v2:172.21.15.111:3300/0 conn(0x7f1528074100 0x7f15280c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f152c9d9640 1 --2- 172.21.15.94:0/1067258913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f152814fbc0 0x7f152806f700 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f152c9d9640 1 -- 172.21.15.94:0/1067258913 >> 172.21.15.94:0/1067258913 conn(0x7f152806b9d0 msgr2=0x7f152806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:56.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f152c9d9640 1 -- 172.21.15.94:0/1067258913 shutdown_connections 2024-04-25T12:24:56.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.426+0000 7f152c9d9640 1 -- 172.21.15.94:0/1067258913 wait complete. 2024-04-25T12:24:56.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.430+0000 7f152c9d9640 1 Processor -- start 2024-04-25T12:24:56.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.430+0000 7f152c9d9640 1 -- start start 2024-04-25T12:24:56.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.430+0000 7f152c9d9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1528074100 0x7f15281f21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:56.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.430+0000 7f152c9d9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f152814fbc0 0x7f15281524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:56.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.430+0000 7f152c9d9640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f152814ffa0 0x7f1528150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:56.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.430+0000 7f152c9d9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f15280c8ab0 con 0x7f1528074100 2024-04-25T12:24:56.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.430+0000 7f152c9d9640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f15280c8930 con 0x7f152814fbc0 2024-04-25T12:24:56.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.430+0000 7f152c9d9640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f1528166090 con 0x7f152814ffa0 2024-04-25T12:24:56.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.430+0000 7f152659c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1528074100 0x7f15281f21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:56.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.430+0000 7f152659c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1528074100 0x7f15281f21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35970/0 (socket says 172.21.15.94:35970) 2024-04-25T12:24:56.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.430+0000 7f152659c640 1 -- 172.21.15.94:0/3341634824 learned_addr learned my addr 172.21.15.94:0/3341634824 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:56.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.430+0000 7f1525d9b640 1 --2- 172.21.15.94:0/3341634824 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f152814fbc0 0x7f15281524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:56.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.430+0000 7f1526d9d640 1 --2- 172.21.15.94:0/3341634824 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f152814ffa0 0x7f1528150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:56.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.430+0000 7f152659c640 1 -- 172.21.15.94:0/3341634824 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f152814ffa0 msgr2=0x7f1528150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:56.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.430+0000 7f152659c640 1 --2- 172.21.15.94:0/3341634824 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f152814ffa0 0x7f1528150c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.430+0000 7f152659c640 1 -- 172.21.15.94:0/3341634824 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f152814fbc0 msgr2=0x7f15281524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:56.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.430+0000 7f152659c640 1 --2- 172.21.15.94:0/3341634824 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f152814fbc0 0x7f15281524a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.430+0000 7f152659c640 1 -- 172.21.15.94:0/3341634824 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15281529e0 con 0x7f1528074100 2024-04-25T12:24:56.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.430+0000 7f152659c640 1 --2- 172.21.15.94:0/3341634824 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1528074100 0x7f15281f21e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f15200af040 tx=0x7f1520019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:56.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.430+0000 7f1516ffd640 1 -- 172.21.15.94:0/3341634824 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520009510 con 0x7f1528074100 2024-04-25T12:24:56.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.430+0000 7f1516ffd640 1 -- 172.21.15.94:0/3341634824 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15200be070 con 0x7f1528074100 2024-04-25T12:24:56.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.430+0000 7f152c9d9640 1 -- 172.21.15.94:0/3341634824 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15280cc0c0 con 0x7f1528074100 2024-04-25T12:24:56.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.430+0000 7f1516ffd640 1 -- 172.21.15.94:0/3341634824 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15200a58e0 con 0x7f1528074100 2024-04-25T12:24:56.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.430+0000 7f152c9d9640 1 -- 172.21.15.94:0/3341634824 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15280cbde0 con 0x7f1528074100 2024-04-25T12:24:56.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.430+0000 7f152c9d9640 1 -- 172.21.15.94:0/3341634824 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1528075df0 con 0x7f1528074100 2024-04-25T12:24:56.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.430+0000 7f1516ffd640 1 -- 172.21.15.94:0/3341634824 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f15200b86b0 con 0x7f1528074100 2024-04-25T12:24:56.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.434+0000 7f1516ffd640 1 --2- 172.21.15.94:0/3341634824 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f1508068380 0x7f150806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:56.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.434+0000 7f1516ffd640 1 -- 172.21.15.94:0/3341634824 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f1520122330 con 0x7f1528074100 2024-04-25T12:24:56.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.434+0000 7f1525d9b640 1 --2- 172.21.15.94:0/3341634824 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f1508068380 0x7f150806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:56.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.434+0000 7f1525d9b640 1 --2- 172.21.15.94:0/3341634824 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f1508068380 0x7f150806a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f152815d5c0 tx=0x7f151c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:56.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.438+0000 7f1516ffd640 1 -- 172.21.15.94:0/3341634824 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f15200165e0 con 0x7f1528074100 2024-04-25T12:24:56.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.586+0000 7f152c9d9640 1 -- 172.21.15.94:0/3341634824 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f15280c7df0 con 0x7f1528074100 2024-04-25T12:24:56.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.586+0000 7f1516ffd640 1 -- 172.21.15.94:0/3341634824 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7f15200f2600 con 0x7f1528074100 2024-04-25T12:24:56.591 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2024-04-25T12:24:56.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.586+0000 7f152c9d9640 1 -- 172.21.15.94:0/3341634824 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f1508068380 msgr2=0x7f150806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:56.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.586+0000 7f152c9d9640 1 --2- 172.21.15.94:0/3341634824 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f1508068380 0x7f150806a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f152815d5c0 tx=0x7f151c009040 comp rx=0 tx=0).stop 2024-04-25T12:24:56.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.586+0000 7f152c9d9640 1 -- 172.21.15.94:0/3341634824 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1528074100 msgr2=0x7f15281f21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:56.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.586+0000 7f152c9d9640 1 --2- 172.21.15.94:0/3341634824 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1528074100 0x7f15281f21e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f15200af040 tx=0x7f1520019790 comp rx=0 tx=0).stop 2024-04-25T12:24:56.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.586+0000 7f152c9d9640 1 -- 172.21.15.94:0/3341634824 shutdown_connections 2024-04-25T12:24:56.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.586+0000 7f152c9d9640 1 --2- 172.21.15.94:0/3341634824 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f1508068380 0x7f150806a840 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.586+0000 7f152c9d9640 1 --2- 172.21.15.94:0/3341634824 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f152814ffa0 0x7f1528150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.586+0000 7f152c9d9640 1 --2- 172.21.15.94:0/3341634824 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f152814fbc0 0x7f15281524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.586+0000 7f152c9d9640 1 --2- 172.21.15.94:0/3341634824 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1528074100 0x7f15281f21e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.586+0000 7f152c9d9640 1 -- 172.21.15.94:0/3341634824 >> 172.21.15.94:0/3341634824 conn(0x7f152806b9d0 msgr2=0x7f152814a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:56.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.586+0000 7f152c9d9640 1 -- 172.21.15.94:0/3341634824 shutdown_connections 2024-04-25T12:24:56.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.586+0000 7f152c9d9640 1 -- 172.21.15.94:0/3341634824 wait complete. 2024-04-25T12:24:56.610 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T12:24:56.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.718+0000 7f1473782640 1 Processor -- start 2024-04-25T12:24:56.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.718+0000 7f1473782640 1 -- start start 2024-04-25T12:24:56.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.722+0000 7f1473782640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f146c0cda50 0x7f146c0c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:56.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.722+0000 7f1473782640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f146c15bc10 con 0x7f146c155350 2024-04-25T12:24:56.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.722+0000 7f1473782640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f146c15beb0 con 0x7f146c15b0b0 2024-04-25T12:24:56.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.722+0000 7f1473782640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f146c0cca40 con 0x7f146c0cda50 2024-04-25T12:24:56.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.722+0000 7f1470d1d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f146c0cda50 0x7f146c0c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:56.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.722+0000 7f147151e640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f146c155350 0x7f146c0cb7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58432/0 (socket says 172.21.15.94:58432) 2024-04-25T12:24:56.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.722+0000 7f147151e640 1 -- 172.21.15.94:0/2894070113 learned_addr learned my addr 172.21.15.94:0/2894070113 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:56.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.722+0000 7f1470d1d640 1 -- 172.21.15.94:0/2894070113 >> v1:172.21.15.111:6789/0 conn(0x7f146c15b0b0 legacy=0x7f146c15b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:56.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.722+0000 7f1470d1d640 1 -- 172.21.15.94:0/2894070113 >> v1:172.21.15.94:6789/0 conn(0x7f146c155350 legacy=0x7f146c0cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:56.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.722+0000 7f1470d1d640 1 -- 172.21.15.94:0/2894070113 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f146c0ccc90 con 0x7f146c0cda50 2024-04-25T12:24:56.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.722+0000 7f1470d1d640 1 --2- 172.21.15.94:0/2894070113 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f146c0cda50 0x7f146c0c59c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f145c0097c0 tx=0x7f145c01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5074bf66ffdcf39 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:56.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.722+0000 7f1463fff640 1 -- 172.21.15.94:0/2894070113 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c0b5070 con 0x7f146c0cda50 2024-04-25T12:24:56.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.722+0000 7f1463fff640 1 -- 172.21.15.94:0/2894070113 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f145c0a8950 con 0x7f146c0cda50 2024-04-25T12:24:56.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.722+0000 7f1463fff640 1 -- 172.21.15.94:0/2894070113 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c0a8d20 con 0x7f146c0cda50 2024-04-25T12:24:56.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f1473782640 1 -- 172.21.15.94:0/2894070113 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f146c0cda50 msgr2=0x7f146c0c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:56.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f1473782640 1 --2- 172.21.15.94:0/2894070113 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f146c0cda50 0x7f146c0c59c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f145c0097c0 tx=0x7f145c01ec50 comp rx=0 tx=0).stop 2024-04-25T12:24:56.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f1473782640 1 -- 172.21.15.94:0/2894070113 shutdown_connections 2024-04-25T12:24:56.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f1473782640 1 --2- 172.21.15.94:0/2894070113 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f146c0cda50 0x7f146c0c59c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f1473782640 1 -- 172.21.15.94:0/2894070113 >> 172.21.15.94:0/2894070113 conn(0x7f146c06cc30 msgr2=0x7f146c06d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:56.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f1473782640 1 -- 172.21.15.94:0/2894070113 shutdown_connections 2024-04-25T12:24:56.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f1473782640 1 -- 172.21.15.94:0/2894070113 wait complete. 2024-04-25T12:24:56.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f1473782640 1 Processor -- start 2024-04-25T12:24:56.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f1473782640 1 -- start start 2024-04-25T12:24:56.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f1473782640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f146c0cda50 0x7f146c14faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:56.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f1473782640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f146c155350 0x7f146c153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:56.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f1473782640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f146c15b0b0 0x7f146c15c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:56.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f1473782640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f146c0cd530 con 0x7f146c0cda50 2024-04-25T12:24:56.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f1473782640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f146c0cd250 con 0x7f146c15b0b0 2024-04-25T12:24:56.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f1473782640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f146c155730 con 0x7f146c155350 2024-04-25T12:24:56.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f147151e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f146c0cda50 0x7f146c14faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:56.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f147151e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f146c0cda50 0x7f146c14faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35982/0 (socket says 172.21.15.94:35982) 2024-04-25T12:24:56.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f147151e640 1 -- 172.21.15.94:0/1930896975 learned_addr learned my addr 172.21.15.94:0/1930896975 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:56.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f1470d1d640 1 --2- 172.21.15.94:0/1930896975 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f146c155350 0x7f146c153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:56.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f1471d1f640 1 --2- 172.21.15.94:0/1930896975 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f146c15b0b0 0x7f146c15c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:56.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f147151e640 1 -- 172.21.15.94:0/1930896975 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f146c155350 msgr2=0x7f146c153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:56.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f147151e640 1 --2- 172.21.15.94:0/1930896975 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f146c155350 0x7f146c153ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f147151e640 1 -- 172.21.15.94:0/1930896975 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f146c15b0b0 msgr2=0x7f146c15c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:56.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f147151e640 1 --2- 172.21.15.94:0/1930896975 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f146c15b0b0 0x7f146c15c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f147151e640 1 -- 172.21.15.94:0/1930896975 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f146c1f1e80 con 0x7f146c0cda50 2024-04-25T12:24:56.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f147151e640 1 --2- 172.21.15.94:0/1930896975 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f146c0cda50 0x7f146c14faa0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f146800c450 tx=0x7f146800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:56.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f1461ffb640 1 -- 172.21.15.94:0/1930896975 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1468017070 con 0x7f146c0cda50 2024-04-25T12:24:56.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f1461ffb640 1 -- 172.21.15.94:0/1930896975 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1468005cf0 con 0x7f146c0cda50 2024-04-25T12:24:56.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.726+0000 7f1461ffb640 1 -- 172.21.15.94:0/1930896975 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1468007290 con 0x7f146c0cda50 2024-04-25T12:24:56.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.730+0000 7f1473782640 1 -- 172.21.15.94:0/1930896975 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f146c1f1ba0 con 0x7f146c0cda50 2024-04-25T12:24:56.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.730+0000 7f1473782640 1 -- 172.21.15.94:0/1930896975 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f146c15d8e0 con 0x7f146c0cda50 2024-04-25T12:24:56.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.730+0000 7f1473782640 1 -- 172.21.15.94:0/1930896975 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f146c1f1900 con 0x7f146c0cda50 2024-04-25T12:24:56.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.730+0000 7f1461ffb640 1 -- 172.21.15.94:0/1930896975 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f146801a070 con 0x7f146c0cda50 2024-04-25T12:24:56.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.730+0000 7f1461ffb640 1 --2- 172.21.15.94:0/1930896975 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f14500683b0 0x7f145006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:56.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.730+0000 7f1461ffb640 1 -- 172.21.15.94:0/1930896975 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f14680860a0 con 0x7f146c0cda50 2024-04-25T12:24:56.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.730+0000 7f1470d1d640 1 --2- 172.21.15.94:0/1930896975 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f14500683b0 0x7f145006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:56.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.730+0000 7f1470d1d640 1 --2- 172.21.15.94:0/1930896975 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f14500683b0 0x7f145006a870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f145c0b2000 tx=0x7f145c0aa070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:56.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.734+0000 7f1461ffb640 1 -- 172.21.15.94:0/1930896975 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1468056250 con 0x7f146c0cda50 2024-04-25T12:24:56.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.890+0000 7f1473782640 1 -- 172.21.15.94:0/1930896975 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f146c0c7180 con 0x7f146c0cda50 2024-04-25T12:24:56.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.890+0000 7f1461ffb640 1 -- 172.21.15.94:0/1930896975 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7f1468055b50 con 0x7f146c0cda50 2024-04-25T12:24:56.897 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2024-04-25T12:24:56.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.894+0000 7f1473782640 1 -- 172.21.15.94:0/1930896975 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f14500683b0 msgr2=0x7f145006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:56.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.894+0000 7f1473782640 1 --2- 172.21.15.94:0/1930896975 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f14500683b0 0x7f145006a870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f145c0b2000 tx=0x7f145c0aa070 comp rx=0 tx=0).stop 2024-04-25T12:24:56.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.894+0000 7f1473782640 1 -- 172.21.15.94:0/1930896975 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f146c0cda50 msgr2=0x7f146c14faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:56.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.894+0000 7f1473782640 1 --2- 172.21.15.94:0/1930896975 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f146c0cda50 0x7f146c14faa0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f146800c450 tx=0x7f146800c910 comp rx=0 tx=0).stop 2024-04-25T12:24:56.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.894+0000 7f1473782640 1 -- 172.21.15.94:0/1930896975 shutdown_connections 2024-04-25T12:24:56.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.894+0000 7f1473782640 1 --2- 172.21.15.94:0/1930896975 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f14500683b0 0x7f145006a870 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.894+0000 7f1473782640 1 --2- 172.21.15.94:0/1930896975 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f146c155350 0x7f146c153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.894+0000 7f1473782640 1 --2- 172.21.15.94:0/1930896975 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f146c15b0b0 0x7f146c15c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.894+0000 7f1473782640 1 --2- 172.21.15.94:0/1930896975 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f146c0cda50 0x7f146c14faa0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:56.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.894+0000 7f1473782640 1 -- 172.21.15.94:0/1930896975 >> 172.21.15.94:0/1930896975 conn(0x7f146c06cc30 msgr2=0x7f146c0cf680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:56.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.894+0000 7f1473782640 1 -- 172.21.15.94:0/1930896975 shutdown_connections 2024-04-25T12:24:56.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:56.894+0000 7f1473782640 1 -- 172.21.15.94:0/1930896975 wait complete. 2024-04-25T12:24:56.914 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T12:24:57.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.014+0000 7fa0e1d14640 1 Processor -- start 2024-04-25T12:24:57.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.014+0000 7fa0e1d14640 1 -- start start 2024-04-25T12:24:57.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.014+0000 7fa0e1d14640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa0dc152270 0x7fa0dc1587b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:57.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.018+0000 7fa0e1d14640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa0dc072700 0x7fa0dc072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:57.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.018+0000 7fa0e1d14640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0dc073090 con 0x7fa0dc06d690 2024-04-25T12:24:57.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.018+0000 7fa0e1d14640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fa0dc0c81e0 con 0x7fa0dc072700 2024-04-25T12:24:57.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.018+0000 7fa0e1d14640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fa0dc0c84c0 con 0x7fa0dc152270 2024-04-25T12:24:57.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.018+0000 7fa0dbfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa0dc072700 0x7fa0dc072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:57.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.018+0000 7fa0daffd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fa0dc06d690 0x7fa0dc06cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58436/0 (socket says 172.21.15.94:58436) 2024-04-25T12:24:57.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.018+0000 7fa0dbfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa0dc072700 0x7fa0dc072b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35990/0 (socket says 172.21.15.94:35990) 2024-04-25T12:24:57.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.018+0000 7fa0daffd640 1 -- 172.21.15.94:0/3844775796 learned_addr learned my addr 172.21.15.94:0/3844775796 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:57.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.018+0000 7fa0db7fe640 1 --2- 172.21.15.94:0/3844775796 >> v2:172.21.15.111:3300/0 conn(0x7fa0dc152270 0x7fa0dc1587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:57.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.018+0000 7fa0dbfff640 1 -- 172.21.15.94:0/3844775796 >> v2:172.21.15.111:3300/0 conn(0x7fa0dc152270 msgr2=0x7fa0dc1587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:57.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.018+0000 7fa0dbfff640 1 --2- 172.21.15.94:0/3844775796 >> v2:172.21.15.111:3300/0 conn(0x7fa0dc152270 0x7fa0dc1587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:57.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.018+0000 7fa0dbfff640 1 -- 172.21.15.94:0/3844775796 >> v1:172.21.15.94:6789/0 conn(0x7fa0dc06d690 legacy=0x7fa0dc06cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:57.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.018+0000 7fa0dbfff640 1 -- 172.21.15.94:0/3844775796 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0dc0c87a0 con 0x7fa0dc072700 2024-04-25T12:24:57.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.018+0000 7fa0db7fe640 1 --2- 172.21.15.94:0/3844775796 >> v2:172.21.15.111:3300/0 conn(0x7fa0dc152270 0x7fa0dc1587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:57.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.018+0000 7fa0dbfff640 1 --2- 172.21.15.94:0/3844775796 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0dc072700 0x7fa0dc072b50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc070a30 tx=0x7fa0d401eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba4492006e8b41e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:57.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.018+0000 7fa0da7fc640 1 -- 172.21.15.94:0/3844775796 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d40b4070 con 0x7fa0dc072700 2024-04-25T12:24:57.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.018+0000 7fa0da7fc640 1 -- 172.21.15.94:0/3844775796 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0d40a7880 con 0x7fa0dc072700 2024-04-25T12:24:57.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.018+0000 7fa0da7fc640 1 -- 172.21.15.94:0/3844775796 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d40a7c50 con 0x7fa0dc072700 2024-04-25T12:24:57.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.018+0000 7fa0e1d14640 1 -- 172.21.15.94:0/3844775796 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0dc072700 msgr2=0x7fa0dc072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:57.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.018+0000 7fa0e1d14640 1 --2- 172.21.15.94:0/3844775796 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0dc072700 0x7fa0dc072b50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc070a30 tx=0x7fa0d401eab0 comp rx=0 tx=0).stop 2024-04-25T12:24:57.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.018+0000 7fa0e1d14640 1 -- 172.21.15.94:0/3844775796 shutdown_connections 2024-04-25T12:24:57.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.018+0000 7fa0e1d14640 1 --2- 172.21.15.94:0/3844775796 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0dc072700 0x7fa0dc072b50 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:57.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.018+0000 7fa0e1d14640 1 --2- 172.21.15.94:0/3844775796 >> v2:172.21.15.111:3300/0 conn(0x7fa0dc152270 0x7fa0dc1587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:57.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.018+0000 7fa0e1d14640 1 -- 172.21.15.94:0/3844775796 >> 172.21.15.94:0/3844775796 conn(0x7fa0dc0ca0d0 msgr2=0x7fa0dc0ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:57.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.018+0000 7fa0e1d14640 1 -- 172.21.15.94:0/3844775796 shutdown_connections 2024-04-25T12:24:57.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.018+0000 7fa0e1d14640 1 -- 172.21.15.94:0/3844775796 wait complete. 2024-04-25T12:24:57.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0e1d14640 1 Processor -- start 2024-04-25T12:24:57.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0e1d14640 1 -- start start 2024-04-25T12:24:57.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0e1d14640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0dc06d690 0x7fa0dc15a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:57.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0e1d14640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa0dc072700 0x7fa0dc1f0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:57.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0e1d14640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0dc152270 0x7fa0dc1f3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:57.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0e1d14640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa0dc0724e0 con 0x7fa0dc06d690 2024-04-25T12:24:57.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0e1d14640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa0dc072360 con 0x7fa0dc152270 2024-04-25T12:24:57.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0e1d14640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa0dc06d1f0 con 0x7fa0dc072700 2024-04-25T12:24:57.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0db7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0dc06d690 0x7fa0dc15a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:57.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0db7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0dc06d690 0x7fa0dc15a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36006/0 (socket says 172.21.15.94:36006) 2024-04-25T12:24:57.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0db7fe640 1 -- 172.21.15.94:0/1798365906 learned_addr learned my addr 172.21.15.94:0/1798365906 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:57.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0db7fe640 1 -- 172.21.15.94:0/1798365906 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa0dc072700 msgr2=0x7fa0dc1f0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:57.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0db7fe640 1 --2- 172.21.15.94:0/1798365906 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa0dc072700 0x7fa0dc1f0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:57.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0db7fe640 1 -- 172.21.15.94:0/1798365906 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0dc152270 msgr2=0x7fa0dc1f3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:57.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0db7fe640 1 --2- 172.21.15.94:0/1798365906 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0dc152270 0x7fa0dc1f3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:57.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0db7fe640 1 -- 172.21.15.94:0/1798365906 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0dc1ef8c0 con 0x7fa0dc06d690 2024-04-25T12:24:57.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0db7fe640 1 --2- 172.21.15.94:0/1798365906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0dc06d690 0x7fa0dc15a450 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00c7f0 tx=0x7fa0cc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:57.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0c3fff640 1 -- 172.21.15.94:0/1798365906 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc015070 con 0x7fa0dc06d690 2024-04-25T12:24:57.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0c3fff640 1 -- 172.21.15.94:0/1798365906 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0cc007820 con 0x7fa0dc06d690 2024-04-25T12:24:57.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0e1d14640 1 -- 172.21.15.94:0/1798365906 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0dc14db30 con 0x7fa0dc06d690 2024-04-25T12:24:57.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0c3fff640 1 -- 172.21.15.94:0/1798365906 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc007c10 con 0x7fa0dc06d690 2024-04-25T12:24:57.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0e1d14640 1 -- 172.21.15.94:0/1798365906 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0dc14e0f0 con 0x7fa0dc06d690 2024-04-25T12:24:57.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0e1d14640 1 -- 172.21.15.94:0/1798365906 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0dc075df0 con 0x7fa0dc06d690 2024-04-25T12:24:57.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0c3fff640 1 -- 172.21.15.94:0/1798365906 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa0cc018070 con 0x7fa0dc06d690 2024-04-25T12:24:57.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0c3fff640 1 --2- 172.21.15.94:0/1798365906 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa0c80683b0 0x7fa0c806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:57.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0c3fff640 1 -- 172.21.15.94:0/1798365906 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fa0cc086bf0 con 0x7fa0dc06d690 2024-04-25T12:24:57.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.022+0000 7fa0daffd640 1 --2- 172.21.15.94:0/1798365906 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa0c80683b0 0x7fa0c806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:57.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.026+0000 7fa0daffd640 1 --2- 172.21.15.94:0/1798365906 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa0c80683b0 0x7fa0c806a870 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0000f70 tx=0x7fa0d0007a90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:57.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.030+0000 7fa0c3fff640 1 -- 172.21.15.94:0/1798365906 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa0cc056e50 con 0x7fa0dc06d690 2024-04-25T12:24:57.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.190+0000 7fa0e1d14640 1 -- 172.21.15.94:0/1798365906 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa0dc06dd50 con 0x7fa0dc06d690 2024-04-25T12:24:57.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.190+0000 7fa0c3fff640 1 -- 172.21.15.94:0/1798365906 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7fa0cc056750 con 0x7fa0dc06d690 2024-04-25T12:24:57.196 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2024-04-25T12:24:57.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.194+0000 7fa0e1d14640 1 -- 172.21.15.94:0/1798365906 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa0c80683b0 msgr2=0x7fa0c806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:57.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.194+0000 7fa0e1d14640 1 --2- 172.21.15.94:0/1798365906 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa0c80683b0 0x7fa0c806a870 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0000f70 tx=0x7fa0d0007a90 comp rx=0 tx=0).stop 2024-04-25T12:24:57.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.194+0000 7fa0e1d14640 1 -- 172.21.15.94:0/1798365906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0dc06d690 msgr2=0x7fa0dc15a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:57.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.194+0000 7fa0e1d14640 1 --2- 172.21.15.94:0/1798365906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0dc06d690 0x7fa0dc15a450 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00c7f0 tx=0x7fa0cc00ccb0 comp rx=0 tx=0).stop 2024-04-25T12:24:57.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.194+0000 7fa0e1d14640 1 -- 172.21.15.94:0/1798365906 shutdown_connections 2024-04-25T12:24:57.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.194+0000 7fa0e1d14640 1 --2- 172.21.15.94:0/1798365906 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa0c80683b0 0x7fa0c806a870 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:57.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.194+0000 7fa0e1d14640 1 --2- 172.21.15.94:0/1798365906 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa0dc072700 0x7fa0dc1f0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:57.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.194+0000 7fa0e1d14640 1 --2- 172.21.15.94:0/1798365906 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0dc152270 0x7fa0dc1f3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:57.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.194+0000 7fa0e1d14640 1 --2- 172.21.15.94:0/1798365906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0dc06d690 0x7fa0dc15a450 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:57.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.194+0000 7fa0e1d14640 1 -- 172.21.15.94:0/1798365906 >> 172.21.15.94:0/1798365906 conn(0x7fa0dc0ca0d0 msgr2=0x7fa0dc151490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:57.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.194+0000 7fa0e1d14640 1 -- 172.21.15.94:0/1798365906 shutdown_connections 2024-04-25T12:24:57.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.194+0000 7fa0e1d14640 1 -- 172.21.15.94:0/1798365906 wait complete. 2024-04-25T12:24:57.215 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi094.front.sepia.ceph.com... 2024-04-25T12:24:57.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:57.215 DEBUG:teuthology.orchestra.run.smithi094:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-25T12:24:57.225 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[35023]: fuse finished with error 0 and tester_r 0 2024-04-25T12:24:57.226 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:24:57.247 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2024-04-25T12:24:57.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:57.247 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T12:24:57.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:57.294 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2024-04-25T12:24:57.341 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T12:24:57.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:57.342 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T12:24:57.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:24:57.397 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link delete ceph-brx 2024-04-25T12:24:57.540 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T12:24:57.550 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T12:24:57.551 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:24:57.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.670+0000 7f62eb809640 1 Processor -- start 2024-04-25T12:24:57.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.670+0000 7f62eb809640 1 -- start start 2024-04-25T12:24:57.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62eb809640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62e40cda50 0x7f62e40c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:57.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62eb809640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f62e415b0b0 0x7f62e415b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:57.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62eb809640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62e415beb0 con 0x7f62e4155350 2024-04-25T12:24:57.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62eb809640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f62e40cca40 con 0x7f62e415b0b0 2024-04-25T12:24:57.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62eb809640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f62e40ccc90 con 0x7f62e40cda50 2024-04-25T12:24:57.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62e95a5640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f62e4155350 0x7f62e40cb7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58438/0 (socket says 172.21.15.94:58438) 2024-04-25T12:24:57.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62e95a5640 1 -- 172.21.15.94:0/291427607 learned_addr learned my addr 172.21.15.94:0/291427607 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:57.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62dbfff640 1 -- 172.21.15.94:0/291427607 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1079622523 0 0) 0x7f62e415beb0 con 0x7f62e4155350 2024-04-25T12:24:57.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62e9da6640 1 --2- 172.21.15.94:0/291427607 >> v2:172.21.15.111:3300/0 conn(0x7f62e415b0b0 0x7f62e415b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:57.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62e8da4640 1 --2- 172.21.15.94:0/291427607 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62e40cda50 0x7f62e40c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:57.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62dbfff640 1 -- 172.21.15.94:0/291427607 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62d0003530 con 0x7f62e4155350 2024-04-25T12:24:57.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62dbfff640 1 -- 172.21.15.94:0/291427607 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1489908647 0 0) 0x7f62d0003530 con 0x7f62e4155350 2024-04-25T12:24:57.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62dbfff640 1 -- 172.21.15.94:0/291427607 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62e40cda50 msgr2=0x7f62e40c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:57.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62dbfff640 1 --2- 172.21.15.94:0/291427607 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62e40cda50 0x7f62e40c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:57.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62dbfff640 1 -- 172.21.15.94:0/291427607 >> v2:172.21.15.111:3300/0 conn(0x7f62e415b0b0 msgr2=0x7f62e415b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:57.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62dbfff640 1 --2- 172.21.15.94:0/291427607 >> v2:172.21.15.111:3300/0 conn(0x7f62e415b0b0 0x7f62e415b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:57.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62dbfff640 1 -- 172.21.15.94:0/291427607 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e40ccf70 con 0x7f62e4155350 2024-04-25T12:24:57.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62dbfff640 1 -- 172.21.15.94:0/291427607 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7f62dc001680 con 0x7f62e4155350 2024-04-25T12:24:57.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62dbfff640 1 -- 172.21.15.94:0/291427607 >> v1:172.21.15.94:6789/0 conn(0x7f62e4155350 legacy=0x7f62e40cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:57.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62dbfff640 1 --2- 172.21.15.94:0/291427607 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62e40cda50 0x7f62d00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:57.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62dbfff640 1 --2- 172.21.15.94:0/291427607 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62d0003f40 0x7f62d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:57.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62dbfff640 1 --2- 172.21.15.94:0/291427607 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62d0004d50 0x7f62d00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:57.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62dbfff640 1 -- 172.21.15.94:0/291427607 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f62e40cca40 con 0x7f62d0004d50 2024-04-25T12:24:57.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62dbfff640 1 -- 172.21.15.94:0/291427607 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f62e40ccc90 con 0x7f62d0003f40 2024-04-25T12:24:57.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62dbfff640 1 -- 172.21.15.94:0/291427607 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f62d000bab0 con 0x7f62e40cda50 2024-04-25T12:24:57.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62e9da6640 1 --2- 172.21.15.94:0/291427607 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62d0004d50 0x7f62d00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:57.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62e8da4640 1 --2- 172.21.15.94:0/291427607 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62d0003f40 0x7f62d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:57.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62e95a5640 1 --2- 172.21.15.94:0/291427607 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62e40cda50 0x7f62d00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:57.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62e9da6640 1 -- 172.21.15.94:0/291427607 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62e40cda50 msgr2=0x7f62d00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:57.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62e9da6640 1 --2- 172.21.15.94:0/291427607 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62e40cda50 0x7f62d00039c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:57.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62e9da6640 1 -- 172.21.15.94:0/291427607 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62d0003f40 msgr2=0x7f62d0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:57.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62e9da6640 1 --2- 172.21.15.94:0/291427607 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62d0003f40 0x7f62d0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:57.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62e9da6640 1 -- 172.21.15.94:0/291427607 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d0003530 con 0x7f62d0004d50 2024-04-25T12:24:57.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62e8da4640 1 --2- 172.21.15.94:0/291427607 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62d0003f40 0x7f62d0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:57.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62e9da6640 1 --2- 172.21.15.94:0/291427607 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62d0004d50 0x7f62d00051d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f62e0007360 tx=0x7f62e001ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf45847a7d3391 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:57.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62dbfff640 1 -- 172.21.15.94:0/291427607 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e00b2070 con 0x7f62d0004d50 2024-04-25T12:24:57.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62dbfff640 1 -- 172.21.15.94:0/291427607 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e00a5d80 con 0x7f62d0004d50 2024-04-25T12:24:57.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.674+0000 7f62dbfff640 1 -- 172.21.15.94:0/291427607 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e0009be0 con 0x7f62d0004d50 2024-04-25T12:24:57.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62eb809640 1 -- 172.21.15.94:0/291427607 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62d0004d50 msgr2=0x7f62d00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:57.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62eb809640 1 --2- 172.21.15.94:0/291427607 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62d0004d50 0x7f62d00051d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f62e0007360 tx=0x7f62e001ce80 comp rx=0 tx=0).stop 2024-04-25T12:24:57.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62e9da6640 1 -- 172.21.15.94:0/291427607 reap_dead start 2024-04-25T12:24:57.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62eb809640 1 -- 172.21.15.94:0/291427607 shutdown_connections 2024-04-25T12:24:57.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62eb809640 1 -- 172.21.15.94:0/291427607 >> 172.21.15.94:0/291427607 conn(0x7f62e406cc30 msgr2=0x7f62e406d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:57.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62eb809640 1 -- 172.21.15.94:0/291427607 shutdown_connections 2024-04-25T12:24:57.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62eb809640 1 -- 172.21.15.94:0/291427607 wait complete. 2024-04-25T12:24:57.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62eb809640 1 Processor -- start 2024-04-25T12:24:57.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62eb809640 1 -- start start 2024-04-25T12:24:57.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62eb809640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62d0004d50 0x7f62e414b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:57.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62eb809640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62e4155e30 0x7f62e40d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:57.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62eb809640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62e40cf2e0 0x7f62e40d0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:57.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62eb809640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f62e4155730 con 0x7f62e40cf2e0 2024-04-25T12:24:57.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62eb809640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f62e40cd530 con 0x7f62e4155e30 2024-04-25T12:24:57.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62eb809640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f62e415e860 con 0x7f62d0004d50 2024-04-25T12:24:57.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62e9da6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62e40cf2e0 0x7f62e40d0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:57.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62e9da6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62e40cf2e0 0x7f62e40d0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36026/0 (socket says 172.21.15.94:36026) 2024-04-25T12:24:57.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62e9da6640 1 -- 172.21.15.94:0/3337752479 learned_addr learned my addr 172.21.15.94:0/3337752479 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:57.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62e8da4640 1 --2- 172.21.15.94:0/3337752479 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62e4155e30 0x7f62e40d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:57.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62e95a5640 1 --2- 172.21.15.94:0/3337752479 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62d0004d50 0x7f62e414b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:57.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62e9da6640 1 -- 172.21.15.94:0/3337752479 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62d0004d50 msgr2=0x7f62e414b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:57.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62e9da6640 1 --2- 172.21.15.94:0/3337752479 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62d0004d50 0x7f62e414b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:57.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62e9da6640 1 -- 172.21.15.94:0/3337752479 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62e4155e30 msgr2=0x7f62e40d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:57.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62e9da6640 1 --2- 172.21.15.94:0/3337752479 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62e4155e30 0x7f62e40d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:57.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62e9da6640 1 -- 172.21.15.94:0/3337752479 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e41f17d0 con 0x7f62e40cf2e0 2024-04-25T12:24:57.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62e95a5640 1 --2- 172.21.15.94:0/3337752479 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62d0004d50 0x7f62e414b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:57.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62e9da6640 1 --2- 172.21.15.94:0/3337752479 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62e40cf2e0 0x7f62e40d0e00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f62e00b0040 tx=0x7f62d0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:57.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62d9ffb640 1 -- 172.21.15.94:0/3337752479 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e00b2040 con 0x7f62e40cf2e0 2024-04-25T12:24:57.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62d9ffb640 1 -- 172.21.15.94:0/3337752479 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e00a5b80 con 0x7f62e40cf2e0 2024-04-25T12:24:57.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62eb809640 1 -- 172.21.15.94:0/3337752479 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62e41f14f0 con 0x7f62e40cf2e0 2024-04-25T12:24:57.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62d9ffb640 1 -- 172.21.15.94:0/3337752479 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e0009be0 con 0x7f62e40cf2e0 2024-04-25T12:24:57.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.678+0000 7f62eb809640 1 -- 172.21.15.94:0/3337752479 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62e40cecb0 con 0x7f62e40cf2e0 2024-04-25T12:24:57.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.682+0000 7f62eb809640 1 -- 172.21.15.94:0/3337752479 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62e4075df0 con 0x7f62e40cf2e0 2024-04-25T12:24:57.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.682+0000 7f62d9ffb640 1 -- 172.21.15.94:0/3337752479 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f62e00b8420 con 0x7f62e40cf2e0 2024-04-25T12:24:57.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.682+0000 7f62d9ffb640 1 --2- 172.21.15.94:0/3337752479 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f62c80683b0 0x7f62c806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:57.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.682+0000 7f62e95a5640 1 --2- 172.21.15.94:0/3337752479 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f62c80683b0 0x7f62c806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:57.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.682+0000 7f62d9ffb640 1 -- 172.21.15.94:0/3337752479 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f62e01214d0 con 0x7f62e40cf2e0 2024-04-25T12:24:57.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.682+0000 7f62e95a5640 1 --2- 172.21.15.94:0/3337752479 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f62c80683b0 0x7f62c806a870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f62dc001060 tx=0x7f62dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:57.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.686+0000 7f62d9ffb640 1 -- 172.21.15.94:0/3337752479 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f62e0016b90 con 0x7f62e40cf2e0 2024-04-25T12:24:57.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.842+0000 7f62eb809640 1 -- 172.21.15.94:0/3337752479 --> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f62e40cc610 con 0x7f62c80683b0 2024-04-25T12:24:57.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.854+0000 7f62d9ffb640 1 -- 172.21.15.94:0/3337752479 <== mgr.4101 v2:172.21.15.94:6832/549402167 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332671 (secure 0 0 0) 0x7f62e40cc610 con 0x7f62c80683b0 2024-04-25T12:24:57.861 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:57.864 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-04-25T12:24:57.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.858+0000 7f62eb809640 1 -- 172.21.15.94:0/3337752479 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f62c80683b0 msgr2=0x7f62c806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:57.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.858+0000 7f62eb809640 1 --2- 172.21.15.94:0/3337752479 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f62c80683b0 0x7f62c806a870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f62dc001060 tx=0x7f62dc009040 comp rx=0 tx=0).stop 2024-04-25T12:24:57.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.858+0000 7f62eb809640 1 -- 172.21.15.94:0/3337752479 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62e40cf2e0 msgr2=0x7f62e40d0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:57.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.858+0000 7f62eb809640 1 --2- 172.21.15.94:0/3337752479 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62e40cf2e0 0x7f62e40d0e00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f62e00b0040 tx=0x7f62d0005840 comp rx=0 tx=0).stop 2024-04-25T12:24:57.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.858+0000 7f62eb809640 1 -- 172.21.15.94:0/3337752479 shutdown_connections 2024-04-25T12:24:57.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.858+0000 7f62eb809640 1 --2- 172.21.15.94:0/3337752479 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f62c80683b0 0x7f62c806a870 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:57.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.858+0000 7f62eb809640 1 --2- 172.21.15.94:0/3337752479 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62e40cf2e0 0x7f62e40d0e00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:57.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.858+0000 7f62eb809640 1 --2- 172.21.15.94:0/3337752479 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62e4155e30 0x7f62e40d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:57.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.858+0000 7f62eb809640 1 --2- 172.21.15.94:0/3337752479 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62d0004d50 0x7f62e414b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:57.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.858+0000 7f62eb809640 1 -- 172.21.15.94:0/3337752479 >> 172.21.15.94:0/3337752479 conn(0x7f62e406cc30 msgr2=0x7f62e40c6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:57.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.858+0000 7f62eb809640 1 -- 172.21.15.94:0/3337752479 shutdown_connections 2024-04-25T12:24:57.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:57.858+0000 7f62eb809640 1 -- 172.21.15.94:0/3337752479 wait complete. 2024-04-25T12:24:57.879 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2024-04-25T12:24:57.816707+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602396,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":375,"num_write_kb":2490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307,"ondisk_log_size":307,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236456,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738264,"statfs":{"total":773094113280,"available":772851982336,"internally_reserved":0,"allocated":3776512,"data_stored":2163352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3058,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004428"},"pg_stats":[{"pgid":"2.1f","version":"28'13","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.915197+0000","last_change":"2024-04-25T12:21:53.194776+0000","last_active":"2024-04-25T12:24:43.915197+0000","last_peered":"2024-04-25T12:24:43.915197+0000","last_clean":"2024-04-25T12:24:43.915197+0000","last_became_active":"2024-04-25T12:21:53.194480+0000","last_became_peered":"2024-04-25T12:21:53.194480+0000","last_unstale":"2024-04-25T12:24:43.915197+0000","last_undegraded":"2024-04-25T12:24:43.915197+0000","last_fullsized":"2024-04-25T12:24:43.915197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:52.906255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979743+0000","last_change":"2024-04-25T12:21:54.200481+0000","last_active":"2024-04-25T12:22:34.979743+0000","last_peered":"2024-04-25T12:22:34.979743+0000","last_clean":"2024-04-25T12:22:34.979743+0000","last_became_active":"2024-04-25T12:21:54.199679+0000","last_became_peered":"2024-04-25T12:21:54.199679+0000","last_unstale":"2024-04-25T12:22:34.979743+0000","last_undegraded":"2024-04-25T12:22:34.979743+0000","last_fullsized":"2024-04-25T12:22:34.979743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:59.395265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978348+0000","last_change":"2024-04-25T12:21:58.346732+0000","last_active":"2024-04-25T12:22:34.978348+0000","last_peered":"2024-04-25T12:22:34.978348+0000","last_clean":"2024-04-25T12:22:34.978348+0000","last_became_active":"2024-04-25T12:21:58.346337+0000","last_became_peered":"2024-04-25T12:21:58.346337+0000","last_unstale":"2024-04-25T12:22:34.978348+0000","last_undegraded":"2024-04-25T12:22:34.978348+0000","last_fullsized":"2024-04-25T12:22:34.978348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:20.028661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:23:54.774933+0000","last_change":"2024-04-25T12:21:53.166281+0000","last_active":"2024-04-25T12:23:54.774933+0000","last_peered":"2024-04-25T12:23:54.774933+0000","last_clean":"2024-04-25T12:23:54.774933+0000","last_became_active":"2024-04-25T12:21:53.165990+0000","last_became_peered":"2024-04-25T12:21:53.165990+0000","last_unstale":"2024-04-25T12:23:54.774933+0000","last_undegraded":"2024-04-25T12:23:54.774933+0000","last_fullsized":"2024-04-25T12:23:54.774933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:07.228743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916094+0000","last_change":"2024-04-25T12:21:54.189754+0000","last_active":"2024-04-25T12:22:34.916094+0000","last_peered":"2024-04-25T12:22:34.916094+0000","last_clean":"2024-04-25T12:22:34.916094+0000","last_became_active":"2024-04-25T12:21:54.188987+0000","last_became_peered":"2024-04-25T12:21:54.188987+0000","last_unstale":"2024-04-25T12:22:34.916094+0000","last_undegraded":"2024-04-25T12:22:34.916094+0000","last_fullsized":"2024-04-25T12:22:34.916094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:29.603368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.892805+0000","last_change":"2024-04-25T12:21:58.251628+0000","last_active":"2024-04-25T12:22:34.892805+0000","last_peered":"2024-04-25T12:22:34.892805+0000","last_clean":"2024-04-25T12:22:34.892805+0000","last_became_active":"2024-04-25T12:21:58.250542+0000","last_became_peered":"2024-04-25T12:21:58.250542+0000","last_unstale":"2024-04-25T12:22:34.892805+0000","last_undegraded":"2024-04-25T12:22:34.892805+0000","last_fullsized":"2024-04-25T12:22:34.892805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:33.434685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'12","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.918854+0000","last_change":"2024-04-25T12:21:53.203427+0000","last_active":"2024-04-25T12:24:43.918854+0000","last_peered":"2024-04-25T12:24:43.918854+0000","last_clean":"2024-04-25T12:24:43.918854+0000","last_became_active":"2024-04-25T12:21:53.202760+0000","last_became_peered":"2024-04-25T12:21:53.202760+0000","last_unstale":"2024-04-25T12:24:43.918854+0000","last_undegraded":"2024-04-25T12:24:43.918854+0000","last_fullsized":"2024-04-25T12:24:43.918854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:44.397450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887718+0000","last_change":"2024-04-25T12:21:54.208420+0000","last_active":"2024-04-25T12:22:34.887718+0000","last_peered":"2024-04-25T12:22:34.887718+0000","last_clean":"2024-04-25T12:22:34.887718+0000","last_became_active":"2024-04-25T12:21:54.208093+0000","last_became_peered":"2024-04-25T12:21:54.208093+0000","last_unstale":"2024-04-25T12:22:34.887718+0000","last_undegraded":"2024-04-25T12:22:34.887718+0000","last_fullsized":"2024-04-25T12:22:34.887718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:08.762268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893123+0000","last_change":"2024-04-25T12:21:58.255963+0000","last_active":"2024-04-25T12:22:34.893123+0000","last_peered":"2024-04-25T12:22:34.893123+0000","last_clean":"2024-04-25T12:22:34.893123+0000","last_became_active":"2024-04-25T12:21:58.254021+0000","last_became_peered":"2024-04-25T12:21:58.254021+0000","last_unstale":"2024-04-25T12:22:34.893123+0000","last_undegraded":"2024-04-25T12:22:34.893123+0000","last_fullsized":"2024-04-25T12:22:34.893123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:20.528034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.916352+0000","last_change":"2024-04-25T12:21:53.208470+0000","last_active":"2024-04-25T12:24:43.916352+0000","last_peered":"2024-04-25T12:24:43.916352+0000","last_clean":"2024-04-25T12:24:43.916352+0000","last_became_active":"2024-04-25T12:21:53.207929+0000","last_became_peered":"2024-04-25T12:21:53.207929+0000","last_unstale":"2024-04-25T12:24:43.916352+0000","last_undegraded":"2024-04-25T12:24:43.916352+0000","last_fullsized":"2024-04-25T12:24:43.916352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:14.904832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887684+0000","last_change":"2024-04-25T12:21:54.206567+0000","last_active":"2024-04-25T12:22:34.887684+0000","last_peered":"2024-04-25T12:22:34.887684+0000","last_clean":"2024-04-25T12:22:34.887684+0000","last_became_active":"2024-04-25T12:21:54.206138+0000","last_became_peered":"2024-04-25T12:21:54.206138+0000","last_unstale":"2024-04-25T12:22:34.887684+0000","last_undegraded":"2024-04-25T12:22:34.887684+0000","last_fullsized":"2024-04-25T12:22:34.887684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:31.698845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893399+0000","last_change":"2024-04-25T12:21:58.245331+0000","last_active":"2024-04-25T12:22:34.893399+0000","last_peered":"2024-04-25T12:22:34.893399+0000","last_clean":"2024-04-25T12:22:34.893399+0000","last_became_active":"2024-04-25T12:21:58.244313+0000","last_became_peered":"2024-04-25T12:21:58.244313+0000","last_unstale":"2024-04-25T12:22:34.893399+0000","last_undegraded":"2024-04-25T12:22:34.893399+0000","last_fullsized":"2024-04-25T12:22:34.893399+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:21.595492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029274+0000","last_change":"2024-04-25T12:21:54.208935+0000","last_active":"2024-04-25T12:22:35.029274+0000","last_peered":"2024-04-25T12:22:35.029274+0000","last_clean":"2024-04-25T12:22:35.029274+0000","last_became_active":"2024-04-25T12:21:54.208338+0000","last_became_peered":"2024-04-25T12:21:54.208338+0000","last_unstale":"2024-04-25T12:22:35.029274+0000","last_undegraded":"2024-04-25T12:22:35.029274+0000","last_fullsized":"2024-04-25T12:22:35.029274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:08.485037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:25.185372+0000","last_change":"2024-04-25T12:21:53.203519+0000","last_active":"2024-04-25T12:24:25.185372+0000","last_peered":"2024-04-25T12:24:25.185372+0000","last_clean":"2024-04-25T12:24:25.185372+0000","last_became_active":"2024-04-25T12:21:53.197141+0000","last_became_peered":"2024-04-25T12:21:53.197141+0000","last_unstale":"2024-04-25T12:24:25.185372+0000","last_undegraded":"2024-04-25T12:24:25.185372+0000","last_fullsized":"2024-04-25T12:24:25.185372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:03.010472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894179+0000","last_change":"2024-04-25T12:21:58.250871+0000","last_active":"2024-04-25T12:22:34.894179+0000","last_peered":"2024-04-25T12:22:34.894179+0000","last_clean":"2024-04-25T12:22:34.894179+0000","last_became_active":"2024-04-25T12:21:58.249079+0000","last_became_peered":"2024-04-25T12:21:58.249079+0000","last_unstale":"2024-04-25T12:22:34.894179+0000","last_undegraded":"2024-04-25T12:22:34.894179+0000","last_fullsized":"2024-04-25T12:22:34.894179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:54.201824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978908+0000","last_change":"2024-04-25T12:21:54.209195+0000","last_active":"2024-04-25T12:22:34.978908+0000","last_peered":"2024-04-25T12:22:34.978908+0000","last_clean":"2024-04-25T12:22:34.978908+0000","last_became_active":"2024-04-25T12:21:54.208802+0000","last_became_peered":"2024-04-25T12:21:54.208802+0000","last_unstale":"2024-04-25T12:22:34.978908+0000","last_undegraded":"2024-04-25T12:22:34.978908+0000","last_fullsized":"2024-04-25T12:22:34.978908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:10.846624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.892354+0000","last_change":"2024-04-25T12:21:53.165498+0000","last_active":"2024-04-25T12:24:37.892354+0000","last_peered":"2024-04-25T12:24:37.892354+0000","last_clean":"2024-04-25T12:24:37.892354+0000","last_became_active":"2024-04-25T12:21:53.164867+0000","last_became_peered":"2024-04-25T12:21:53.164867+0000","last_unstale":"2024-04-25T12:24:37.892354+0000","last_undegraded":"2024-04-25T12:24:37.892354+0000","last_fullsized":"2024-04-25T12:24:37.892354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:07.312761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893517+0000","last_change":"2024-04-25T12:21:58.260620+0000","last_active":"2024-04-25T12:22:34.893517+0000","last_peered":"2024-04-25T12:22:34.893517+0000","last_clean":"2024-04-25T12:22:34.893517+0000","last_became_active":"2024-04-25T12:21:58.259595+0000","last_became_peered":"2024-04-25T12:21:58.259595+0000","last_unstale":"2024-04-25T12:22:34.893517+0000","last_undegraded":"2024-04-25T12:22:34.893517+0000","last_fullsized":"2024-04-25T12:22:34.893517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:43.230479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979100+0000","last_change":"2024-04-25T12:21:54.206960+0000","last_active":"2024-04-25T12:22:34.979100+0000","last_peered":"2024-04-25T12:22:34.979100+0000","last_clean":"2024-04-25T12:22:34.979100+0000","last_became_active":"2024-04-25T12:21:54.204650+0000","last_became_peered":"2024-04-25T12:21:54.204650+0000","last_unstale":"2024-04-25T12:22:34.979100+0000","last_undegraded":"2024-04-25T12:22:34.979100+0000","last_fullsized":"2024-04-25T12:22:34.979100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:15.888865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'7","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.916785+0000","last_change":"2024-04-25T12:21:53.193797+0000","last_active":"2024-04-25T12:24:43.916785+0000","last_peered":"2024-04-25T12:24:43.916785+0000","last_clean":"2024-04-25T12:24:43.916785+0000","last_became_active":"2024-04-25T12:21:53.193466+0000","last_became_peered":"2024-04-25T12:21:53.193466+0000","last_unstale":"2024-04-25T12:24:43.916785+0000","last_undegraded":"2024-04-25T12:24:43.916785+0000","last_fullsized":"2024-04-25T12:24:43.916785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:23.341451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292912+0000","last_change":"2024-04-25T12:21:58.348047+0000","last_active":"2024-04-25T12:22:35.292912+0000","last_peered":"2024-04-25T12:22:35.292912+0000","last_clean":"2024-04-25T12:22:35.292912+0000","last_became_active":"2024-04-25T12:21:58.347583+0000","last_became_peered":"2024-04-25T12:21:58.347583+0000","last_unstale":"2024-04-25T12:22:35.292912+0000","last_undegraded":"2024-04-25T12:22:35.292912+0000","last_fullsized":"2024-04-25T12:22:35.292912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:21:48.878907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894218+0000","last_change":"2024-04-25T12:21:54.196479+0000","last_active":"2024-04-25T12:22:34.894218+0000","last_peered":"2024-04-25T12:22:34.894218+0000","last_clean":"2024-04-25T12:22:34.894218+0000","last_became_active":"2024-04-25T12:21:54.195939+0000","last_became_peered":"2024-04-25T12:21:54.195939+0000","last_unstale":"2024-04-25T12:22:34.894218+0000","last_undegraded":"2024-04-25T12:22:34.894218+0000","last_fullsized":"2024-04-25T12:22:34.894218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:17.787145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:25.185667+0000","last_change":"2024-04-25T12:21:53.198034+0000","last_active":"2024-04-25T12:24:25.185667+0000","last_peered":"2024-04-25T12:24:25.185667+0000","last_clean":"2024-04-25T12:24:25.185667+0000","last_became_active":"2024-04-25T12:21:53.196252+0000","last_became_peered":"2024-04-25T12:21:53.196252+0000","last_unstale":"2024-04-25T12:24:25.185667+0000","last_undegraded":"2024-04-25T12:24:25.185667+0000","last_fullsized":"2024-04-25T12:24:25.185667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:08.329111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.033926+0000","last_change":"2024-04-25T12:22:35.032802+0000","last_active":"2024-04-25T12:22:35.033926+0000","last_peered":"2024-04-25T12:22:35.033926+0000","last_clean":"2024-04-25T12:22:35.033926+0000","last_became_active":"2024-04-25T12:22:35.031906+0000","last_became_peered":"2024-04-25T12:22:35.031906+0000","last_unstale":"2024-04-25T12:22:35.033926+0000","last_undegraded":"2024-04-25T12:22:35.033926+0000","last_fullsized":"2024-04-25T12:22:35.033926+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:40.346041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916736+0000","last_change":"2024-04-25T12:21:54.192601+0000","last_active":"2024-04-25T12:22:34.916736+0000","last_peered":"2024-04-25T12:22:34.916736+0000","last_clean":"2024-04-25T12:22:34.916736+0000","last_became_active":"2024-04-25T12:21:54.191864+0000","last_became_peered":"2024-04-25T12:21:54.191864+0000","last_unstale":"2024-04-25T12:22:34.916736+0000","last_undegraded":"2024-04-25T12:22:34.916736+0000","last_fullsized":"2024-04-25T12:22:34.916736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:50.392769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.916643+0000","last_change":"2024-04-25T12:21:53.197793+0000","last_active":"2024-04-25T12:24:43.916643+0000","last_peered":"2024-04-25T12:24:43.916643+0000","last_clean":"2024-04-25T12:24:43.916643+0000","last_became_active":"2024-04-25T12:21:53.197059+0000","last_became_peered":"2024-04-25T12:21:53.197059+0000","last_unstale":"2024-04-25T12:24:43.916643+0000","last_undegraded":"2024-04-25T12:24:43.916643+0000","last_fullsized":"2024-04-25T12:24:43.916643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:58.471408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893581+0000","last_change":"2024-04-25T12:21:58.355166+0000","last_active":"2024-04-25T12:22:34.893581+0000","last_peered":"2024-04-25T12:22:34.893581+0000","last_clean":"2024-04-25T12:22:34.893581+0000","last_became_active":"2024-04-25T12:21:58.353996+0000","last_became_peered":"2024-04-25T12:21:58.353996+0000","last_unstale":"2024-04-25T12:22:34.893581+0000","last_undegraded":"2024-04-25T12:22:34.893581+0000","last_fullsized":"2024-04-25T12:22:34.893581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:22.681720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980643+0000","last_change":"2024-04-25T12:21:54.219182+0000","last_active":"2024-04-25T12:22:34.980643+0000","last_peered":"2024-04-25T12:22:34.980643+0000","last_clean":"2024-04-25T12:22:34.980643+0000","last_became_active":"2024-04-25T12:21:54.218854+0000","last_became_peered":"2024-04-25T12:21:54.218854+0000","last_unstale":"2024-04-25T12:22:34.980643+0000","last_undegraded":"2024-04-25T12:22:34.980643+0000","last_fullsized":"2024-04-25T12:22:34.980643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:08.985962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'7","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.900945+0000","last_change":"2024-04-25T12:21:53.190102+0000","last_active":"2024-04-25T12:24:37.900945+0000","last_peered":"2024-04-25T12:24:37.900945+0000","last_clean":"2024-04-25T12:24:37.900945+0000","last_became_active":"2024-04-25T12:21:53.189781+0000","last_became_peered":"2024-04-25T12:21:53.189781+0000","last_unstale":"2024-04-25T12:24:37.900945+0000","last_undegraded":"2024-04-25T12:24:37.900945+0000","last_fullsized":"2024-04-25T12:24:37.900945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:52.533217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978106+0000","last_change":"2024-04-25T12:21:58.341932+0000","last_active":"2024-04-25T12:22:34.978106+0000","last_peered":"2024-04-25T12:22:34.978106+0000","last_clean":"2024-04-25T12:22:34.978106+0000","last_became_active":"2024-04-25T12:21:58.341492+0000","last_became_peered":"2024-04-25T12:21:58.341492+0000","last_unstale":"2024-04-25T12:22:34.978106+0000","last_undegraded":"2024-04-25T12:22:34.978106+0000","last_fullsized":"2024-04-25T12:22:34.978106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:51.576036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293382+0000","last_change":"2024-04-25T12:21:54.182541+0000","last_active":"2024-04-25T12:22:35.293382+0000","last_peered":"2024-04-25T12:22:35.293382+0000","last_clean":"2024-04-25T12:22:35.293382+0000","last_became_active":"2024-04-25T12:21:54.181720+0000","last_became_peered":"2024-04-25T12:21:54.181720+0000","last_unstale":"2024-04-25T12:22:35.293382+0000","last_undegraded":"2024-04-25T12:22:35.293382+0000","last_fullsized":"2024-04-25T12:22:35.293382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:00.544076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.893209+0000","last_change":"2024-04-25T12:21:53.200521+0000","last_active":"2024-04-25T12:24:37.893209+0000","last_peered":"2024-04-25T12:24:37.893209+0000","last_clean":"2024-04-25T12:24:37.893209+0000","last_became_active":"2024-04-25T12:21:53.196102+0000","last_became_peered":"2024-04-25T12:21:53.196102+0000","last_unstale":"2024-04-25T12:24:37.893209+0000","last_undegraded":"2024-04-25T12:24:37.893209+0000","last_fullsized":"2024-04-25T12:24:37.893209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:54.350452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916195+0000","last_change":"2024-04-25T12:21:58.342064+0000","last_active":"2024-04-25T12:22:34.916195+0000","last_peered":"2024-04-25T12:22:34.916195+0000","last_clean":"2024-04-25T12:22:34.916195+0000","last_became_active":"2024-04-25T12:21:58.341558+0000","last_became_peered":"2024-04-25T12:21:58.341558+0000","last_unstale":"2024-04-25T12:22:34.916195+0000","last_undegraded":"2024-04-25T12:22:34.916195+0000","last_fullsized":"2024-04-25T12:22:34.916195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:11.378767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887849+0000","last_change":"2024-04-25T12:21:54.206427+0000","last_active":"2024-04-25T12:22:34.887849+0000","last_peered":"2024-04-25T12:22:34.887849+0000","last_clean":"2024-04-25T12:22:34.887849+0000","last_became_active":"2024-04-25T12:21:54.205519+0000","last_became_peered":"2024-04-25T12:21:54.205519+0000","last_unstale":"2024-04-25T12:22:34.887849+0000","last_undegraded":"2024-04-25T12:22:34.887849+0000","last_fullsized":"2024-04-25T12:22:34.887849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:59.659460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:23:59.776320+0000","last_change":"2024-04-25T12:21:53.162914+0000","last_active":"2024-04-25T12:23:59.776320+0000","last_peered":"2024-04-25T12:23:59.776320+0000","last_clean":"2024-04-25T12:23:59.776320+0000","last_became_active":"2024-04-25T12:21:53.162599+0000","last_became_peered":"2024-04-25T12:21:53.162599+0000","last_unstale":"2024-04-25T12:23:59.776320+0000","last_undegraded":"2024-04-25T12:23:59.776320+0000","last_fullsized":"2024-04-25T12:23:59.776320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:23.448280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.920456+0000","last_change":"2024-04-25T12:22:34.919463+0000","last_active":"2024-04-25T12:22:34.920456+0000","last_peered":"2024-04-25T12:22:34.920456+0000","last_clean":"2024-04-25T12:22:34.920456+0000","last_became_active":"2024-04-25T12:22:34.917798+0000","last_became_peered":"2024-04-25T12:22:34.917798+0000","last_unstale":"2024-04-25T12:22:34.920456+0000","last_undegraded":"2024-04-25T12:22:34.920456+0000","last_fullsized":"2024-04-25T12:22:34.920456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:35.620229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894822+0000","last_change":"2024-04-25T12:21:54.202462+0000","last_active":"2024-04-25T12:22:34.894822+0000","last_peered":"2024-04-25T12:22:34.894822+0000","last_clean":"2024-04-25T12:22:34.894822+0000","last_became_active":"2024-04-25T12:21:54.202112+0000","last_became_peered":"2024-04-25T12:21:54.202112+0000","last_unstale":"2024-04-25T12:22:34.894822+0000","last_undegraded":"2024-04-25T12:22:34.894822+0000","last_fullsized":"2024-04-25T12:22:34.894822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:20.813264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.916490+0000","last_change":"2024-04-25T12:21:53.188606+0000","last_active":"2024-04-25T12:24:43.916490+0000","last_peered":"2024-04-25T12:24:43.916490+0000","last_clean":"2024-04-25T12:24:43.916490+0000","last_became_active":"2024-04-25T12:21:53.187855+0000","last_became_peered":"2024-04-25T12:21:53.187855+0000","last_unstale":"2024-04-25T12:24:43.916490+0000","last_undegraded":"2024-04-25T12:24:43.916490+0000","last_fullsized":"2024-04-25T12:24:43.916490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:52.874270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293184+0000","last_change":"2024-04-25T12:21:58.264074+0000","last_active":"2024-04-25T12:22:35.293184+0000","last_peered":"2024-04-25T12:22:35.293184+0000","last_clean":"2024-04-25T12:22:35.293184+0000","last_became_active":"2024-04-25T12:21:58.263425+0000","last_became_peered":"2024-04-25T12:21:58.263425+0000","last_unstale":"2024-04-25T12:22:35.293184+0000","last_undegraded":"2024-04-25T12:22:35.293184+0000","last_fullsized":"2024-04-25T12:22:35.293184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:02.083494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292583+0000","last_change":"2024-04-25T12:21:54.189512+0000","last_active":"2024-04-25T12:22:35.292583+0000","last_peered":"2024-04-25T12:22:35.292583+0000","last_clean":"2024-04-25T12:22:35.292583+0000","last_became_active":"2024-04-25T12:21:54.188587+0000","last_became_peered":"2024-04-25T12:21:54.188587+0000","last_unstale":"2024-04-25T12:22:35.292583+0000","last_undegraded":"2024-04-25T12:22:35.292583+0000","last_fullsized":"2024-04-25T12:22:35.292583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:00.810648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.913498+0000","last_change":"2024-04-25T12:21:53.159998+0000","last_active":"2024-04-25T12:24:43.913498+0000","last_peered":"2024-04-25T12:24:43.913498+0000","last_clean":"2024-04-25T12:24:43.913498+0000","last_became_active":"2024-04-25T12:21:53.159714+0000","last_became_peered":"2024-04-25T12:21:53.159714+0000","last_unstale":"2024-04-25T12:24:43.913498+0000","last_undegraded":"2024-04-25T12:24:43.913498+0000","last_fullsized":"2024-04-25T12:24:43.913498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:38.665874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.983753+0000","last_change":"2024-04-25T12:22:34.982542+0000","last_active":"2024-04-25T12:22:34.983753+0000","last_peered":"2024-04-25T12:22:34.983753+0000","last_clean":"2024-04-25T12:22:34.983753+0000","last_became_active":"2024-04-25T12:22:34.981347+0000","last_became_peered":"2024-04-25T12:22:34.981347+0000","last_unstale":"2024-04-25T12:22:34.983753+0000","last_undegraded":"2024-04-25T12:22:34.983753+0000","last_fullsized":"2024-04-25T12:22:34.983753+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:55.180698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915214+0000","last_change":"2024-04-25T12:21:54.205348+0000","last_active":"2024-04-25T12:22:34.915214+0000","last_peered":"2024-04-25T12:22:34.915214+0000","last_clean":"2024-04-25T12:22:34.915214+0000","last_became_active":"2024-04-25T12:21:54.205023+0000","last_became_peered":"2024-04-25T12:21:54.205023+0000","last_unstale":"2024-04-25T12:22:34.915214+0000","last_undegraded":"2024-04-25T12:22:34.915214+0000","last_fullsized":"2024-04-25T12:22:34.915214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:46.381368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:31.226144+0000","last_change":"2024-04-25T12:21:53.201066+0000","last_active":"2024-04-25T12:24:31.226144+0000","last_peered":"2024-04-25T12:24:31.226144+0000","last_clean":"2024-04-25T12:24:31.226144+0000","last_became_active":"2024-04-25T12:21:53.197081+0000","last_became_peered":"2024-04-25T12:21:53.197081+0000","last_unstale":"2024-04-25T12:24:31.226144+0000","last_undegraded":"2024-04-25T12:24:31.226144+0000","last_fullsized":"2024-04-25T12:24:31.226144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:19.865455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916511+0000","last_change":"2024-04-25T12:21:58.343823+0000","last_active":"2024-04-25T12:22:34.916511+0000","last_peered":"2024-04-25T12:22:34.916511+0000","last_clean":"2024-04-25T12:22:34.916511+0000","last_became_active":"2024-04-25T12:21:58.342796+0000","last_became_peered":"2024-04-25T12:21:58.342796+0000","last_unstale":"2024-04-25T12:22:34.916511+0000","last_undegraded":"2024-04-25T12:22:34.916511+0000","last_fullsized":"2024-04-25T12:22:34.916511+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:14.849636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979107+0000","last_change":"2024-04-25T12:21:54.204569+0000","last_active":"2024-04-25T12:22:34.979107+0000","last_peered":"2024-04-25T12:22:34.979107+0000","last_clean":"2024-04-25T12:22:34.979107+0000","last_became_active":"2024-04-25T12:21:54.204212+0000","last_became_peered":"2024-04-25T12:21:54.204212+0000","last_unstale":"2024-04-25T12:22:34.979107+0000","last_undegraded":"2024-04-25T12:22:34.979107+0000","last_fullsized":"2024-04-25T12:22:34.979107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:44.245327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.897489+0000","last_change":"2024-04-25T12:21:53.169844+0000","last_active":"2024-04-25T12:24:37.897489+0000","last_peered":"2024-04-25T12:24:37.897489+0000","last_clean":"2024-04-25T12:24:37.897489+0000","last_became_active":"2024-04-25T12:21:53.168939+0000","last_became_peered":"2024-04-25T12:21:53.168939+0000","last_unstale":"2024-04-25T12:24:37.897489+0000","last_undegraded":"2024-04-25T12:24:37.897489+0000","last_fullsized":"2024-04-25T12:24:37.897489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:57.836476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.888439+0000","last_change":"2024-04-25T12:21:42.610528+0000","last_active":"2024-04-25T12:22:34.888439+0000","last_peered":"2024-04-25T12:22:34.888439+0000","last_clean":"2024-04-25T12:22:34.888439+0000","last_became_active":"2024-04-25T12:21:42.608579+0000","last_became_peered":"2024-04-25T12:21:42.608579+0000","last_unstale":"2024-04-25T12:22:34.888439+0000","last_undegraded":"2024-04-25T12:22:34.888439+0000","last_fullsized":"2024-04-25T12:22:34.888439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:39.904333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:39.904333+0000","last_clean_scrub_stamp":"2024-04-25T12:21:39.904333+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:16.122851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029891+0000","last_change":"2024-04-25T12:21:58.351105+0000","last_active":"2024-04-25T12:22:35.029891+0000","last_peered":"2024-04-25T12:22:35.029891+0000","last_clean":"2024-04-25T12:22:35.029891+0000","last_became_active":"2024-04-25T12:21:58.350087+0000","last_became_peered":"2024-04-25T12:21:58.350087+0000","last_unstale":"2024-04-25T12:22:35.029891+0000","last_undegraded":"2024-04-25T12:22:35.029891+0000","last_fullsized":"2024-04-25T12:22:35.029891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:22.686410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891042+0000","last_change":"2024-04-25T12:21:54.215530+0000","last_active":"2024-04-25T12:22:34.891042+0000","last_peered":"2024-04-25T12:22:34.891042+0000","last_clean":"2024-04-25T12:22:34.891042+0000","last_became_active":"2024-04-25T12:21:54.211077+0000","last_became_peered":"2024-04-25T12:21:54.211077+0000","last_unstale":"2024-04-25T12:22:34.891042+0000","last_undegraded":"2024-04-25T12:22:34.891042+0000","last_fullsized":"2024-04-25T12:22:34.891042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:03.079964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.903231+0000","last_change":"2024-04-25T12:21:53.175259+0000","last_active":"2024-04-25T12:24:37.903231+0000","last_peered":"2024-04-25T12:24:37.903231+0000","last_clean":"2024-04-25T12:24:37.903231+0000","last_became_active":"2024-04-25T12:21:53.174980+0000","last_became_peered":"2024-04-25T12:21:53.174980+0000","last_unstale":"2024-04-25T12:24:37.903231+0000","last_undegraded":"2024-04-25T12:24:37.903231+0000","last_fullsized":"2024-04-25T12:24:37.903231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:51.852590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029315+0000","last_change":"2024-04-25T12:21:58.344660+0000","last_active":"2024-04-25T12:22:35.029315+0000","last_peered":"2024-04-25T12:22:35.029315+0000","last_clean":"2024-04-25T12:22:35.029315+0000","last_became_active":"2024-04-25T12:21:58.343502+0000","last_became_peered":"2024-04-25T12:21:58.343502+0000","last_unstale":"2024-04-25T12:22:35.029315+0000","last_undegraded":"2024-04-25T12:22:35.029315+0000","last_fullsized":"2024-04-25T12:22:35.029315+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:46.127740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887959+0000","last_change":"2024-04-25T12:21:54.207666+0000","last_active":"2024-04-25T12:22:34.887959+0000","last_peered":"2024-04-25T12:22:34.887959+0000","last_clean":"2024-04-25T12:22:34.887959+0000","last_became_active":"2024-04-25T12:21:54.206749+0000","last_became_peered":"2024-04-25T12:21:54.206749+0000","last_unstale":"2024-04-25T12:22:34.887959+0000","last_undegraded":"2024-04-25T12:22:34.887959+0000","last_fullsized":"2024-04-25T12:22:34.887959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:36.113364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.900925+0000","last_change":"2024-04-25T12:21:53.179412+0000","last_active":"2024-04-25T12:24:37.900925+0000","last_peered":"2024-04-25T12:24:37.900925+0000","last_clean":"2024-04-25T12:24:37.900925+0000","last_became_active":"2024-04-25T12:21:53.179142+0000","last_became_peered":"2024-04-25T12:21:53.179142+0000","last_unstale":"2024-04-25T12:24:37.900925+0000","last_undegraded":"2024-04-25T12:24:37.900925+0000","last_fullsized":"2024-04-25T12:24:37.900925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:08.771439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915942+0000","last_change":"2024-04-25T12:21:58.254119+0000","last_active":"2024-04-25T12:22:34.915942+0000","last_peered":"2024-04-25T12:22:34.915942+0000","last_clean":"2024-04-25T12:22:34.915942+0000","last_became_active":"2024-04-25T12:21:58.253624+0000","last_became_peered":"2024-04-25T12:21:58.253624+0000","last_unstale":"2024-04-25T12:22:34.915942+0000","last_undegraded":"2024-04-25T12:22:34.915942+0000","last_fullsized":"2024-04-25T12:22:34.915942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:54.719908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891979+0000","last_change":"2024-04-25T12:21:54.219803+0000","last_active":"2024-04-25T12:22:34.891979+0000","last_peered":"2024-04-25T12:22:34.891979+0000","last_clean":"2024-04-25T12:22:34.891979+0000","last_became_active":"2024-04-25T12:21:54.219513+0000","last_became_peered":"2024-04-25T12:21:54.219513+0000","last_unstale":"2024-04-25T12:22:34.891979+0000","last_undegraded":"2024-04-25T12:22:34.891979+0000","last_fullsized":"2024-04-25T12:22:34.891979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:03.617773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.912860+0000","last_change":"2024-04-25T12:21:53.159382+0000","last_active":"2024-04-25T12:24:43.912860+0000","last_peered":"2024-04-25T12:24:43.912860+0000","last_clean":"2024-04-25T12:24:43.912860+0000","last_became_active":"2024-04-25T12:21:53.159018+0000","last_became_peered":"2024-04-25T12:21:53.159018+0000","last_unstale":"2024-04-25T12:24:43.912860+0000","last_undegraded":"2024-04-25T12:24:43.912860+0000","last_fullsized":"2024-04-25T12:24:43.912860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:39.868721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.885990+0000","last_change":"2024-04-25T12:21:58.344915+0000","last_active":"2024-04-25T12:22:34.885990+0000","last_peered":"2024-04-25T12:22:34.885990+0000","last_clean":"2024-04-25T12:22:34.885990+0000","last_became_active":"2024-04-25T12:21:58.343839+0000","last_became_peered":"2024-04-25T12:21:58.343839+0000","last_unstale":"2024-04-25T12:22:34.885990+0000","last_undegraded":"2024-04-25T12:22:34.885990+0000","last_fullsized":"2024-04-25T12:22:34.885990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:20.784047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891353+0000","last_change":"2024-04-25T12:21:54.215509+0000","last_active":"2024-04-25T12:22:34.891353+0000","last_peered":"2024-04-25T12:22:34.891353+0000","last_clean":"2024-04-25T12:22:34.891353+0000","last_became_active":"2024-04-25T12:21:54.211719+0000","last_became_peered":"2024-04-25T12:21:54.211719+0000","last_unstale":"2024-04-25T12:22:34.891353+0000","last_undegraded":"2024-04-25T12:22:34.891353+0000","last_fullsized":"2024-04-25T12:22:34.891353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:21.047044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'2","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:10.988142+0000","last_change":"2024-04-25T12:21:53.170513+0000","last_active":"2024-04-25T12:24:10.988142+0000","last_peered":"2024-04-25T12:24:10.988142+0000","last_clean":"2024-04-25T12:24:10.988142+0000","last_became_active":"2024-04-25T12:21:53.169743+0000","last_became_peered":"2024-04-25T12:21:53.169743+0000","last_unstale":"2024-04-25T12:24:10.988142+0000","last_undegraded":"2024-04-25T12:24:10.988142+0000","last_fullsized":"2024-04-25T12:24:10.988142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:03.566639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893058+0000","last_change":"2024-04-25T12:21:58.254432+0000","last_active":"2024-04-25T12:22:34.893058+0000","last_peered":"2024-04-25T12:22:34.893058+0000","last_clean":"2024-04-25T12:22:34.893058+0000","last_became_active":"2024-04-25T12:21:58.253256+0000","last_became_peered":"2024-04-25T12:21:58.253256+0000","last_unstale":"2024-04-25T12:22:34.893058+0000","last_undegraded":"2024-04-25T12:22:34.893058+0000","last_fullsized":"2024-04-25T12:22:34.893058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:13.469118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.897492+0000","last_change":"2024-04-25T12:22:34.896289+0000","last_active":"2024-04-25T12:22:34.897492+0000","last_peered":"2024-04-25T12:22:34.897492+0000","last_clean":"2024-04-25T12:22:34.897492+0000","last_became_active":"2024-04-25T12:22:34.895584+0000","last_became_peered":"2024-04-25T12:22:34.895584+0000","last_unstale":"2024-04-25T12:22:34.897492+0000","last_undegraded":"2024-04-25T12:22:34.897492+0000","last_fullsized":"2024-04-25T12:22:34.897492+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:54.648002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"28'17","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.895231+0000","last_change":"2024-04-25T12:21:53.163846+0000","last_active":"2024-04-25T12:24:37.895231+0000","last_peered":"2024-04-25T12:24:37.895231+0000","last_clean":"2024-04-25T12:24:37.895231+0000","last_became_active":"2024-04-25T12:21:53.163565+0000","last_became_peered":"2024-04-25T12:21:53.163565+0000","last_unstale":"2024-04-25T12:24:37.895231+0000","last_undegraded":"2024-04-25T12:24:37.895231+0000","last_fullsized":"2024-04-25T12:24:37.895231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:22.297830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916263+0000","last_change":"2024-04-25T12:21:58.250582+0000","last_active":"2024-04-25T12:22:34.916263+0000","last_peered":"2024-04-25T12:22:34.916263+0000","last_clean":"2024-04-25T12:22:34.916263+0000","last_became_active":"2024-04-25T12:21:58.250136+0000","last_became_peered":"2024-04-25T12:21:58.250136+0000","last_unstale":"2024-04-25T12:22:34.916263+0000","last_undegraded":"2024-04-25T12:22:34.916263+0000","last_fullsized":"2024-04-25T12:22:34.916263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:23.786586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030261+0000","last_change":"2024-04-25T12:21:54.200492+0000","last_active":"2024-04-25T12:22:35.030261+0000","last_peered":"2024-04-25T12:22:35.030261+0000","last_clean":"2024-04-25T12:22:35.030261+0000","last_became_active":"2024-04-25T12:21:54.200187+0000","last_became_peered":"2024-04-25T12:21:54.200187+0000","last_unstale":"2024-04-25T12:22:35.030261+0000","last_undegraded":"2024-04-25T12:22:35.030261+0000","last_fullsized":"2024-04-25T12:22:35.030261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:17.428348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.895785+0000","last_change":"2024-04-25T12:21:53.186752+0000","last_active":"2024-04-25T12:24:37.895785+0000","last_peered":"2024-04-25T12:24:37.895785+0000","last_clean":"2024-04-25T12:24:37.895785+0000","last_became_active":"2024-04-25T12:21:53.184866+0000","last_became_peered":"2024-04-25T12:21:53.184866+0000","last_unstale":"2024-04-25T12:24:37.895785+0000","last_undegraded":"2024-04-25T12:24:37.895785+0000","last_fullsized":"2024-04-25T12:24:37.895785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:07.228743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980381+0000","last_change":"2024-04-25T12:21:58.344241+0000","last_active":"2024-04-25T12:22:34.980381+0000","last_peered":"2024-04-25T12:22:34.980381+0000","last_clean":"2024-04-25T12:22:34.980381+0000","last_became_active":"2024-04-25T12:21:58.343764+0000","last_became_peered":"2024-04-25T12:21:58.343764+0000","last_unstale":"2024-04-25T12:22:34.980381+0000","last_undegraded":"2024-04-25T12:22:34.980381+0000","last_fullsized":"2024-04-25T12:22:34.980381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:25.931918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890533+0000","last_change":"2024-04-25T12:21:54.216405+0000","last_active":"2024-04-25T12:22:34.890533+0000","last_peered":"2024-04-25T12:22:34.890533+0000","last_clean":"2024-04-25T12:22:34.890533+0000","last_became_active":"2024-04-25T12:21:54.215575+0000","last_became_peered":"2024-04-25T12:21:54.215575+0000","last_unstale":"2024-04-25T12:22:34.890533+0000","last_undegraded":"2024-04-25T12:22:34.890533+0000","last_fullsized":"2024-04-25T12:22:34.890533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:57.935295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.896331+0000","last_change":"2024-04-25T12:21:53.198384+0000","last_active":"2024-04-25T12:24:37.896331+0000","last_peered":"2024-04-25T12:24:37.896331+0000","last_clean":"2024-04-25T12:24:37.896331+0000","last_became_active":"2024-04-25T12:21:53.197618+0000","last_became_peered":"2024-04-25T12:21:53.197618+0000","last_unstale":"2024-04-25T12:24:37.896331+0000","last_undegraded":"2024-04-25T12:24:37.896331+0000","last_fullsized":"2024-04-25T12:24:37.896331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:23.368197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979881+0000","last_change":"2024-04-25T12:21:58.342445+0000","last_active":"2024-04-25T12:22:34.979881+0000","last_peered":"2024-04-25T12:22:34.979881+0000","last_clean":"2024-04-25T12:22:34.979881+0000","last_became_active":"2024-04-25T12:21:58.341575+0000","last_became_peered":"2024-04-25T12:21:58.341575+0000","last_unstale":"2024-04-25T12:22:34.979881+0000","last_undegraded":"2024-04-25T12:22:34.979881+0000","last_fullsized":"2024-04-25T12:22:34.979881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:34.553686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915983+0000","last_change":"2024-04-25T12:21:54.200799+0000","last_active":"2024-04-25T12:22:34.915983+0000","last_peered":"2024-04-25T12:22:34.915983+0000","last_clean":"2024-04-25T12:22:34.915983+0000","last_became_active":"2024-04-25T12:21:54.200209+0000","last_became_peered":"2024-04-25T12:21:54.200209+0000","last_unstale":"2024-04-25T12:22:34.915983+0000","last_undegraded":"2024-04-25T12:22:34.915983+0000","last_fullsized":"2024-04-25T12:22:34.915983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:57.958942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.912380+0000","last_change":"2024-04-25T12:21:53.168731+0000","last_active":"2024-04-25T12:24:43.912380+0000","last_peered":"2024-04-25T12:24:43.912380+0000","last_clean":"2024-04-25T12:24:43.912380+0000","last_became_active":"2024-04-25T12:21:53.168461+0000","last_became_peered":"2024-04-25T12:21:53.168461+0000","last_unstale":"2024-04-25T12:24:43.912380+0000","last_undegraded":"2024-04-25T12:24:43.912380+0000","last_fullsized":"2024-04-25T12:24:43.912380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:34.935857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887582+0000","last_change":"2024-04-25T12:21:58.344622+0000","last_active":"2024-04-25T12:22:34.887582+0000","last_peered":"2024-04-25T12:22:34.887582+0000","last_clean":"2024-04-25T12:22:34.887582+0000","last_became_active":"2024-04-25T12:21:58.343533+0000","last_became_peered":"2024-04-25T12:21:58.343533+0000","last_unstale":"2024-04-25T12:22:34.887582+0000","last_undegraded":"2024-04-25T12:22:34.887582+0000","last_fullsized":"2024-04-25T12:22:34.887582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:35.536857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891003+0000","last_change":"2024-04-25T12:21:54.216903+0000","last_active":"2024-04-25T12:22:34.891003+0000","last_peered":"2024-04-25T12:22:34.891003+0000","last_clean":"2024-04-25T12:22:34.891003+0000","last_became_active":"2024-04-25T12:21:54.216312+0000","last_became_peered":"2024-04-25T12:21:54.216312+0000","last_unstale":"2024-04-25T12:22:34.891003+0000","last_undegraded":"2024-04-25T12:22:34.891003+0000","last_fullsized":"2024-04-25T12:22:34.891003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:12.963783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'16","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:51.472761+0000","last_change":"2024-04-25T12:21:53.179160+0000","last_active":"2024-04-25T12:24:51.472761+0000","last_peered":"2024-04-25T12:24:51.472761+0000","last_clean":"2024-04-25T12:24:51.472761+0000","last_became_active":"2024-04-25T12:21:53.177229+0000","last_became_peered":"2024-04-25T12:21:53.177229+0000","last_unstale":"2024-04-25T12:24:51.472761+0000","last_undegraded":"2024-04-25T12:24:51.472761+0000","last_fullsized":"2024-04-25T12:24:51.472761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:09.082459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4283,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293725+0000","last_change":"2024-04-25T12:21:58.245003+0000","last_active":"2024-04-25T12:22:35.293725+0000","last_peered":"2024-04-25T12:22:35.293725+0000","last_clean":"2024-04-25T12:22:35.293725+0000","last_became_active":"2024-04-25T12:21:58.244500+0000","last_became_peered":"2024-04-25T12:21:58.244500+0000","last_unstale":"2024-04-25T12:22:35.293725+0000","last_undegraded":"2024-04-25T12:22:35.293725+0000","last_fullsized":"2024-04-25T12:22:35.293725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:35.010344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.895285+0000","last_change":"2024-04-25T12:21:54.213845+0000","last_active":"2024-04-25T12:22:34.895285+0000","last_peered":"2024-04-25T12:22:34.895285+0000","last_clean":"2024-04-25T12:22:34.895285+0000","last_became_active":"2024-04-25T12:21:54.213413+0000","last_became_peered":"2024-04-25T12:21:54.213413+0000","last_unstale":"2024-04-25T12:22:34.895285+0000","last_undegraded":"2024-04-25T12:22:34.895285+0000","last_fullsized":"2024-04-25T12:22:34.895285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:59.864079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:25.191571+0000","last_change":"2024-04-25T12:21:53.186487+0000","last_active":"2024-04-25T12:24:25.191571+0000","last_peered":"2024-04-25T12:24:25.191571+0000","last_clean":"2024-04-25T12:24:25.191571+0000","last_became_active":"2024-04-25T12:21:53.186227+0000","last_became_peered":"2024-04-25T12:21:53.186227+0000","last_unstale":"2024-04-25T12:24:25.191571+0000","last_undegraded":"2024-04-25T12:24:25.191571+0000","last_fullsized":"2024-04-25T12:24:25.191571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:20.317103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894312+0000","last_change":"2024-04-25T12:21:58.249806+0000","last_active":"2024-04-25T12:22:34.894312+0000","last_peered":"2024-04-25T12:22:34.894312+0000","last_clean":"2024-04-25T12:22:34.894312+0000","last_became_active":"2024-04-25T12:21:58.248841+0000","last_became_peered":"2024-04-25T12:21:58.248841+0000","last_unstale":"2024-04-25T12:22:34.894312+0000","last_undegraded":"2024-04-25T12:22:34.894312+0000","last_fullsized":"2024-04-25T12:22:34.894312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:18.448118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916576+0000","last_change":"2024-04-25T12:21:54.189948+0000","last_active":"2024-04-25T12:22:34.916576+0000","last_peered":"2024-04-25T12:22:34.916576+0000","last_clean":"2024-04-25T12:22:34.916576+0000","last_became_active":"2024-04-25T12:21:54.189097+0000","last_became_peered":"2024-04-25T12:21:54.189097+0000","last_unstale":"2024-04-25T12:22:34.916576+0000","last_undegraded":"2024-04-25T12:22:34.916576+0000","last_fullsized":"2024-04-25T12:22:34.916576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:09.029536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'4","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.916749+0000","last_change":"2024-04-25T12:21:53.206472+0000","last_active":"2024-04-25T12:24:43.916749+0000","last_peered":"2024-04-25T12:24:43.916749+0000","last_clean":"2024-04-25T12:24:43.916749+0000","last_became_active":"2024-04-25T12:21:53.205742+0000","last_became_peered":"2024-04-25T12:21:53.205742+0000","last_unstale":"2024-04-25T12:24:43.916749+0000","last_undegraded":"2024-04-25T12:24:43.916749+0000","last_fullsized":"2024-04-25T12:24:43.916749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:37.444336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978676+0000","last_change":"2024-04-25T12:21:58.261490+0000","last_active":"2024-04-25T12:22:34.978676+0000","last_peered":"2024-04-25T12:22:34.978676+0000","last_clean":"2024-04-25T12:22:34.978676+0000","last_became_active":"2024-04-25T12:21:58.260979+0000","last_became_peered":"2024-04-25T12:21:58.260979+0000","last_unstale":"2024-04-25T12:22:34.978676+0000","last_undegraded":"2024-04-25T12:22:34.978676+0000","last_fullsized":"2024-04-25T12:22:34.978676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:51.396618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890271+0000","last_change":"2024-04-25T12:22:34.890271+0000","last_active":"2024-04-25T12:22:34.890271+0000","last_peered":"2024-04-25T12:22:34.890271+0000","last_clean":"2024-04-25T12:22:34.890271+0000","last_became_active":"2024-04-25T12:22:34.889562+0000","last_became_peered":"2024-04-25T12:22:34.889562+0000","last_unstale":"2024-04-25T12:22:34.890271+0000","last_undegraded":"2024-04-25T12:22:34.890271+0000","last_fullsized":"2024-04-25T12:22:34.890271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:17.476913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.895701+0000","last_change":"2024-04-25T12:21:53.206850+0000","last_active":"2024-04-25T12:24:37.895701+0000","last_peered":"2024-04-25T12:24:37.895701+0000","last_clean":"2024-04-25T12:24:37.895701+0000","last_became_active":"2024-04-25T12:21:53.206274+0000","last_became_peered":"2024-04-25T12:21:53.206274+0000","last_unstale":"2024-04-25T12:24:37.895701+0000","last_undegraded":"2024-04-25T12:24:37.895701+0000","last_fullsized":"2024-04-25T12:24:37.895701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:25.867387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979375+0000","last_change":"2024-04-25T12:21:58.346593+0000","last_active":"2024-04-25T12:22:34.979375+0000","last_peered":"2024-04-25T12:22:34.979375+0000","last_clean":"2024-04-25T12:22:34.979375+0000","last_became_active":"2024-04-25T12:21:58.346195+0000","last_became_peered":"2024-04-25T12:21:58.346195+0000","last_unstale":"2024-04-25T12:22:34.979375+0000","last_undegraded":"2024-04-25T12:22:34.979375+0000","last_fullsized":"2024-04-25T12:22:34.979375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:47.745861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915960+0000","last_change":"2024-04-25T12:21:58.347908+0000","last_active":"2024-04-25T12:22:34.915960+0000","last_peered":"2024-04-25T12:22:34.915960+0000","last_clean":"2024-04-25T12:22:34.915960+0000","last_became_active":"2024-04-25T12:21:58.346887+0000","last_became_peered":"2024-04-25T12:21:58.346887+0000","last_unstale":"2024-04-25T12:22:34.915960+0000","last_undegraded":"2024-04-25T12:22:34.915960+0000","last_fullsized":"2024-04-25T12:22:34.915960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:06.228605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.291914+0000","last_change":"2024-04-25T12:21:54.203140+0000","last_active":"2024-04-25T12:22:35.291914+0000","last_peered":"2024-04-25T12:22:35.291914+0000","last_clean":"2024-04-25T12:22:35.291914+0000","last_became_active":"2024-04-25T12:21:54.202399+0000","last_became_peered":"2024-04-25T12:21:54.202399+0000","last_unstale":"2024-04-25T12:22:35.291914+0000","last_undegraded":"2024-04-25T12:22:35.291914+0000","last_fullsized":"2024-04-25T12:22:35.291914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:19.691760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'3","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.900829+0000","last_change":"2024-04-25T12:21:53.202038+0000","last_active":"2024-04-25T12:24:37.900829+0000","last_peered":"2024-04-25T12:24:37.900829+0000","last_clean":"2024-04-25T12:24:37.900829+0000","last_became_active":"2024-04-25T12:21:53.189592+0000","last_became_peered":"2024-04-25T12:21:53.189592+0000","last_unstale":"2024-04-25T12:24:37.900829+0000","last_undegraded":"2024-04-25T12:24:37.900829+0000","last_fullsized":"2024-04-25T12:24:37.900829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:38.052120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030482+0000","last_change":"2024-04-25T12:21:58.246247+0000","last_active":"2024-04-25T12:22:35.030482+0000","last_peered":"2024-04-25T12:22:35.030482+0000","last_clean":"2024-04-25T12:22:35.030482+0000","last_became_active":"2024-04-25T12:21:58.245085+0000","last_became_peered":"2024-04-25T12:21:58.245085+0000","last_unstale":"2024-04-25T12:22:35.030482+0000","last_undegraded":"2024-04-25T12:22:35.030482+0000","last_fullsized":"2024-04-25T12:22:35.030482+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:24.660921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978856+0000","last_change":"2024-04-25T12:21:54.207534+0000","last_active":"2024-04-25T12:22:34.978856+0000","last_peered":"2024-04-25T12:22:34.978856+0000","last_clean":"2024-04-25T12:22:34.978856+0000","last_became_active":"2024-04-25T12:21:54.206786+0000","last_became_peered":"2024-04-25T12:21:54.206786+0000","last_unstale":"2024-04-25T12:22:34.978856+0000","last_undegraded":"2024-04-25T12:22:34.978856+0000","last_fullsized":"2024-04-25T12:22:34.978856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:48.775827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:31.226688+0000","last_change":"2024-04-25T12:21:53.190402+0000","last_active":"2024-04-25T12:24:31.226688+0000","last_peered":"2024-04-25T12:24:31.226688+0000","last_clean":"2024-04-25T12:24:31.226688+0000","last_became_active":"2024-04-25T12:21:53.189936+0000","last_became_peered":"2024-04-25T12:21:53.189936+0000","last_unstale":"2024-04-25T12:24:31.226688+0000","last_undegraded":"2024-04-25T12:24:31.226688+0000","last_fullsized":"2024-04-25T12:24:31.226688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:30.984588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.895874+0000","last_change":"2024-04-25T12:21:53.186071+0000","last_active":"2024-04-25T12:24:37.895874+0000","last_peered":"2024-04-25T12:24:37.895874+0000","last_clean":"2024-04-25T12:24:37.895874+0000","last_became_active":"2024-04-25T12:21:53.185357+0000","last_became_peered":"2024-04-25T12:21:53.185357+0000","last_unstale":"2024-04-25T12:24:37.895874+0000","last_undegraded":"2024-04-25T12:24:37.895874+0000","last_fullsized":"2024-04-25T12:24:37.895874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:10.148702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916445+0000","last_change":"2024-04-25T12:21:54.205678+0000","last_active":"2024-04-25T12:22:34.916445+0000","last_peered":"2024-04-25T12:22:34.916445+0000","last_clean":"2024-04-25T12:22:34.916445+0000","last_became_active":"2024-04-25T12:21:54.205219+0000","last_became_peered":"2024-04-25T12:21:54.205219+0000","last_unstale":"2024-04-25T12:22:34.916445+0000","last_undegraded":"2024-04-25T12:22:34.916445+0000","last_fullsized":"2024-04-25T12:22:34.916445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:55.152284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884465+0000","last_change":"2024-04-25T12:21:58.257395+0000","last_active":"2024-04-25T12:22:34.884465+0000","last_peered":"2024-04-25T12:22:34.884465+0000","last_clean":"2024-04-25T12:22:34.884465+0000","last_became_active":"2024-04-25T12:21:58.256219+0000","last_became_peered":"2024-04-25T12:21:58.256219+0000","last_unstale":"2024-04-25T12:22:34.884465+0000","last_undegraded":"2024-04-25T12:22:34.884465+0000","last_fullsized":"2024-04-25T12:22:34.884465+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:15.119967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:25.197594+0000","last_change":"2024-04-25T12:21:53.194633+0000","last_active":"2024-04-25T12:24:25.197594+0000","last_peered":"2024-04-25T12:24:25.197594+0000","last_clean":"2024-04-25T12:24:25.197594+0000","last_became_active":"2024-04-25T12:21:53.194306+0000","last_became_peered":"2024-04-25T12:21:53.194306+0000","last_unstale":"2024-04-25T12:24:25.197594+0000","last_undegraded":"2024-04-25T12:24:25.197594+0000","last_fullsized":"2024-04-25T12:24:25.197594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:03.566639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1063,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894127+0000","last_change":"2024-04-25T12:21:54.201494+0000","last_active":"2024-04-25T12:22:34.894127+0000","last_peered":"2024-04-25T12:22:34.894127+0000","last_clean":"2024-04-25T12:22:34.894127+0000","last_became_active":"2024-04-25T12:21:54.196085+0000","last_became_peered":"2024-04-25T12:21:54.196085+0000","last_unstale":"2024-04-25T12:22:34.894127+0000","last_undegraded":"2024-04-25T12:22:34.894127+0000","last_fullsized":"2024-04-25T12:22:34.894127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:21.183608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979718+0000","last_change":"2024-04-25T12:21:58.261744+0000","last_active":"2024-04-25T12:22:34.979718+0000","last_peered":"2024-04-25T12:22:34.979718+0000","last_clean":"2024-04-25T12:22:34.979718+0000","last_became_active":"2024-04-25T12:21:58.260821+0000","last_became_peered":"2024-04-25T12:21:58.260821+0000","last_unstale":"2024-04-25T12:22:34.979718+0000","last_undegraded":"2024-04-25T12:22:34.979718+0000","last_fullsized":"2024-04-25T12:22:34.979718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:14.169485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029125+0000","last_change":"2024-04-25T12:21:54.201042+0000","last_active":"2024-04-25T12:22:35.029125+0000","last_peered":"2024-04-25T12:22:35.029125+0000","last_clean":"2024-04-25T12:22:35.029125+0000","last_became_active":"2024-04-25T12:21:54.200446+0000","last_became_peered":"2024-04-25T12:21:54.200446+0000","last_unstale":"2024-04-25T12:22:35.029125+0000","last_undegraded":"2024-04-25T12:22:35.029125+0000","last_fullsized":"2024-04-25T12:22:35.029125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:37.866196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884359+0000","last_change":"2024-04-25T12:21:54.188004+0000","last_active":"2024-04-25T12:22:34.884359+0000","last_peered":"2024-04-25T12:22:34.884359+0000","last_clean":"2024-04-25T12:22:34.884359+0000","last_became_active":"2024-04-25T12:21:54.187254+0000","last_became_peered":"2024-04-25T12:21:54.187254+0000","last_unstale":"2024-04-25T12:22:34.884359+0000","last_undegraded":"2024-04-25T12:22:34.884359+0000","last_fullsized":"2024-04-25T12:22:34.884359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:32.252676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887407+0000","last_change":"2024-04-25T12:21:54.206788+0000","last_active":"2024-04-25T12:22:34.887407+0000","last_peered":"2024-04-25T12:22:34.887407+0000","last_clean":"2024-04-25T12:22:34.887407+0000","last_became_active":"2024-04-25T12:21:54.204904+0000","last_became_peered":"2024-04-25T12:21:54.204904+0000","last_unstale":"2024-04-25T12:22:34.887407+0000","last_undegraded":"2024-04-25T12:22:34.887407+0000","last_fullsized":"2024-04-25T12:22:34.887407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:24.928840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916233+0000","last_change":"2024-04-25T12:21:54.204288+0000","last_active":"2024-04-25T12:22:34.916233+0000","last_peered":"2024-04-25T12:22:34.916233+0000","last_clean":"2024-04-25T12:22:34.916233+0000","last_became_active":"2024-04-25T12:21:54.203922+0000","last_became_peered":"2024-04-25T12:21:54.203922+0000","last_unstale":"2024-04-25T12:22:34.916233+0000","last_undegraded":"2024-04-25T12:22:34.916233+0000","last_fullsized":"2024-04-25T12:22:34.916233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:36.299452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980303+0000","last_change":"2024-04-25T12:21:54.208621+0000","last_active":"2024-04-25T12:22:34.980303+0000","last_peered":"2024-04-25T12:22:34.980303+0000","last_clean":"2024-04-25T12:22:34.980303+0000","last_became_active":"2024-04-25T12:21:54.206993+0000","last_became_peered":"2024-04-25T12:21:54.206993+0000","last_unstale":"2024-04-25T12:22:34.980303+0000","last_undegraded":"2024-04-25T12:22:34.980303+0000","last_fullsized":"2024-04-25T12:22:34.980303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:56:08.605883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292881+0000","last_change":"2024-04-25T12:21:54.202203+0000","last_active":"2024-04-25T12:22:35.292881+0000","last_peered":"2024-04-25T12:22:35.292881+0000","last_clean":"2024-04-25T12:22:35.292881+0000","last_became_active":"2024-04-25T12:21:54.201551+0000","last_became_peered":"2024-04-25T12:21:54.201551+0000","last_unstale":"2024-04-25T12:22:35.292881+0000","last_undegraded":"2024-04-25T12:22:35.292881+0000","last_fullsized":"2024-04-25T12:22:35.292881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:12.846584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030100+0000","last_change":"2024-04-25T12:21:54.220705+0000","last_active":"2024-04-25T12:22:35.030100+0000","last_peered":"2024-04-25T12:22:35.030100+0000","last_clean":"2024-04-25T12:22:35.030100+0000","last_became_active":"2024-04-25T12:21:54.220435+0000","last_became_peered":"2024-04-25T12:21:54.220435+0000","last_unstale":"2024-04-25T12:22:35.030100+0000","last_undegraded":"2024-04-25T12:22:35.030100+0000","last_fullsized":"2024-04-25T12:22:35.030100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:27.885210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980397+0000","last_change":"2024-04-25T12:21:54.206568+0000","last_active":"2024-04-25T12:22:34.980397+0000","last_peered":"2024-04-25T12:22:34.980397+0000","last_clean":"2024-04-25T12:22:34.980397+0000","last_became_active":"2024-04-25T12:21:54.204587+0000","last_became_peered":"2024-04-25T12:21:54.204587+0000","last_unstale":"2024-04-25T12:22:34.980397+0000","last_undegraded":"2024-04-25T12:22:34.980397+0000","last_fullsized":"2024-04-25T12:22:34.980397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:37.419230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.297659+0000","last_change":"2024-04-25T12:22:35.295869+0000","last_active":"2024-04-25T12:22:35.297659+0000","last_peered":"2024-04-25T12:22:35.297659+0000","last_clean":"2024-04-25T12:22:35.297659+0000","last_became_active":"2024-04-25T12:22:35.295116+0000","last_became_peered":"2024-04-25T12:22:35.295116+0000","last_unstale":"2024-04-25T12:22:35.297659+0000","last_undegraded":"2024-04-25T12:22:35.297659+0000","last_fullsized":"2024-04-25T12:22:35.297659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:08.665587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979578+0000","last_change":"2024-04-25T12:21:54.203886+0000","last_active":"2024-04-25T12:22:34.979578+0000","last_peered":"2024-04-25T12:22:34.979578+0000","last_clean":"2024-04-25T12:22:34.979578+0000","last_became_active":"2024-04-25T12:21:54.203464+0000","last_became_peered":"2024-04-25T12:21:54.203464+0000","last_unstale":"2024-04-25T12:22:34.979578+0000","last_undegraded":"2024-04-25T12:22:34.979578+0000","last_fullsized":"2024-04-25T12:22:34.979578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:41.646353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887358+0000","last_change":"2024-04-25T12:21:54.213114+0000","last_active":"2024-04-25T12:22:34.887358+0000","last_peered":"2024-04-25T12:22:34.887358+0000","last_clean":"2024-04-25T12:22:34.887358+0000","last_became_active":"2024-04-25T12:21:54.212559+0000","last_became_peered":"2024-04-25T12:21:54.212559+0000","last_unstale":"2024-04-25T12:22:34.887358+0000","last_undegraded":"2024-04-25T12:22:34.887358+0000","last_fullsized":"2024-04-25T12:22:34.887358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:13.824789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915648+0000","last_change":"2024-04-25T12:21:54.215749+0000","last_active":"2024-04-25T12:22:34.915648+0000","last_peered":"2024-04-25T12:22:34.915648+0000","last_clean":"2024-04-25T12:22:34.915648+0000","last_became_active":"2024-04-25T12:21:54.215446+0000","last_became_peered":"2024-04-25T12:21:54.215446+0000","last_unstale":"2024-04-25T12:22:34.915648+0000","last_undegraded":"2024-04-25T12:22:34.915648+0000","last_fullsized":"2024-04-25T12:22:34.915648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:31.642141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029876+0000","last_change":"2024-04-25T12:21:54.210099+0000","last_active":"2024-04-25T12:22:35.029876+0000","last_peered":"2024-04-25T12:22:35.029876+0000","last_clean":"2024-04-25T12:22:35.029876+0000","last_became_active":"2024-04-25T12:21:54.209393+0000","last_became_peered":"2024-04-25T12:21:54.209393+0000","last_unstale":"2024-04-25T12:22:35.029876+0000","last_undegraded":"2024-04-25T12:22:35.029876+0000","last_fullsized":"2024-04-25T12:22:35.029876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:32.318047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891441+0000","last_change":"2024-04-25T12:21:54.216255+0000","last_active":"2024-04-25T12:22:34.891441+0000","last_peered":"2024-04-25T12:22:34.891441+0000","last_clean":"2024-04-25T12:22:34.891441+0000","last_became_active":"2024-04-25T12:21:54.211787+0000","last_became_peered":"2024-04-25T12:21:54.211787+0000","last_unstale":"2024-04-25T12:22:34.891441+0000","last_undegraded":"2024-04-25T12:22:34.891441+0000","last_fullsized":"2024-04-25T12:22:34.891441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:32.351790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.886612+0000","last_change":"2024-04-25T12:21:54.200503+0000","last_active":"2024-04-25T12:22:34.886612+0000","last_peered":"2024-04-25T12:22:34.886612+0000","last_clean":"2024-04-25T12:22:34.886612+0000","last_became_active":"2024-04-25T12:21:54.200123+0000","last_became_peered":"2024-04-25T12:21:54.200123+0000","last_unstale":"2024-04-25T12:22:34.886612+0000","last_undegraded":"2024-04-25T12:22:34.886612+0000","last_fullsized":"2024-04-25T12:22:34.886612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:04.504889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.889718+0000","last_change":"2024-04-25T12:21:54.220717+0000","last_active":"2024-04-25T12:22:34.889718+0000","last_peered":"2024-04-25T12:22:34.889718+0000","last_clean":"2024-04-25T12:22:34.889718+0000","last_became_active":"2024-04-25T12:21:54.220272+0000","last_became_peered":"2024-04-25T12:21:54.220272+0000","last_unstale":"2024-04-25T12:22:34.889718+0000","last_undegraded":"2024-04-25T12:22:34.889718+0000","last_fullsized":"2024-04-25T12:22:34.889718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:51.165297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.886279+0000","last_change":"2024-04-25T12:21:54.190288+0000","last_active":"2024-04-25T12:22:34.886279+0000","last_peered":"2024-04-25T12:22:34.886279+0000","last_clean":"2024-04-25T12:22:34.886279+0000","last_became_active":"2024-04-25T12:21:54.189535+0000","last_became_peered":"2024-04-25T12:21:54.189535+0000","last_unstale":"2024-04-25T12:22:34.886279+0000","last_undegraded":"2024-04-25T12:22:34.886279+0000","last_fullsized":"2024-04-25T12:22:34.886279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:03.757883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292136+0000","last_change":"2024-04-25T12:21:54.202898+0000","last_active":"2024-04-25T12:22:35.292136+0000","last_peered":"2024-04-25T12:22:35.292136+0000","last_clean":"2024-04-25T12:22:35.292136+0000","last_became_active":"2024-04-25T12:21:54.201641+0000","last_became_peered":"2024-04-25T12:21:54.201641+0000","last_unstale":"2024-04-25T12:22:35.292136+0000","last_undegraded":"2024-04-25T12:22:35.292136+0000","last_fullsized":"2024-04-25T12:22:35.292136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:42.865496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916388+0000","last_change":"2024-04-25T12:21:54.192818+0000","last_active":"2024-04-25T12:22:34.916388+0000","last_peered":"2024-04-25T12:22:34.916388+0000","last_clean":"2024-04-25T12:22:34.916388+0000","last_became_active":"2024-04-25T12:21:54.192052+0000","last_became_peered":"2024-04-25T12:21:54.192052+0000","last_unstale":"2024-04-25T12:22:34.916388+0000","last_undegraded":"2024-04-25T12:22:34.916388+0000","last_fullsized":"2024-04-25T12:22:34.916388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:26.048483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978815+0000","last_change":"2024-04-25T12:21:54.203798+0000","last_active":"2024-04-25T12:22:34.978815+0000","last_peered":"2024-04-25T12:22:34.978815+0000","last_clean":"2024-04-25T12:22:34.978815+0000","last_became_active":"2024-04-25T12:21:54.203472+0000","last_became_peered":"2024-04-25T12:21:54.203472+0000","last_unstale":"2024-04-25T12:22:34.978815+0000","last_undegraded":"2024-04-25T12:22:34.978815+0000","last_fullsized":"2024-04-25T12:22:34.978815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:19.958172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894317+0000","last_change":"2024-04-25T12:21:54.206055+0000","last_active":"2024-04-25T12:22:34.894317+0000","last_peered":"2024-04-25T12:22:34.894317+0000","last_clean":"2024-04-25T12:22:34.894317+0000","last_became_active":"2024-04-25T12:21:54.203030+0000","last_became_peered":"2024-04-25T12:21:54.203030+0000","last_unstale":"2024-04-25T12:22:34.894317+0000","last_undegraded":"2024-04-25T12:22:34.894317+0000","last_fullsized":"2024-04-25T12:22:34.894317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:58.836301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030468+0000","last_change":"2024-04-25T12:21:54.199660+0000","last_active":"2024-04-25T12:22:35.030468+0000","last_peered":"2024-04-25T12:22:35.030468+0000","last_clean":"2024-04-25T12:22:35.030468+0000","last_became_active":"2024-04-25T12:21:54.199362+0000","last_became_peered":"2024-04-25T12:21:54.199362+0000","last_unstale":"2024-04-25T12:22:35.030468+0000","last_undegraded":"2024-04-25T12:22:35.030468+0000","last_fullsized":"2024-04-25T12:22:35.030468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:57.706566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029976+0000","last_change":"2024-04-25T12:21:54.198710+0000","last_active":"2024-04-25T12:22:35.029976+0000","last_peered":"2024-04-25T12:22:35.029976+0000","last_clean":"2024-04-25T12:22:35.029976+0000","last_became_active":"2024-04-25T12:21:54.198432+0000","last_became_peered":"2024-04-25T12:21:54.198432+0000","last_unstale":"2024-04-25T12:22:35.029976+0000","last_undegraded":"2024-04-25T12:22:35.029976+0000","last_fullsized":"2024-04-25T12:22:35.029976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:33.124005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.892012+0000","last_change":"2024-04-25T12:21:54.218474+0000","last_active":"2024-04-25T12:22:34.892012+0000","last_peered":"2024-04-25T12:22:34.892012+0000","last_clean":"2024-04-25T12:22:34.892012+0000","last_became_active":"2024-04-25T12:21:54.216949+0000","last_became_peered":"2024-04-25T12:21:54.216949+0000","last_unstale":"2024-04-25T12:22:34.892012+0000","last_undegraded":"2024-04-25T12:22:34.892012+0000","last_fullsized":"2024-04-25T12:22:34.892012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:56.162843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978395+0000","last_change":"2024-04-25T12:21:54.200590+0000","last_active":"2024-04-25T12:22:34.978395+0000","last_peered":"2024-04-25T12:22:34.978395+0000","last_clean":"2024-04-25T12:22:34.978395+0000","last_became_active":"2024-04-25T12:21:54.200248+0000","last_became_peered":"2024-04-25T12:21:54.200248+0000","last_unstale":"2024-04-25T12:22:34.978395+0000","last_undegraded":"2024-04-25T12:22:34.978395+0000","last_fullsized":"2024-04-25T12:22:34.978395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:12.875315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890043+0000","last_change":"2024-04-25T12:21:54.197805+0000","last_active":"2024-04-25T12:22:34.890043+0000","last_peered":"2024-04-25T12:22:34.890043+0000","last_clean":"2024-04-25T12:22:34.890043+0000","last_became_active":"2024-04-25T12:21:54.197028+0000","last_became_peered":"2024-04-25T12:21:54.197028+0000","last_unstale":"2024-04-25T12:22:34.890043+0000","last_undegraded":"2024-04-25T12:22:34.890043+0000","last_fullsized":"2024-04-25T12:22:34.890043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:03.069305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887087+0000","last_change":"2024-04-25T12:21:54.190517+0000","last_active":"2024-04-25T12:22:34.887087+0000","last_peered":"2024-04-25T12:22:34.887087+0000","last_clean":"2024-04-25T12:22:34.887087+0000","last_became_active":"2024-04-25T12:21:54.189711+0000","last_became_peered":"2024-04-25T12:21:54.189711+0000","last_unstale":"2024-04-25T12:22:34.887087+0000","last_undegraded":"2024-04-25T12:22:34.887087+0000","last_fullsized":"2024-04-25T12:22:34.887087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:17.879060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890320+0000","last_change":"2024-04-25T12:21:54.197205+0000","last_active":"2024-04-25T12:22:34.890320+0000","last_peered":"2024-04-25T12:22:34.890320+0000","last_clean":"2024-04-25T12:22:34.890320+0000","last_became_active":"2024-04-25T12:21:54.196933+0000","last_became_peered":"2024-04-25T12:21:54.196933+0000","last_unstale":"2024-04-25T12:22:34.890320+0000","last_undegraded":"2024-04-25T12:22:34.890320+0000","last_fullsized":"2024-04-25T12:22:34.890320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:32.003058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887450+0000","last_change":"2024-04-25T12:21:54.207709+0000","last_active":"2024-04-25T12:22:34.887450+0000","last_peered":"2024-04-25T12:22:34.887450+0000","last_clean":"2024-04-25T12:22:34.887450+0000","last_became_active":"2024-04-25T12:21:54.207027+0000","last_became_peered":"2024-04-25T12:21:54.207027+0000","last_unstale":"2024-04-25T12:22:34.887450+0000","last_undegraded":"2024-04-25T12:22:34.887450+0000","last_fullsized":"2024-04-25T12:22:34.887450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:15.116440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915838+0000","last_change":"2024-04-25T12:21:54.185338+0000","last_active":"2024-04-25T12:22:34.915838+0000","last_peered":"2024-04-25T12:22:34.915838+0000","last_clean":"2024-04-25T12:22:34.915838+0000","last_became_active":"2024-04-25T12:21:54.184502+0000","last_became_peered":"2024-04-25T12:21:54.184502+0000","last_unstale":"2024-04-25T12:22:34.915838+0000","last_undegraded":"2024-04-25T12:22:34.915838+0000","last_fullsized":"2024-04-25T12:22:34.915838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:29.865959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292679+0000","last_change":"2024-04-25T12:21:54.183773+0000","last_active":"2024-04-25T12:22:35.292679+0000","last_peered":"2024-04-25T12:22:35.292679+0000","last_clean":"2024-04-25T12:22:35.292679+0000","last_became_active":"2024-04-25T12:21:54.182924+0000","last_became_peered":"2024-04-25T12:21:54.182924+0000","last_unstale":"2024-04-25T12:22:35.292679+0000","last_undegraded":"2024-04-25T12:22:35.292679+0000","last_fullsized":"2024-04-25T12:22:35.292679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:22.046777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891694+0000","last_change":"2024-04-25T12:21:54.210631+0000","last_active":"2024-04-25T12:22:34.891694+0000","last_peered":"2024-04-25T12:22:34.891694+0000","last_clean":"2024-04-25T12:22:34.891694+0000","last_became_active":"2024-04-25T12:21:54.210333+0000","last_became_peered":"2024-04-25T12:21:54.210333+0000","last_unstale":"2024-04-25T12:22:34.891694+0000","last_undegraded":"2024-04-25T12:22:34.891694+0000","last_fullsized":"2024-04-25T12:22:34.891694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:39.783406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12028,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":24056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190,"ondisk_log_size":190,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476778,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":921600,"data_stored":712729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476779,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":125334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476778,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":124193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476777,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":121591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542186,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":125368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542187,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":121723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542186,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":121352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542186,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":913408,"data_stored":711062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:24:57.885 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:24:58.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.034+0000 7f26cd037640 1 Processor -- start 2024-04-25T12:24:58.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.034+0000 7f26cd037640 1 -- start start 2024-04-25T12:24:58.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.038+0000 7f26cd037640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f26c80723d0 0x7f26c80727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:58.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.038+0000 7f26cd037640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f26c8067b00 0x7f26c8152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:58.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.038+0000 7f26cd037640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26c80742d0 con 0x7f26c8153220 2024-04-25T12:24:58.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.038+0000 7f26cd037640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f26c8153690 con 0x7f26c8067b00 2024-04-25T12:24:58.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.038+0000 7f26cd037640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f26c8074550 con 0x7f26c80723d0 2024-04-25T12:24:58.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.038+0000 7f26c659c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f26c8067b00 0x7f26c8152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:58.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.038+0000 7f26c659c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f26c8067b00 0x7f26c8152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36030/0 (socket says 172.21.15.94:36030) 2024-04-25T12:24:58.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.038+0000 7f26c659c640 1 -- 172.21.15.94:0/2034417574 learned_addr learned my addr 172.21.15.94:0/2034417574 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:58.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.038+0000 7f26c6d9d640 1 --2- 172.21.15.94:0/2034417574 >> v2:172.21.15.111:3300/0 conn(0x7f26c80723d0 0x7f26c80727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:58.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.038+0000 7f26c659c640 1 -- 172.21.15.94:0/2034417574 >> v2:172.21.15.111:3300/0 conn(0x7f26c80723d0 msgr2=0x7f26c80727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:58.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.038+0000 7f26c659c640 1 --2- 172.21.15.94:0/2034417574 >> v2:172.21.15.111:3300/0 conn(0x7f26c80723d0 0x7f26c80727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.038+0000 7f26c659c640 1 -- 172.21.15.94:0/2034417574 >> v1:172.21.15.111:6789/0 conn(0x7f26c8153220 legacy=0x7f26c806ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:58.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.038+0000 7f26c659c640 1 -- 172.21.15.94:0/2034417574 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c8159a60 con 0x7f26c8067b00 2024-04-25T12:24:58.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.038+0000 7f26c659c640 1 --2- 172.21.15.94:0/2034417574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26c8067b00 0x7f26c8152ce0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f26c8075820 tx=0x7f26b801c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3f9a13b63b2469 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:58.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.038+0000 7f26c5d9b640 1 -- 172.21.15.94:0/2034417574 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b80b0070 con 0x7f26c8067b00 2024-04-25T12:24:58.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.038+0000 7f26c5d9b640 1 -- 172.21.15.94:0/2034417574 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26b80ab600 con 0x7f26c8067b00 2024-04-25T12:24:58.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.038+0000 7f26c5d9b640 1 -- 172.21.15.94:0/2034417574 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b80ab9d0 con 0x7f26c8067b00 2024-04-25T12:24:58.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26cd037640 1 -- 172.21.15.94:0/2034417574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26c8067b00 msgr2=0x7f26c8152ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:58.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26cd037640 1 --2- 172.21.15.94:0/2034417574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26c8067b00 0x7f26c8152ce0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f26c8075820 tx=0x7f26b801c300 comp rx=0 tx=0).stop 2024-04-25T12:24:58.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26cd037640 1 -- 172.21.15.94:0/2034417574 shutdown_connections 2024-04-25T12:24:58.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26cd037640 1 --2- 172.21.15.94:0/2034417574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26c8067b00 0x7f26c8152ce0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26cd037640 1 --2- 172.21.15.94:0/2034417574 >> v2:172.21.15.111:3300/0 conn(0x7f26c80723d0 0x7f26c80727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26cd037640 1 -- 172.21.15.94:0/2034417574 >> 172.21.15.94:0/2034417574 conn(0x7f26c80c9a70 msgr2=0x7f26c80c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:58.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26cd037640 1 -- 172.21.15.94:0/2034417574 shutdown_connections 2024-04-25T12:24:58.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26cd037640 1 -- 172.21.15.94:0/2034417574 wait complete. 2024-04-25T12:24:58.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26cd037640 1 Processor -- start 2024-04-25T12:24:58.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26cd037640 1 -- start start 2024-04-25T12:24:58.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26cd037640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f26c8067b00 0x7f26c8154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:58.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26cd037640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26c80723d0 0x7f26c8156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:58.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26cd037640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f26c8153220 0x7f26c8156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:58.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26cd037640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f26c80676a0 con 0x7f26c80723d0 2024-04-25T12:24:58.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26cd037640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f26c8159d40 con 0x7f26c8067b00 2024-04-25T12:24:58.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26cd037640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f26c8067820 con 0x7f26c8153220 2024-04-25T12:24:58.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26c659c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26c80723d0 0x7f26c8156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:58.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26c659c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26c80723d0 0x7f26c8156010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36042/0 (socket says 172.21.15.94:36042) 2024-04-25T12:24:58.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26c659c640 1 -- 172.21.15.94:0/2608530973 learned_addr learned my addr 172.21.15.94:0/2608530973 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:58.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26c6d9d640 1 --2- 172.21.15.94:0/2608530973 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f26c8067b00 0x7f26c8154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:58.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26c759e640 1 --2- 172.21.15.94:0/2608530973 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f26c8153220 0x7f26c8156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:58.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26c659c640 1 -- 172.21.15.94:0/2608530973 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f26c8153220 msgr2=0x7f26c8156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:58.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26c659c640 1 --2- 172.21.15.94:0/2608530973 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f26c8153220 0x7f26c8156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26c659c640 1 -- 172.21.15.94:0/2608530973 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f26c8067b00 msgr2=0x7f26c8154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:58.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26c659c640 1 --2- 172.21.15.94:0/2608530973 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f26c8067b00 0x7f26c8154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26c659c640 1 -- 172.21.15.94:0/2608530973 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c8154410 con 0x7f26c80723d0 2024-04-25T12:24:58.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26c6d9d640 1 --2- 172.21.15.94:0/2608530973 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f26c8067b00 0x7f26c8154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:58.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26c759e640 1 --2- 172.21.15.94:0/2608530973 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f26c8153220 0x7f26c8156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:24:58.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26c659c640 1 --2- 172.21.15.94:0/2608530973 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26c80723d0 0x7f26c8156010 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f26b8019f30 tx=0x7f26b80190a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:58.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26bf7fe640 1 -- 172.21.15.94:0/2608530973 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b80b9070 con 0x7f26c80723d0 2024-04-25T12:24:58.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26bf7fe640 1 -- 172.21.15.94:0/2608530973 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26b80b4400 con 0x7f26c80723d0 2024-04-25T12:24:58.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26cd037640 1 -- 172.21.15.94:0/2608530973 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26c80cae10 con 0x7f26c80723d0 2024-04-25T12:24:58.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26bf7fe640 1 -- 172.21.15.94:0/2608530973 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b80b0040 con 0x7f26c80723d0 2024-04-25T12:24:58.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26cd037640 1 -- 172.21.15.94:0/2608530973 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26c80cb3d0 con 0x7f26c80723d0 2024-04-25T12:24:58.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.042+0000 7f26cd037640 1 -- 172.21.15.94:0/2608530973 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26c8075df0 con 0x7f26c80723d0 2024-04-25T12:24:58.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.046+0000 7f26bf7fe640 1 -- 172.21.15.94:0/2608530973 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f26b80bc070 con 0x7f26c80723d0 2024-04-25T12:24:58.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.046+0000 7f26bf7fe640 1 --2- 172.21.15.94:0/2608530973 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f26a8068380 0x7f26a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:58.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.046+0000 7f26c6d9d640 1 --2- 172.21.15.94:0/2608530973 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f26a8068380 0x7f26a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:58.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.046+0000 7f26bf7fe640 1 -- 172.21.15.94:0/2608530973 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f26b811ff60 con 0x7f26c80723d0 2024-04-25T12:24:58.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.046+0000 7f26c6d9d640 1 --2- 172.21.15.94:0/2608530973 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f26a8068380 0x7f26a806a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f26c0007330 tx=0x7f26c000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:58.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.050+0000 7f26bf7fe640 1 -- 172.21.15.94:0/2608530973 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f26c80742d0 con 0x7f26c80723d0 2024-04-25T12:24:58.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.210+0000 7f26cd037640 1 -- 172.21.15.94:0/2608530973 --> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f26c806e970 con 0x7f26a8068380 2024-04-25T12:24:58.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.218+0000 7f26bf7fe640 1 -- 172.21.15.94:0/2608530973 <== mgr.4101 v2:172.21.15.94:6832/549402167 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332671 (secure 0 0 0) 0x7f26c006c390 con 0x7f26a8068380 2024-04-25T12:24:58.228 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:58.230 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-04-25T12:24:58.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.222+0000 7f26cd037640 1 -- 172.21.15.94:0/2608530973 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f26a8068380 msgr2=0x7f26a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:58.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.222+0000 7f26cd037640 1 --2- 172.21.15.94:0/2608530973 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f26a8068380 0x7f26a806a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f26c0007330 tx=0x7f26c000b040 comp rx=0 tx=0).stop 2024-04-25T12:24:58.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.222+0000 7f26cd037640 1 -- 172.21.15.94:0/2608530973 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26c80723d0 msgr2=0x7f26c8156010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:58.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.222+0000 7f26cd037640 1 --2- 172.21.15.94:0/2608530973 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26c80723d0 0x7f26c8156010 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f26b8019f30 tx=0x7f26b80190a0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.222+0000 7f26cd037640 1 -- 172.21.15.94:0/2608530973 shutdown_connections 2024-04-25T12:24:58.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.222+0000 7f26cd037640 1 --2- 172.21.15.94:0/2608530973 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f26a8068380 0x7f26a806a840 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.222+0000 7f26cd037640 1 --2- 172.21.15.94:0/2608530973 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f26c8153220 0x7f26c8156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.222+0000 7f26cd037640 1 --2- 172.21.15.94:0/2608530973 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26c80723d0 0x7f26c8156010 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.222+0000 7f26cd037640 1 --2- 172.21.15.94:0/2608530973 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f26c8067b00 0x7f26c8154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.222+0000 7f26cd037640 1 -- 172.21.15.94:0/2608530973 >> 172.21.15.94:0/2608530973 conn(0x7f26c80c9a70 msgr2=0x7f26c80c7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:58.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.222+0000 7f26cd037640 1 -- 172.21.15.94:0/2608530973 shutdown_connections 2024-04-25T12:24:58.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.222+0000 7f26cd037640 1 -- 172.21.15.94:0/2608530973 wait complete. 2024-04-25T12:24:58.244 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2024-04-25T12:24:57.816707+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602396,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":375,"num_write_kb":2490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307,"ondisk_log_size":307,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236456,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738264,"statfs":{"total":773094113280,"available":772851982336,"internally_reserved":0,"allocated":3776512,"data_stored":2163352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3058,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004428"},"pg_stats":[{"pgid":"2.1f","version":"28'13","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.915197+0000","last_change":"2024-04-25T12:21:53.194776+0000","last_active":"2024-04-25T12:24:43.915197+0000","last_peered":"2024-04-25T12:24:43.915197+0000","last_clean":"2024-04-25T12:24:43.915197+0000","last_became_active":"2024-04-25T12:21:53.194480+0000","last_became_peered":"2024-04-25T12:21:53.194480+0000","last_unstale":"2024-04-25T12:24:43.915197+0000","last_undegraded":"2024-04-25T12:24:43.915197+0000","last_fullsized":"2024-04-25T12:24:43.915197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:52.906255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979743+0000","last_change":"2024-04-25T12:21:54.200481+0000","last_active":"2024-04-25T12:22:34.979743+0000","last_peered":"2024-04-25T12:22:34.979743+0000","last_clean":"2024-04-25T12:22:34.979743+0000","last_became_active":"2024-04-25T12:21:54.199679+0000","last_became_peered":"2024-04-25T12:21:54.199679+0000","last_unstale":"2024-04-25T12:22:34.979743+0000","last_undegraded":"2024-04-25T12:22:34.979743+0000","last_fullsized":"2024-04-25T12:22:34.979743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:59.395265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978348+0000","last_change":"2024-04-25T12:21:58.346732+0000","last_active":"2024-04-25T12:22:34.978348+0000","last_peered":"2024-04-25T12:22:34.978348+0000","last_clean":"2024-04-25T12:22:34.978348+0000","last_became_active":"2024-04-25T12:21:58.346337+0000","last_became_peered":"2024-04-25T12:21:58.346337+0000","last_unstale":"2024-04-25T12:22:34.978348+0000","last_undegraded":"2024-04-25T12:22:34.978348+0000","last_fullsized":"2024-04-25T12:22:34.978348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:20.028661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:23:54.774933+0000","last_change":"2024-04-25T12:21:53.166281+0000","last_active":"2024-04-25T12:23:54.774933+0000","last_peered":"2024-04-25T12:23:54.774933+0000","last_clean":"2024-04-25T12:23:54.774933+0000","last_became_active":"2024-04-25T12:21:53.165990+0000","last_became_peered":"2024-04-25T12:21:53.165990+0000","last_unstale":"2024-04-25T12:23:54.774933+0000","last_undegraded":"2024-04-25T12:23:54.774933+0000","last_fullsized":"2024-04-25T12:23:54.774933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:07.228743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916094+0000","last_change":"2024-04-25T12:21:54.189754+0000","last_active":"2024-04-25T12:22:34.916094+0000","last_peered":"2024-04-25T12:22:34.916094+0000","last_clean":"2024-04-25T12:22:34.916094+0000","last_became_active":"2024-04-25T12:21:54.188987+0000","last_became_peered":"2024-04-25T12:21:54.188987+0000","last_unstale":"2024-04-25T12:22:34.916094+0000","last_undegraded":"2024-04-25T12:22:34.916094+0000","last_fullsized":"2024-04-25T12:22:34.916094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:29.603368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.892805+0000","last_change":"2024-04-25T12:21:58.251628+0000","last_active":"2024-04-25T12:22:34.892805+0000","last_peered":"2024-04-25T12:22:34.892805+0000","last_clean":"2024-04-25T12:22:34.892805+0000","last_became_active":"2024-04-25T12:21:58.250542+0000","last_became_peered":"2024-04-25T12:21:58.250542+0000","last_unstale":"2024-04-25T12:22:34.892805+0000","last_undegraded":"2024-04-25T12:22:34.892805+0000","last_fullsized":"2024-04-25T12:22:34.892805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:33.434685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'12","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.918854+0000","last_change":"2024-04-25T12:21:53.203427+0000","last_active":"2024-04-25T12:24:43.918854+0000","last_peered":"2024-04-25T12:24:43.918854+0000","last_clean":"2024-04-25T12:24:43.918854+0000","last_became_active":"2024-04-25T12:21:53.202760+0000","last_became_peered":"2024-04-25T12:21:53.202760+0000","last_unstale":"2024-04-25T12:24:43.918854+0000","last_undegraded":"2024-04-25T12:24:43.918854+0000","last_fullsized":"2024-04-25T12:24:43.918854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:44.397450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887718+0000","last_change":"2024-04-25T12:21:54.208420+0000","last_active":"2024-04-25T12:22:34.887718+0000","last_peered":"2024-04-25T12:22:34.887718+0000","last_clean":"2024-04-25T12:22:34.887718+0000","last_became_active":"2024-04-25T12:21:54.208093+0000","last_became_peered":"2024-04-25T12:21:54.208093+0000","last_unstale":"2024-04-25T12:22:34.887718+0000","last_undegraded":"2024-04-25T12:22:34.887718+0000","last_fullsized":"2024-04-25T12:22:34.887718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:08.762268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893123+0000","last_change":"2024-04-25T12:21:58.255963+0000","last_active":"2024-04-25T12:22:34.893123+0000","last_peered":"2024-04-25T12:22:34.893123+0000","last_clean":"2024-04-25T12:22:34.893123+0000","last_became_active":"2024-04-25T12:21:58.254021+0000","last_became_peered":"2024-04-25T12:21:58.254021+0000","last_unstale":"2024-04-25T12:22:34.893123+0000","last_undegraded":"2024-04-25T12:22:34.893123+0000","last_fullsized":"2024-04-25T12:22:34.893123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:20.528034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.916352+0000","last_change":"2024-04-25T12:21:53.208470+0000","last_active":"2024-04-25T12:24:43.916352+0000","last_peered":"2024-04-25T12:24:43.916352+0000","last_clean":"2024-04-25T12:24:43.916352+0000","last_became_active":"2024-04-25T12:21:53.207929+0000","last_became_peered":"2024-04-25T12:21:53.207929+0000","last_unstale":"2024-04-25T12:24:43.916352+0000","last_undegraded":"2024-04-25T12:24:43.916352+0000","last_fullsized":"2024-04-25T12:24:43.916352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:14.904832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887684+0000","last_change":"2024-04-25T12:21:54.206567+0000","last_active":"2024-04-25T12:22:34.887684+0000","last_peered":"2024-04-25T12:22:34.887684+0000","last_clean":"2024-04-25T12:22:34.887684+0000","last_became_active":"2024-04-25T12:21:54.206138+0000","last_became_peered":"2024-04-25T12:21:54.206138+0000","last_unstale":"2024-04-25T12:22:34.887684+0000","last_undegraded":"2024-04-25T12:22:34.887684+0000","last_fullsized":"2024-04-25T12:22:34.887684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:31.698845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893399+0000","last_change":"2024-04-25T12:21:58.245331+0000","last_active":"2024-04-25T12:22:34.893399+0000","last_peered":"2024-04-25T12:22:34.893399+0000","last_clean":"2024-04-25T12:22:34.893399+0000","last_became_active":"2024-04-25T12:21:58.244313+0000","last_became_peered":"2024-04-25T12:21:58.244313+0000","last_unstale":"2024-04-25T12:22:34.893399+0000","last_undegraded":"2024-04-25T12:22:34.893399+0000","last_fullsized":"2024-04-25T12:22:34.893399+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:21.595492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029274+0000","last_change":"2024-04-25T12:21:54.208935+0000","last_active":"2024-04-25T12:22:35.029274+0000","last_peered":"2024-04-25T12:22:35.029274+0000","last_clean":"2024-04-25T12:22:35.029274+0000","last_became_active":"2024-04-25T12:21:54.208338+0000","last_became_peered":"2024-04-25T12:21:54.208338+0000","last_unstale":"2024-04-25T12:22:35.029274+0000","last_undegraded":"2024-04-25T12:22:35.029274+0000","last_fullsized":"2024-04-25T12:22:35.029274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:08.485037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:25.185372+0000","last_change":"2024-04-25T12:21:53.203519+0000","last_active":"2024-04-25T12:24:25.185372+0000","last_peered":"2024-04-25T12:24:25.185372+0000","last_clean":"2024-04-25T12:24:25.185372+0000","last_became_active":"2024-04-25T12:21:53.197141+0000","last_became_peered":"2024-04-25T12:21:53.197141+0000","last_unstale":"2024-04-25T12:24:25.185372+0000","last_undegraded":"2024-04-25T12:24:25.185372+0000","last_fullsized":"2024-04-25T12:24:25.185372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:03.010472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894179+0000","last_change":"2024-04-25T12:21:58.250871+0000","last_active":"2024-04-25T12:22:34.894179+0000","last_peered":"2024-04-25T12:22:34.894179+0000","last_clean":"2024-04-25T12:22:34.894179+0000","last_became_active":"2024-04-25T12:21:58.249079+0000","last_became_peered":"2024-04-25T12:21:58.249079+0000","last_unstale":"2024-04-25T12:22:34.894179+0000","last_undegraded":"2024-04-25T12:22:34.894179+0000","last_fullsized":"2024-04-25T12:22:34.894179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:54.201824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978908+0000","last_change":"2024-04-25T12:21:54.209195+0000","last_active":"2024-04-25T12:22:34.978908+0000","last_peered":"2024-04-25T12:22:34.978908+0000","last_clean":"2024-04-25T12:22:34.978908+0000","last_became_active":"2024-04-25T12:21:54.208802+0000","last_became_peered":"2024-04-25T12:21:54.208802+0000","last_unstale":"2024-04-25T12:22:34.978908+0000","last_undegraded":"2024-04-25T12:22:34.978908+0000","last_fullsized":"2024-04-25T12:22:34.978908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:10.846624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.892354+0000","last_change":"2024-04-25T12:21:53.165498+0000","last_active":"2024-04-25T12:24:37.892354+0000","last_peered":"2024-04-25T12:24:37.892354+0000","last_clean":"2024-04-25T12:24:37.892354+0000","last_became_active":"2024-04-25T12:21:53.164867+0000","last_became_peered":"2024-04-25T12:21:53.164867+0000","last_unstale":"2024-04-25T12:24:37.892354+0000","last_undegraded":"2024-04-25T12:24:37.892354+0000","last_fullsized":"2024-04-25T12:24:37.892354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:07.312761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893517+0000","last_change":"2024-04-25T12:21:58.260620+0000","last_active":"2024-04-25T12:22:34.893517+0000","last_peered":"2024-04-25T12:22:34.893517+0000","last_clean":"2024-04-25T12:22:34.893517+0000","last_became_active":"2024-04-25T12:21:58.259595+0000","last_became_peered":"2024-04-25T12:21:58.259595+0000","last_unstale":"2024-04-25T12:22:34.893517+0000","last_undegraded":"2024-04-25T12:22:34.893517+0000","last_fullsized":"2024-04-25T12:22:34.893517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:43.230479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979100+0000","last_change":"2024-04-25T12:21:54.206960+0000","last_active":"2024-04-25T12:22:34.979100+0000","last_peered":"2024-04-25T12:22:34.979100+0000","last_clean":"2024-04-25T12:22:34.979100+0000","last_became_active":"2024-04-25T12:21:54.204650+0000","last_became_peered":"2024-04-25T12:21:54.204650+0000","last_unstale":"2024-04-25T12:22:34.979100+0000","last_undegraded":"2024-04-25T12:22:34.979100+0000","last_fullsized":"2024-04-25T12:22:34.979100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:15.888865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'7","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.916785+0000","last_change":"2024-04-25T12:21:53.193797+0000","last_active":"2024-04-25T12:24:43.916785+0000","last_peered":"2024-04-25T12:24:43.916785+0000","last_clean":"2024-04-25T12:24:43.916785+0000","last_became_active":"2024-04-25T12:21:53.193466+0000","last_became_peered":"2024-04-25T12:21:53.193466+0000","last_unstale":"2024-04-25T12:24:43.916785+0000","last_undegraded":"2024-04-25T12:24:43.916785+0000","last_fullsized":"2024-04-25T12:24:43.916785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:23.341451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292912+0000","last_change":"2024-04-25T12:21:58.348047+0000","last_active":"2024-04-25T12:22:35.292912+0000","last_peered":"2024-04-25T12:22:35.292912+0000","last_clean":"2024-04-25T12:22:35.292912+0000","last_became_active":"2024-04-25T12:21:58.347583+0000","last_became_peered":"2024-04-25T12:21:58.347583+0000","last_unstale":"2024-04-25T12:22:35.292912+0000","last_undegraded":"2024-04-25T12:22:35.292912+0000","last_fullsized":"2024-04-25T12:22:35.292912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:21:48.878907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894218+0000","last_change":"2024-04-25T12:21:54.196479+0000","last_active":"2024-04-25T12:22:34.894218+0000","last_peered":"2024-04-25T12:22:34.894218+0000","last_clean":"2024-04-25T12:22:34.894218+0000","last_became_active":"2024-04-25T12:21:54.195939+0000","last_became_peered":"2024-04-25T12:21:54.195939+0000","last_unstale":"2024-04-25T12:22:34.894218+0000","last_undegraded":"2024-04-25T12:22:34.894218+0000","last_fullsized":"2024-04-25T12:22:34.894218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:17.787145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:25.185667+0000","last_change":"2024-04-25T12:21:53.198034+0000","last_active":"2024-04-25T12:24:25.185667+0000","last_peered":"2024-04-25T12:24:25.185667+0000","last_clean":"2024-04-25T12:24:25.185667+0000","last_became_active":"2024-04-25T12:21:53.196252+0000","last_became_peered":"2024-04-25T12:21:53.196252+0000","last_unstale":"2024-04-25T12:24:25.185667+0000","last_undegraded":"2024-04-25T12:24:25.185667+0000","last_fullsized":"2024-04-25T12:24:25.185667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:08.329111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.033926+0000","last_change":"2024-04-25T12:22:35.032802+0000","last_active":"2024-04-25T12:22:35.033926+0000","last_peered":"2024-04-25T12:22:35.033926+0000","last_clean":"2024-04-25T12:22:35.033926+0000","last_became_active":"2024-04-25T12:22:35.031906+0000","last_became_peered":"2024-04-25T12:22:35.031906+0000","last_unstale":"2024-04-25T12:22:35.033926+0000","last_undegraded":"2024-04-25T12:22:35.033926+0000","last_fullsized":"2024-04-25T12:22:35.033926+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:40.346041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916736+0000","last_change":"2024-04-25T12:21:54.192601+0000","last_active":"2024-04-25T12:22:34.916736+0000","last_peered":"2024-04-25T12:22:34.916736+0000","last_clean":"2024-04-25T12:22:34.916736+0000","last_became_active":"2024-04-25T12:21:54.191864+0000","last_became_peered":"2024-04-25T12:21:54.191864+0000","last_unstale":"2024-04-25T12:22:34.916736+0000","last_undegraded":"2024-04-25T12:22:34.916736+0000","last_fullsized":"2024-04-25T12:22:34.916736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:50.392769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.916643+0000","last_change":"2024-04-25T12:21:53.197793+0000","last_active":"2024-04-25T12:24:43.916643+0000","last_peered":"2024-04-25T12:24:43.916643+0000","last_clean":"2024-04-25T12:24:43.916643+0000","last_became_active":"2024-04-25T12:21:53.197059+0000","last_became_peered":"2024-04-25T12:21:53.197059+0000","last_unstale":"2024-04-25T12:24:43.916643+0000","last_undegraded":"2024-04-25T12:24:43.916643+0000","last_fullsized":"2024-04-25T12:24:43.916643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:58.471408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893581+0000","last_change":"2024-04-25T12:21:58.355166+0000","last_active":"2024-04-25T12:22:34.893581+0000","last_peered":"2024-04-25T12:22:34.893581+0000","last_clean":"2024-04-25T12:22:34.893581+0000","last_became_active":"2024-04-25T12:21:58.353996+0000","last_became_peered":"2024-04-25T12:21:58.353996+0000","last_unstale":"2024-04-25T12:22:34.893581+0000","last_undegraded":"2024-04-25T12:22:34.893581+0000","last_fullsized":"2024-04-25T12:22:34.893581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:22.681720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980643+0000","last_change":"2024-04-25T12:21:54.219182+0000","last_active":"2024-04-25T12:22:34.980643+0000","last_peered":"2024-04-25T12:22:34.980643+0000","last_clean":"2024-04-25T12:22:34.980643+0000","last_became_active":"2024-04-25T12:21:54.218854+0000","last_became_peered":"2024-04-25T12:21:54.218854+0000","last_unstale":"2024-04-25T12:22:34.980643+0000","last_undegraded":"2024-04-25T12:22:34.980643+0000","last_fullsized":"2024-04-25T12:22:34.980643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:08.985962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'7","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.900945+0000","last_change":"2024-04-25T12:21:53.190102+0000","last_active":"2024-04-25T12:24:37.900945+0000","last_peered":"2024-04-25T12:24:37.900945+0000","last_clean":"2024-04-25T12:24:37.900945+0000","last_became_active":"2024-04-25T12:21:53.189781+0000","last_became_peered":"2024-04-25T12:21:53.189781+0000","last_unstale":"2024-04-25T12:24:37.900945+0000","last_undegraded":"2024-04-25T12:24:37.900945+0000","last_fullsized":"2024-04-25T12:24:37.900945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:52.533217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978106+0000","last_change":"2024-04-25T12:21:58.341932+0000","last_active":"2024-04-25T12:22:34.978106+0000","last_peered":"2024-04-25T12:22:34.978106+0000","last_clean":"2024-04-25T12:22:34.978106+0000","last_became_active":"2024-04-25T12:21:58.341492+0000","last_became_peered":"2024-04-25T12:21:58.341492+0000","last_unstale":"2024-04-25T12:22:34.978106+0000","last_undegraded":"2024-04-25T12:22:34.978106+0000","last_fullsized":"2024-04-25T12:22:34.978106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:51.576036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293382+0000","last_change":"2024-04-25T12:21:54.182541+0000","last_active":"2024-04-25T12:22:35.293382+0000","last_peered":"2024-04-25T12:22:35.293382+0000","last_clean":"2024-04-25T12:22:35.293382+0000","last_became_active":"2024-04-25T12:21:54.181720+0000","last_became_peered":"2024-04-25T12:21:54.181720+0000","last_unstale":"2024-04-25T12:22:35.293382+0000","last_undegraded":"2024-04-25T12:22:35.293382+0000","last_fullsized":"2024-04-25T12:22:35.293382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:00.544076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.893209+0000","last_change":"2024-04-25T12:21:53.200521+0000","last_active":"2024-04-25T12:24:37.893209+0000","last_peered":"2024-04-25T12:24:37.893209+0000","last_clean":"2024-04-25T12:24:37.893209+0000","last_became_active":"2024-04-25T12:21:53.196102+0000","last_became_peered":"2024-04-25T12:21:53.196102+0000","last_unstale":"2024-04-25T12:24:37.893209+0000","last_undegraded":"2024-04-25T12:24:37.893209+0000","last_fullsized":"2024-04-25T12:24:37.893209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:54.350452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916195+0000","last_change":"2024-04-25T12:21:58.342064+0000","last_active":"2024-04-25T12:22:34.916195+0000","last_peered":"2024-04-25T12:22:34.916195+0000","last_clean":"2024-04-25T12:22:34.916195+0000","last_became_active":"2024-04-25T12:21:58.341558+0000","last_became_peered":"2024-04-25T12:21:58.341558+0000","last_unstale":"2024-04-25T12:22:34.916195+0000","last_undegraded":"2024-04-25T12:22:34.916195+0000","last_fullsized":"2024-04-25T12:22:34.916195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:11.378767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887849+0000","last_change":"2024-04-25T12:21:54.206427+0000","last_active":"2024-04-25T12:22:34.887849+0000","last_peered":"2024-04-25T12:22:34.887849+0000","last_clean":"2024-04-25T12:22:34.887849+0000","last_became_active":"2024-04-25T12:21:54.205519+0000","last_became_peered":"2024-04-25T12:21:54.205519+0000","last_unstale":"2024-04-25T12:22:34.887849+0000","last_undegraded":"2024-04-25T12:22:34.887849+0000","last_fullsized":"2024-04-25T12:22:34.887849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:59.659460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:23:59.776320+0000","last_change":"2024-04-25T12:21:53.162914+0000","last_active":"2024-04-25T12:23:59.776320+0000","last_peered":"2024-04-25T12:23:59.776320+0000","last_clean":"2024-04-25T12:23:59.776320+0000","last_became_active":"2024-04-25T12:21:53.162599+0000","last_became_peered":"2024-04-25T12:21:53.162599+0000","last_unstale":"2024-04-25T12:23:59.776320+0000","last_undegraded":"2024-04-25T12:23:59.776320+0000","last_fullsized":"2024-04-25T12:23:59.776320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:23.448280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.920456+0000","last_change":"2024-04-25T12:22:34.919463+0000","last_active":"2024-04-25T12:22:34.920456+0000","last_peered":"2024-04-25T12:22:34.920456+0000","last_clean":"2024-04-25T12:22:34.920456+0000","last_became_active":"2024-04-25T12:22:34.917798+0000","last_became_peered":"2024-04-25T12:22:34.917798+0000","last_unstale":"2024-04-25T12:22:34.920456+0000","last_undegraded":"2024-04-25T12:22:34.920456+0000","last_fullsized":"2024-04-25T12:22:34.920456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:35.620229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894822+0000","last_change":"2024-04-25T12:21:54.202462+0000","last_active":"2024-04-25T12:22:34.894822+0000","last_peered":"2024-04-25T12:22:34.894822+0000","last_clean":"2024-04-25T12:22:34.894822+0000","last_became_active":"2024-04-25T12:21:54.202112+0000","last_became_peered":"2024-04-25T12:21:54.202112+0000","last_unstale":"2024-04-25T12:22:34.894822+0000","last_undegraded":"2024-04-25T12:22:34.894822+0000","last_fullsized":"2024-04-25T12:22:34.894822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:20.813264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.916490+0000","last_change":"2024-04-25T12:21:53.188606+0000","last_active":"2024-04-25T12:24:43.916490+0000","last_peered":"2024-04-25T12:24:43.916490+0000","last_clean":"2024-04-25T12:24:43.916490+0000","last_became_active":"2024-04-25T12:21:53.187855+0000","last_became_peered":"2024-04-25T12:21:53.187855+0000","last_unstale":"2024-04-25T12:24:43.916490+0000","last_undegraded":"2024-04-25T12:24:43.916490+0000","last_fullsized":"2024-04-25T12:24:43.916490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:52.874270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293184+0000","last_change":"2024-04-25T12:21:58.264074+0000","last_active":"2024-04-25T12:22:35.293184+0000","last_peered":"2024-04-25T12:22:35.293184+0000","last_clean":"2024-04-25T12:22:35.293184+0000","last_became_active":"2024-04-25T12:21:58.263425+0000","last_became_peered":"2024-04-25T12:21:58.263425+0000","last_unstale":"2024-04-25T12:22:35.293184+0000","last_undegraded":"2024-04-25T12:22:35.293184+0000","last_fullsized":"2024-04-25T12:22:35.293184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:02.083494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292583+0000","last_change":"2024-04-25T12:21:54.189512+0000","last_active":"2024-04-25T12:22:35.292583+0000","last_peered":"2024-04-25T12:22:35.292583+0000","last_clean":"2024-04-25T12:22:35.292583+0000","last_became_active":"2024-04-25T12:21:54.188587+0000","last_became_peered":"2024-04-25T12:21:54.188587+0000","last_unstale":"2024-04-25T12:22:35.292583+0000","last_undegraded":"2024-04-25T12:22:35.292583+0000","last_fullsized":"2024-04-25T12:22:35.292583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:00.810648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.913498+0000","last_change":"2024-04-25T12:21:53.159998+0000","last_active":"2024-04-25T12:24:43.913498+0000","last_peered":"2024-04-25T12:24:43.913498+0000","last_clean":"2024-04-25T12:24:43.913498+0000","last_became_active":"2024-04-25T12:21:53.159714+0000","last_became_peered":"2024-04-25T12:21:53.159714+0000","last_unstale":"2024-04-25T12:24:43.913498+0000","last_undegraded":"2024-04-25T12:24:43.913498+0000","last_fullsized":"2024-04-25T12:24:43.913498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:38.665874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.983753+0000","last_change":"2024-04-25T12:22:34.982542+0000","last_active":"2024-04-25T12:22:34.983753+0000","last_peered":"2024-04-25T12:22:34.983753+0000","last_clean":"2024-04-25T12:22:34.983753+0000","last_became_active":"2024-04-25T12:22:34.981347+0000","last_became_peered":"2024-04-25T12:22:34.981347+0000","last_unstale":"2024-04-25T12:22:34.983753+0000","last_undegraded":"2024-04-25T12:22:34.983753+0000","last_fullsized":"2024-04-25T12:22:34.983753+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:55.180698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915214+0000","last_change":"2024-04-25T12:21:54.205348+0000","last_active":"2024-04-25T12:22:34.915214+0000","last_peered":"2024-04-25T12:22:34.915214+0000","last_clean":"2024-04-25T12:22:34.915214+0000","last_became_active":"2024-04-25T12:21:54.205023+0000","last_became_peered":"2024-04-25T12:21:54.205023+0000","last_unstale":"2024-04-25T12:22:34.915214+0000","last_undegraded":"2024-04-25T12:22:34.915214+0000","last_fullsized":"2024-04-25T12:22:34.915214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:46.381368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:31.226144+0000","last_change":"2024-04-25T12:21:53.201066+0000","last_active":"2024-04-25T12:24:31.226144+0000","last_peered":"2024-04-25T12:24:31.226144+0000","last_clean":"2024-04-25T12:24:31.226144+0000","last_became_active":"2024-04-25T12:21:53.197081+0000","last_became_peered":"2024-04-25T12:21:53.197081+0000","last_unstale":"2024-04-25T12:24:31.226144+0000","last_undegraded":"2024-04-25T12:24:31.226144+0000","last_fullsized":"2024-04-25T12:24:31.226144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:19.865455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916511+0000","last_change":"2024-04-25T12:21:58.343823+0000","last_active":"2024-04-25T12:22:34.916511+0000","last_peered":"2024-04-25T12:22:34.916511+0000","last_clean":"2024-04-25T12:22:34.916511+0000","last_became_active":"2024-04-25T12:21:58.342796+0000","last_became_peered":"2024-04-25T12:21:58.342796+0000","last_unstale":"2024-04-25T12:22:34.916511+0000","last_undegraded":"2024-04-25T12:22:34.916511+0000","last_fullsized":"2024-04-25T12:22:34.916511+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:14.849636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979107+0000","last_change":"2024-04-25T12:21:54.204569+0000","last_active":"2024-04-25T12:22:34.979107+0000","last_peered":"2024-04-25T12:22:34.979107+0000","last_clean":"2024-04-25T12:22:34.979107+0000","last_became_active":"2024-04-25T12:21:54.204212+0000","last_became_peered":"2024-04-25T12:21:54.204212+0000","last_unstale":"2024-04-25T12:22:34.979107+0000","last_undegraded":"2024-04-25T12:22:34.979107+0000","last_fullsized":"2024-04-25T12:22:34.979107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:44.245327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.897489+0000","last_change":"2024-04-25T12:21:53.169844+0000","last_active":"2024-04-25T12:24:37.897489+0000","last_peered":"2024-04-25T12:24:37.897489+0000","last_clean":"2024-04-25T12:24:37.897489+0000","last_became_active":"2024-04-25T12:21:53.168939+0000","last_became_peered":"2024-04-25T12:21:53.168939+0000","last_unstale":"2024-04-25T12:24:37.897489+0000","last_undegraded":"2024-04-25T12:24:37.897489+0000","last_fullsized":"2024-04-25T12:24:37.897489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:57.836476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.888439+0000","last_change":"2024-04-25T12:21:42.610528+0000","last_active":"2024-04-25T12:22:34.888439+0000","last_peered":"2024-04-25T12:22:34.888439+0000","last_clean":"2024-04-25T12:22:34.888439+0000","last_became_active":"2024-04-25T12:21:42.608579+0000","last_became_peered":"2024-04-25T12:21:42.608579+0000","last_unstale":"2024-04-25T12:22:34.888439+0000","last_undegraded":"2024-04-25T12:22:34.888439+0000","last_fullsized":"2024-04-25T12:22:34.888439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:39.904333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:39.904333+0000","last_clean_scrub_stamp":"2024-04-25T12:21:39.904333+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:16.122851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029891+0000","last_change":"2024-04-25T12:21:58.351105+0000","last_active":"2024-04-25T12:22:35.029891+0000","last_peered":"2024-04-25T12:22:35.029891+0000","last_clean":"2024-04-25T12:22:35.029891+0000","last_became_active":"2024-04-25T12:21:58.350087+0000","last_became_peered":"2024-04-25T12:21:58.350087+0000","last_unstale":"2024-04-25T12:22:35.029891+0000","last_undegraded":"2024-04-25T12:22:35.029891+0000","last_fullsized":"2024-04-25T12:22:35.029891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:22.686410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891042+0000","last_change":"2024-04-25T12:21:54.215530+0000","last_active":"2024-04-25T12:22:34.891042+0000","last_peered":"2024-04-25T12:22:34.891042+0000","last_clean":"2024-04-25T12:22:34.891042+0000","last_became_active":"2024-04-25T12:21:54.211077+0000","last_became_peered":"2024-04-25T12:21:54.211077+0000","last_unstale":"2024-04-25T12:22:34.891042+0000","last_undegraded":"2024-04-25T12:22:34.891042+0000","last_fullsized":"2024-04-25T12:22:34.891042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:03.079964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.903231+0000","last_change":"2024-04-25T12:21:53.175259+0000","last_active":"2024-04-25T12:24:37.903231+0000","last_peered":"2024-04-25T12:24:37.903231+0000","last_clean":"2024-04-25T12:24:37.903231+0000","last_became_active":"2024-04-25T12:21:53.174980+0000","last_became_peered":"2024-04-25T12:21:53.174980+0000","last_unstale":"2024-04-25T12:24:37.903231+0000","last_undegraded":"2024-04-25T12:24:37.903231+0000","last_fullsized":"2024-04-25T12:24:37.903231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:51.852590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029315+0000","last_change":"2024-04-25T12:21:58.344660+0000","last_active":"2024-04-25T12:22:35.029315+0000","last_peered":"2024-04-25T12:22:35.029315+0000","last_clean":"2024-04-25T12:22:35.029315+0000","last_became_active":"2024-04-25T12:21:58.343502+0000","last_became_peered":"2024-04-25T12:21:58.343502+0000","last_unstale":"2024-04-25T12:22:35.029315+0000","last_undegraded":"2024-04-25T12:22:35.029315+0000","last_fullsized":"2024-04-25T12:22:35.029315+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:46.127740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887959+0000","last_change":"2024-04-25T12:21:54.207666+0000","last_active":"2024-04-25T12:22:34.887959+0000","last_peered":"2024-04-25T12:22:34.887959+0000","last_clean":"2024-04-25T12:22:34.887959+0000","last_became_active":"2024-04-25T12:21:54.206749+0000","last_became_peered":"2024-04-25T12:21:54.206749+0000","last_unstale":"2024-04-25T12:22:34.887959+0000","last_undegraded":"2024-04-25T12:22:34.887959+0000","last_fullsized":"2024-04-25T12:22:34.887959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:36.113364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.900925+0000","last_change":"2024-04-25T12:21:53.179412+0000","last_active":"2024-04-25T12:24:37.900925+0000","last_peered":"2024-04-25T12:24:37.900925+0000","last_clean":"2024-04-25T12:24:37.900925+0000","last_became_active":"2024-04-25T12:21:53.179142+0000","last_became_peered":"2024-04-25T12:21:53.179142+0000","last_unstale":"2024-04-25T12:24:37.900925+0000","last_undegraded":"2024-04-25T12:24:37.900925+0000","last_fullsized":"2024-04-25T12:24:37.900925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:08.771439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915942+0000","last_change":"2024-04-25T12:21:58.254119+0000","last_active":"2024-04-25T12:22:34.915942+0000","last_peered":"2024-04-25T12:22:34.915942+0000","last_clean":"2024-04-25T12:22:34.915942+0000","last_became_active":"2024-04-25T12:21:58.253624+0000","last_became_peered":"2024-04-25T12:21:58.253624+0000","last_unstale":"2024-04-25T12:22:34.915942+0000","last_undegraded":"2024-04-25T12:22:34.915942+0000","last_fullsized":"2024-04-25T12:22:34.915942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:54.719908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891979+0000","last_change":"2024-04-25T12:21:54.219803+0000","last_active":"2024-04-25T12:22:34.891979+0000","last_peered":"2024-04-25T12:22:34.891979+0000","last_clean":"2024-04-25T12:22:34.891979+0000","last_became_active":"2024-04-25T12:21:54.219513+0000","last_became_peered":"2024-04-25T12:21:54.219513+0000","last_unstale":"2024-04-25T12:22:34.891979+0000","last_undegraded":"2024-04-25T12:22:34.891979+0000","last_fullsized":"2024-04-25T12:22:34.891979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:03.617773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.912860+0000","last_change":"2024-04-25T12:21:53.159382+0000","last_active":"2024-04-25T12:24:43.912860+0000","last_peered":"2024-04-25T12:24:43.912860+0000","last_clean":"2024-04-25T12:24:43.912860+0000","last_became_active":"2024-04-25T12:21:53.159018+0000","last_became_peered":"2024-04-25T12:21:53.159018+0000","last_unstale":"2024-04-25T12:24:43.912860+0000","last_undegraded":"2024-04-25T12:24:43.912860+0000","last_fullsized":"2024-04-25T12:24:43.912860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:39.868721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.885990+0000","last_change":"2024-04-25T12:21:58.344915+0000","last_active":"2024-04-25T12:22:34.885990+0000","last_peered":"2024-04-25T12:22:34.885990+0000","last_clean":"2024-04-25T12:22:34.885990+0000","last_became_active":"2024-04-25T12:21:58.343839+0000","last_became_peered":"2024-04-25T12:21:58.343839+0000","last_unstale":"2024-04-25T12:22:34.885990+0000","last_undegraded":"2024-04-25T12:22:34.885990+0000","last_fullsized":"2024-04-25T12:22:34.885990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:20.784047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891353+0000","last_change":"2024-04-25T12:21:54.215509+0000","last_active":"2024-04-25T12:22:34.891353+0000","last_peered":"2024-04-25T12:22:34.891353+0000","last_clean":"2024-04-25T12:22:34.891353+0000","last_became_active":"2024-04-25T12:21:54.211719+0000","last_became_peered":"2024-04-25T12:21:54.211719+0000","last_unstale":"2024-04-25T12:22:34.891353+0000","last_undegraded":"2024-04-25T12:22:34.891353+0000","last_fullsized":"2024-04-25T12:22:34.891353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:21.047044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'2","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:10.988142+0000","last_change":"2024-04-25T12:21:53.170513+0000","last_active":"2024-04-25T12:24:10.988142+0000","last_peered":"2024-04-25T12:24:10.988142+0000","last_clean":"2024-04-25T12:24:10.988142+0000","last_became_active":"2024-04-25T12:21:53.169743+0000","last_became_peered":"2024-04-25T12:21:53.169743+0000","last_unstale":"2024-04-25T12:24:10.988142+0000","last_undegraded":"2024-04-25T12:24:10.988142+0000","last_fullsized":"2024-04-25T12:24:10.988142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:03.566639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893058+0000","last_change":"2024-04-25T12:21:58.254432+0000","last_active":"2024-04-25T12:22:34.893058+0000","last_peered":"2024-04-25T12:22:34.893058+0000","last_clean":"2024-04-25T12:22:34.893058+0000","last_became_active":"2024-04-25T12:21:58.253256+0000","last_became_peered":"2024-04-25T12:21:58.253256+0000","last_unstale":"2024-04-25T12:22:34.893058+0000","last_undegraded":"2024-04-25T12:22:34.893058+0000","last_fullsized":"2024-04-25T12:22:34.893058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:13.469118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.897492+0000","last_change":"2024-04-25T12:22:34.896289+0000","last_active":"2024-04-25T12:22:34.897492+0000","last_peered":"2024-04-25T12:22:34.897492+0000","last_clean":"2024-04-25T12:22:34.897492+0000","last_became_active":"2024-04-25T12:22:34.895584+0000","last_became_peered":"2024-04-25T12:22:34.895584+0000","last_unstale":"2024-04-25T12:22:34.897492+0000","last_undegraded":"2024-04-25T12:22:34.897492+0000","last_fullsized":"2024-04-25T12:22:34.897492+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:54.648002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"28'17","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.895231+0000","last_change":"2024-04-25T12:21:53.163846+0000","last_active":"2024-04-25T12:24:37.895231+0000","last_peered":"2024-04-25T12:24:37.895231+0000","last_clean":"2024-04-25T12:24:37.895231+0000","last_became_active":"2024-04-25T12:21:53.163565+0000","last_became_peered":"2024-04-25T12:21:53.163565+0000","last_unstale":"2024-04-25T12:24:37.895231+0000","last_undegraded":"2024-04-25T12:24:37.895231+0000","last_fullsized":"2024-04-25T12:24:37.895231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:22.297830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916263+0000","last_change":"2024-04-25T12:21:58.250582+0000","last_active":"2024-04-25T12:22:34.916263+0000","last_peered":"2024-04-25T12:22:34.916263+0000","last_clean":"2024-04-25T12:22:34.916263+0000","last_became_active":"2024-04-25T12:21:58.250136+0000","last_became_peered":"2024-04-25T12:21:58.250136+0000","last_unstale":"2024-04-25T12:22:34.916263+0000","last_undegraded":"2024-04-25T12:22:34.916263+0000","last_fullsized":"2024-04-25T12:22:34.916263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:23.786586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030261+0000","last_change":"2024-04-25T12:21:54.200492+0000","last_active":"2024-04-25T12:22:35.030261+0000","last_peered":"2024-04-25T12:22:35.030261+0000","last_clean":"2024-04-25T12:22:35.030261+0000","last_became_active":"2024-04-25T12:21:54.200187+0000","last_became_peered":"2024-04-25T12:21:54.200187+0000","last_unstale":"2024-04-25T12:22:35.030261+0000","last_undegraded":"2024-04-25T12:22:35.030261+0000","last_fullsized":"2024-04-25T12:22:35.030261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:17.428348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.895785+0000","last_change":"2024-04-25T12:21:53.186752+0000","last_active":"2024-04-25T12:24:37.895785+0000","last_peered":"2024-04-25T12:24:37.895785+0000","last_clean":"2024-04-25T12:24:37.895785+0000","last_became_active":"2024-04-25T12:21:53.184866+0000","last_became_peered":"2024-04-25T12:21:53.184866+0000","last_unstale":"2024-04-25T12:24:37.895785+0000","last_undegraded":"2024-04-25T12:24:37.895785+0000","last_fullsized":"2024-04-25T12:24:37.895785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:07.228743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980381+0000","last_change":"2024-04-25T12:21:58.344241+0000","last_active":"2024-04-25T12:22:34.980381+0000","last_peered":"2024-04-25T12:22:34.980381+0000","last_clean":"2024-04-25T12:22:34.980381+0000","last_became_active":"2024-04-25T12:21:58.343764+0000","last_became_peered":"2024-04-25T12:21:58.343764+0000","last_unstale":"2024-04-25T12:22:34.980381+0000","last_undegraded":"2024-04-25T12:22:34.980381+0000","last_fullsized":"2024-04-25T12:22:34.980381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:25.931918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890533+0000","last_change":"2024-04-25T12:21:54.216405+0000","last_active":"2024-04-25T12:22:34.890533+0000","last_peered":"2024-04-25T12:22:34.890533+0000","last_clean":"2024-04-25T12:22:34.890533+0000","last_became_active":"2024-04-25T12:21:54.215575+0000","last_became_peered":"2024-04-25T12:21:54.215575+0000","last_unstale":"2024-04-25T12:22:34.890533+0000","last_undegraded":"2024-04-25T12:22:34.890533+0000","last_fullsized":"2024-04-25T12:22:34.890533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:57.935295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.896331+0000","last_change":"2024-04-25T12:21:53.198384+0000","last_active":"2024-04-25T12:24:37.896331+0000","last_peered":"2024-04-25T12:24:37.896331+0000","last_clean":"2024-04-25T12:24:37.896331+0000","last_became_active":"2024-04-25T12:21:53.197618+0000","last_became_peered":"2024-04-25T12:21:53.197618+0000","last_unstale":"2024-04-25T12:24:37.896331+0000","last_undegraded":"2024-04-25T12:24:37.896331+0000","last_fullsized":"2024-04-25T12:24:37.896331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:23.368197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979881+0000","last_change":"2024-04-25T12:21:58.342445+0000","last_active":"2024-04-25T12:22:34.979881+0000","last_peered":"2024-04-25T12:22:34.979881+0000","last_clean":"2024-04-25T12:22:34.979881+0000","last_became_active":"2024-04-25T12:21:58.341575+0000","last_became_peered":"2024-04-25T12:21:58.341575+0000","last_unstale":"2024-04-25T12:22:34.979881+0000","last_undegraded":"2024-04-25T12:22:34.979881+0000","last_fullsized":"2024-04-25T12:22:34.979881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:34.553686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915983+0000","last_change":"2024-04-25T12:21:54.200799+0000","last_active":"2024-04-25T12:22:34.915983+0000","last_peered":"2024-04-25T12:22:34.915983+0000","last_clean":"2024-04-25T12:22:34.915983+0000","last_became_active":"2024-04-25T12:21:54.200209+0000","last_became_peered":"2024-04-25T12:21:54.200209+0000","last_unstale":"2024-04-25T12:22:34.915983+0000","last_undegraded":"2024-04-25T12:22:34.915983+0000","last_fullsized":"2024-04-25T12:22:34.915983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:57.958942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.912380+0000","last_change":"2024-04-25T12:21:53.168731+0000","last_active":"2024-04-25T12:24:43.912380+0000","last_peered":"2024-04-25T12:24:43.912380+0000","last_clean":"2024-04-25T12:24:43.912380+0000","last_became_active":"2024-04-25T12:21:53.168461+0000","last_became_peered":"2024-04-25T12:21:53.168461+0000","last_unstale":"2024-04-25T12:24:43.912380+0000","last_undegraded":"2024-04-25T12:24:43.912380+0000","last_fullsized":"2024-04-25T12:24:43.912380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:34.935857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887582+0000","last_change":"2024-04-25T12:21:58.344622+0000","last_active":"2024-04-25T12:22:34.887582+0000","last_peered":"2024-04-25T12:22:34.887582+0000","last_clean":"2024-04-25T12:22:34.887582+0000","last_became_active":"2024-04-25T12:21:58.343533+0000","last_became_peered":"2024-04-25T12:21:58.343533+0000","last_unstale":"2024-04-25T12:22:34.887582+0000","last_undegraded":"2024-04-25T12:22:34.887582+0000","last_fullsized":"2024-04-25T12:22:34.887582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:35.536857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891003+0000","last_change":"2024-04-25T12:21:54.216903+0000","last_active":"2024-04-25T12:22:34.891003+0000","last_peered":"2024-04-25T12:22:34.891003+0000","last_clean":"2024-04-25T12:22:34.891003+0000","last_became_active":"2024-04-25T12:21:54.216312+0000","last_became_peered":"2024-04-25T12:21:54.216312+0000","last_unstale":"2024-04-25T12:22:34.891003+0000","last_undegraded":"2024-04-25T12:22:34.891003+0000","last_fullsized":"2024-04-25T12:22:34.891003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:12.963783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'16","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:51.472761+0000","last_change":"2024-04-25T12:21:53.179160+0000","last_active":"2024-04-25T12:24:51.472761+0000","last_peered":"2024-04-25T12:24:51.472761+0000","last_clean":"2024-04-25T12:24:51.472761+0000","last_became_active":"2024-04-25T12:21:53.177229+0000","last_became_peered":"2024-04-25T12:21:53.177229+0000","last_unstale":"2024-04-25T12:24:51.472761+0000","last_undegraded":"2024-04-25T12:24:51.472761+0000","last_fullsized":"2024-04-25T12:24:51.472761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:09.082459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4283,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293725+0000","last_change":"2024-04-25T12:21:58.245003+0000","last_active":"2024-04-25T12:22:35.293725+0000","last_peered":"2024-04-25T12:22:35.293725+0000","last_clean":"2024-04-25T12:22:35.293725+0000","last_became_active":"2024-04-25T12:21:58.244500+0000","last_became_peered":"2024-04-25T12:21:58.244500+0000","last_unstale":"2024-04-25T12:22:35.293725+0000","last_undegraded":"2024-04-25T12:22:35.293725+0000","last_fullsized":"2024-04-25T12:22:35.293725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:35.010344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.895285+0000","last_change":"2024-04-25T12:21:54.213845+0000","last_active":"2024-04-25T12:22:34.895285+0000","last_peered":"2024-04-25T12:22:34.895285+0000","last_clean":"2024-04-25T12:22:34.895285+0000","last_became_active":"2024-04-25T12:21:54.213413+0000","last_became_peered":"2024-04-25T12:21:54.213413+0000","last_unstale":"2024-04-25T12:22:34.895285+0000","last_undegraded":"2024-04-25T12:22:34.895285+0000","last_fullsized":"2024-04-25T12:22:34.895285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:59.864079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:25.191571+0000","last_change":"2024-04-25T12:21:53.186487+0000","last_active":"2024-04-25T12:24:25.191571+0000","last_peered":"2024-04-25T12:24:25.191571+0000","last_clean":"2024-04-25T12:24:25.191571+0000","last_became_active":"2024-04-25T12:21:53.186227+0000","last_became_peered":"2024-04-25T12:21:53.186227+0000","last_unstale":"2024-04-25T12:24:25.191571+0000","last_undegraded":"2024-04-25T12:24:25.191571+0000","last_fullsized":"2024-04-25T12:24:25.191571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:20.317103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894312+0000","last_change":"2024-04-25T12:21:58.249806+0000","last_active":"2024-04-25T12:22:34.894312+0000","last_peered":"2024-04-25T12:22:34.894312+0000","last_clean":"2024-04-25T12:22:34.894312+0000","last_became_active":"2024-04-25T12:21:58.248841+0000","last_became_peered":"2024-04-25T12:21:58.248841+0000","last_unstale":"2024-04-25T12:22:34.894312+0000","last_undegraded":"2024-04-25T12:22:34.894312+0000","last_fullsized":"2024-04-25T12:22:34.894312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:18.448118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916576+0000","last_change":"2024-04-25T12:21:54.189948+0000","last_active":"2024-04-25T12:22:34.916576+0000","last_peered":"2024-04-25T12:22:34.916576+0000","last_clean":"2024-04-25T12:22:34.916576+0000","last_became_active":"2024-04-25T12:21:54.189097+0000","last_became_peered":"2024-04-25T12:21:54.189097+0000","last_unstale":"2024-04-25T12:22:34.916576+0000","last_undegraded":"2024-04-25T12:22:34.916576+0000","last_fullsized":"2024-04-25T12:22:34.916576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:09.029536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'4","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.916749+0000","last_change":"2024-04-25T12:21:53.206472+0000","last_active":"2024-04-25T12:24:43.916749+0000","last_peered":"2024-04-25T12:24:43.916749+0000","last_clean":"2024-04-25T12:24:43.916749+0000","last_became_active":"2024-04-25T12:21:53.205742+0000","last_became_peered":"2024-04-25T12:21:53.205742+0000","last_unstale":"2024-04-25T12:24:43.916749+0000","last_undegraded":"2024-04-25T12:24:43.916749+0000","last_fullsized":"2024-04-25T12:24:43.916749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:37.444336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978676+0000","last_change":"2024-04-25T12:21:58.261490+0000","last_active":"2024-04-25T12:22:34.978676+0000","last_peered":"2024-04-25T12:22:34.978676+0000","last_clean":"2024-04-25T12:22:34.978676+0000","last_became_active":"2024-04-25T12:21:58.260979+0000","last_became_peered":"2024-04-25T12:21:58.260979+0000","last_unstale":"2024-04-25T12:22:34.978676+0000","last_undegraded":"2024-04-25T12:22:34.978676+0000","last_fullsized":"2024-04-25T12:22:34.978676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:51.396618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890271+0000","last_change":"2024-04-25T12:22:34.890271+0000","last_active":"2024-04-25T12:22:34.890271+0000","last_peered":"2024-04-25T12:22:34.890271+0000","last_clean":"2024-04-25T12:22:34.890271+0000","last_became_active":"2024-04-25T12:22:34.889562+0000","last_became_peered":"2024-04-25T12:22:34.889562+0000","last_unstale":"2024-04-25T12:22:34.890271+0000","last_undegraded":"2024-04-25T12:22:34.890271+0000","last_fullsized":"2024-04-25T12:22:34.890271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:17.476913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.895701+0000","last_change":"2024-04-25T12:21:53.206850+0000","last_active":"2024-04-25T12:24:37.895701+0000","last_peered":"2024-04-25T12:24:37.895701+0000","last_clean":"2024-04-25T12:24:37.895701+0000","last_became_active":"2024-04-25T12:21:53.206274+0000","last_became_peered":"2024-04-25T12:21:53.206274+0000","last_unstale":"2024-04-25T12:24:37.895701+0000","last_undegraded":"2024-04-25T12:24:37.895701+0000","last_fullsized":"2024-04-25T12:24:37.895701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:25.867387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979375+0000","last_change":"2024-04-25T12:21:58.346593+0000","last_active":"2024-04-25T12:22:34.979375+0000","last_peered":"2024-04-25T12:22:34.979375+0000","last_clean":"2024-04-25T12:22:34.979375+0000","last_became_active":"2024-04-25T12:21:58.346195+0000","last_became_peered":"2024-04-25T12:21:58.346195+0000","last_unstale":"2024-04-25T12:22:34.979375+0000","last_undegraded":"2024-04-25T12:22:34.979375+0000","last_fullsized":"2024-04-25T12:22:34.979375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:47.745861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915960+0000","last_change":"2024-04-25T12:21:58.347908+0000","last_active":"2024-04-25T12:22:34.915960+0000","last_peered":"2024-04-25T12:22:34.915960+0000","last_clean":"2024-04-25T12:22:34.915960+0000","last_became_active":"2024-04-25T12:21:58.346887+0000","last_became_peered":"2024-04-25T12:21:58.346887+0000","last_unstale":"2024-04-25T12:22:34.915960+0000","last_undegraded":"2024-04-25T12:22:34.915960+0000","last_fullsized":"2024-04-25T12:22:34.915960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:06.228605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.291914+0000","last_change":"2024-04-25T12:21:54.203140+0000","last_active":"2024-04-25T12:22:35.291914+0000","last_peered":"2024-04-25T12:22:35.291914+0000","last_clean":"2024-04-25T12:22:35.291914+0000","last_became_active":"2024-04-25T12:21:54.202399+0000","last_became_peered":"2024-04-25T12:21:54.202399+0000","last_unstale":"2024-04-25T12:22:35.291914+0000","last_undegraded":"2024-04-25T12:22:35.291914+0000","last_fullsized":"2024-04-25T12:22:35.291914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:19.691760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'3","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.900829+0000","last_change":"2024-04-25T12:21:53.202038+0000","last_active":"2024-04-25T12:24:37.900829+0000","last_peered":"2024-04-25T12:24:37.900829+0000","last_clean":"2024-04-25T12:24:37.900829+0000","last_became_active":"2024-04-25T12:21:53.189592+0000","last_became_peered":"2024-04-25T12:21:53.189592+0000","last_unstale":"2024-04-25T12:24:37.900829+0000","last_undegraded":"2024-04-25T12:24:37.900829+0000","last_fullsized":"2024-04-25T12:24:37.900829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:38.052120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030482+0000","last_change":"2024-04-25T12:21:58.246247+0000","last_active":"2024-04-25T12:22:35.030482+0000","last_peered":"2024-04-25T12:22:35.030482+0000","last_clean":"2024-04-25T12:22:35.030482+0000","last_became_active":"2024-04-25T12:21:58.245085+0000","last_became_peered":"2024-04-25T12:21:58.245085+0000","last_unstale":"2024-04-25T12:22:35.030482+0000","last_undegraded":"2024-04-25T12:22:35.030482+0000","last_fullsized":"2024-04-25T12:22:35.030482+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:24.660921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978856+0000","last_change":"2024-04-25T12:21:54.207534+0000","last_active":"2024-04-25T12:22:34.978856+0000","last_peered":"2024-04-25T12:22:34.978856+0000","last_clean":"2024-04-25T12:22:34.978856+0000","last_became_active":"2024-04-25T12:21:54.206786+0000","last_became_peered":"2024-04-25T12:21:54.206786+0000","last_unstale":"2024-04-25T12:22:34.978856+0000","last_undegraded":"2024-04-25T12:22:34.978856+0000","last_fullsized":"2024-04-25T12:22:34.978856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:48.775827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:31.226688+0000","last_change":"2024-04-25T12:21:53.190402+0000","last_active":"2024-04-25T12:24:31.226688+0000","last_peered":"2024-04-25T12:24:31.226688+0000","last_clean":"2024-04-25T12:24:31.226688+0000","last_became_active":"2024-04-25T12:21:53.189936+0000","last_became_peered":"2024-04-25T12:21:53.189936+0000","last_unstale":"2024-04-25T12:24:31.226688+0000","last_undegraded":"2024-04-25T12:24:31.226688+0000","last_fullsized":"2024-04-25T12:24:31.226688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:30.984588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.895874+0000","last_change":"2024-04-25T12:21:53.186071+0000","last_active":"2024-04-25T12:24:37.895874+0000","last_peered":"2024-04-25T12:24:37.895874+0000","last_clean":"2024-04-25T12:24:37.895874+0000","last_became_active":"2024-04-25T12:21:53.185357+0000","last_became_peered":"2024-04-25T12:21:53.185357+0000","last_unstale":"2024-04-25T12:24:37.895874+0000","last_undegraded":"2024-04-25T12:24:37.895874+0000","last_fullsized":"2024-04-25T12:24:37.895874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:10.148702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916445+0000","last_change":"2024-04-25T12:21:54.205678+0000","last_active":"2024-04-25T12:22:34.916445+0000","last_peered":"2024-04-25T12:22:34.916445+0000","last_clean":"2024-04-25T12:22:34.916445+0000","last_became_active":"2024-04-25T12:21:54.205219+0000","last_became_peered":"2024-04-25T12:21:54.205219+0000","last_unstale":"2024-04-25T12:22:34.916445+0000","last_undegraded":"2024-04-25T12:22:34.916445+0000","last_fullsized":"2024-04-25T12:22:34.916445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:55.152284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884465+0000","last_change":"2024-04-25T12:21:58.257395+0000","last_active":"2024-04-25T12:22:34.884465+0000","last_peered":"2024-04-25T12:22:34.884465+0000","last_clean":"2024-04-25T12:22:34.884465+0000","last_became_active":"2024-04-25T12:21:58.256219+0000","last_became_peered":"2024-04-25T12:21:58.256219+0000","last_unstale":"2024-04-25T12:22:34.884465+0000","last_undegraded":"2024-04-25T12:22:34.884465+0000","last_fullsized":"2024-04-25T12:22:34.884465+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:15.119967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:25.197594+0000","last_change":"2024-04-25T12:21:53.194633+0000","last_active":"2024-04-25T12:24:25.197594+0000","last_peered":"2024-04-25T12:24:25.197594+0000","last_clean":"2024-04-25T12:24:25.197594+0000","last_became_active":"2024-04-25T12:21:53.194306+0000","last_became_peered":"2024-04-25T12:21:53.194306+0000","last_unstale":"2024-04-25T12:24:25.197594+0000","last_undegraded":"2024-04-25T12:24:25.197594+0000","last_fullsized":"2024-04-25T12:24:25.197594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:03.566639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1063,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894127+0000","last_change":"2024-04-25T12:21:54.201494+0000","last_active":"2024-04-25T12:22:34.894127+0000","last_peered":"2024-04-25T12:22:34.894127+0000","last_clean":"2024-04-25T12:22:34.894127+0000","last_became_active":"2024-04-25T12:21:54.196085+0000","last_became_peered":"2024-04-25T12:21:54.196085+0000","last_unstale":"2024-04-25T12:22:34.894127+0000","last_undegraded":"2024-04-25T12:22:34.894127+0000","last_fullsized":"2024-04-25T12:22:34.894127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:21.183608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979718+0000","last_change":"2024-04-25T12:21:58.261744+0000","last_active":"2024-04-25T12:22:34.979718+0000","last_peered":"2024-04-25T12:22:34.979718+0000","last_clean":"2024-04-25T12:22:34.979718+0000","last_became_active":"2024-04-25T12:21:58.260821+0000","last_became_peered":"2024-04-25T12:21:58.260821+0000","last_unstale":"2024-04-25T12:22:34.979718+0000","last_undegraded":"2024-04-25T12:22:34.979718+0000","last_fullsized":"2024-04-25T12:22:34.979718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:14.169485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029125+0000","last_change":"2024-04-25T12:21:54.201042+0000","last_active":"2024-04-25T12:22:35.029125+0000","last_peered":"2024-04-25T12:22:35.029125+0000","last_clean":"2024-04-25T12:22:35.029125+0000","last_became_active":"2024-04-25T12:21:54.200446+0000","last_became_peered":"2024-04-25T12:21:54.200446+0000","last_unstale":"2024-04-25T12:22:35.029125+0000","last_undegraded":"2024-04-25T12:22:35.029125+0000","last_fullsized":"2024-04-25T12:22:35.029125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:37.866196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884359+0000","last_change":"2024-04-25T12:21:54.188004+0000","last_active":"2024-04-25T12:22:34.884359+0000","last_peered":"2024-04-25T12:22:34.884359+0000","last_clean":"2024-04-25T12:22:34.884359+0000","last_became_active":"2024-04-25T12:21:54.187254+0000","last_became_peered":"2024-04-25T12:21:54.187254+0000","last_unstale":"2024-04-25T12:22:34.884359+0000","last_undegraded":"2024-04-25T12:22:34.884359+0000","last_fullsized":"2024-04-25T12:22:34.884359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:32.252676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887407+0000","last_change":"2024-04-25T12:21:54.206788+0000","last_active":"2024-04-25T12:22:34.887407+0000","last_peered":"2024-04-25T12:22:34.887407+0000","last_clean":"2024-04-25T12:22:34.887407+0000","last_became_active":"2024-04-25T12:21:54.204904+0000","last_became_peered":"2024-04-25T12:21:54.204904+0000","last_unstale":"2024-04-25T12:22:34.887407+0000","last_undegraded":"2024-04-25T12:22:34.887407+0000","last_fullsized":"2024-04-25T12:22:34.887407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:24.928840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916233+0000","last_change":"2024-04-25T12:21:54.204288+0000","last_active":"2024-04-25T12:22:34.916233+0000","last_peered":"2024-04-25T12:22:34.916233+0000","last_clean":"2024-04-25T12:22:34.916233+0000","last_became_active":"2024-04-25T12:21:54.203922+0000","last_became_peered":"2024-04-25T12:21:54.203922+0000","last_unstale":"2024-04-25T12:22:34.916233+0000","last_undegraded":"2024-04-25T12:22:34.916233+0000","last_fullsized":"2024-04-25T12:22:34.916233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:36.299452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980303+0000","last_change":"2024-04-25T12:21:54.208621+0000","last_active":"2024-04-25T12:22:34.980303+0000","last_peered":"2024-04-25T12:22:34.980303+0000","last_clean":"2024-04-25T12:22:34.980303+0000","last_became_active":"2024-04-25T12:21:54.206993+0000","last_became_peered":"2024-04-25T12:21:54.206993+0000","last_unstale":"2024-04-25T12:22:34.980303+0000","last_undegraded":"2024-04-25T12:22:34.980303+0000","last_fullsized":"2024-04-25T12:22:34.980303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:56:08.605883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292881+0000","last_change":"2024-04-25T12:21:54.202203+0000","last_active":"2024-04-25T12:22:35.292881+0000","last_peered":"2024-04-25T12:22:35.292881+0000","last_clean":"2024-04-25T12:22:35.292881+0000","last_became_active":"2024-04-25T12:21:54.201551+0000","last_became_peered":"2024-04-25T12:21:54.201551+0000","last_unstale":"2024-04-25T12:22:35.292881+0000","last_undegraded":"2024-04-25T12:22:35.292881+0000","last_fullsized":"2024-04-25T12:22:35.292881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:12.846584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030100+0000","last_change":"2024-04-25T12:21:54.220705+0000","last_active":"2024-04-25T12:22:35.030100+0000","last_peered":"2024-04-25T12:22:35.030100+0000","last_clean":"2024-04-25T12:22:35.030100+0000","last_became_active":"2024-04-25T12:21:54.220435+0000","last_became_peered":"2024-04-25T12:21:54.220435+0000","last_unstale":"2024-04-25T12:22:35.030100+0000","last_undegraded":"2024-04-25T12:22:35.030100+0000","last_fullsized":"2024-04-25T12:22:35.030100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:27.885210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980397+0000","last_change":"2024-04-25T12:21:54.206568+0000","last_active":"2024-04-25T12:22:34.980397+0000","last_peered":"2024-04-25T12:22:34.980397+0000","last_clean":"2024-04-25T12:22:34.980397+0000","last_became_active":"2024-04-25T12:21:54.204587+0000","last_became_peered":"2024-04-25T12:21:54.204587+0000","last_unstale":"2024-04-25T12:22:34.980397+0000","last_undegraded":"2024-04-25T12:22:34.980397+0000","last_fullsized":"2024-04-25T12:22:34.980397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:37.419230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.297659+0000","last_change":"2024-04-25T12:22:35.295869+0000","last_active":"2024-04-25T12:22:35.297659+0000","last_peered":"2024-04-25T12:22:35.297659+0000","last_clean":"2024-04-25T12:22:35.297659+0000","last_became_active":"2024-04-25T12:22:35.295116+0000","last_became_peered":"2024-04-25T12:22:35.295116+0000","last_unstale":"2024-04-25T12:22:35.297659+0000","last_undegraded":"2024-04-25T12:22:35.297659+0000","last_fullsized":"2024-04-25T12:22:35.297659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:08.665587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979578+0000","last_change":"2024-04-25T12:21:54.203886+0000","last_active":"2024-04-25T12:22:34.979578+0000","last_peered":"2024-04-25T12:22:34.979578+0000","last_clean":"2024-04-25T12:22:34.979578+0000","last_became_active":"2024-04-25T12:21:54.203464+0000","last_became_peered":"2024-04-25T12:21:54.203464+0000","last_unstale":"2024-04-25T12:22:34.979578+0000","last_undegraded":"2024-04-25T12:22:34.979578+0000","last_fullsized":"2024-04-25T12:22:34.979578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:41.646353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887358+0000","last_change":"2024-04-25T12:21:54.213114+0000","last_active":"2024-04-25T12:22:34.887358+0000","last_peered":"2024-04-25T12:22:34.887358+0000","last_clean":"2024-04-25T12:22:34.887358+0000","last_became_active":"2024-04-25T12:21:54.212559+0000","last_became_peered":"2024-04-25T12:21:54.212559+0000","last_unstale":"2024-04-25T12:22:34.887358+0000","last_undegraded":"2024-04-25T12:22:34.887358+0000","last_fullsized":"2024-04-25T12:22:34.887358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:13.824789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915648+0000","last_change":"2024-04-25T12:21:54.215749+0000","last_active":"2024-04-25T12:22:34.915648+0000","last_peered":"2024-04-25T12:22:34.915648+0000","last_clean":"2024-04-25T12:22:34.915648+0000","last_became_active":"2024-04-25T12:21:54.215446+0000","last_became_peered":"2024-04-25T12:21:54.215446+0000","last_unstale":"2024-04-25T12:22:34.915648+0000","last_undegraded":"2024-04-25T12:22:34.915648+0000","last_fullsized":"2024-04-25T12:22:34.915648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:31.642141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029876+0000","last_change":"2024-04-25T12:21:54.210099+0000","last_active":"2024-04-25T12:22:35.029876+0000","last_peered":"2024-04-25T12:22:35.029876+0000","last_clean":"2024-04-25T12:22:35.029876+0000","last_became_active":"2024-04-25T12:21:54.209393+0000","last_became_peered":"2024-04-25T12:21:54.209393+0000","last_unstale":"2024-04-25T12:22:35.029876+0000","last_undegraded":"2024-04-25T12:22:35.029876+0000","last_fullsized":"2024-04-25T12:22:35.029876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:32.318047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891441+0000","last_change":"2024-04-25T12:21:54.216255+0000","last_active":"2024-04-25T12:22:34.891441+0000","last_peered":"2024-04-25T12:22:34.891441+0000","last_clean":"2024-04-25T12:22:34.891441+0000","last_became_active":"2024-04-25T12:21:54.211787+0000","last_became_peered":"2024-04-25T12:21:54.211787+0000","last_unstale":"2024-04-25T12:22:34.891441+0000","last_undegraded":"2024-04-25T12:22:34.891441+0000","last_fullsized":"2024-04-25T12:22:34.891441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:32.351790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.886612+0000","last_change":"2024-04-25T12:21:54.200503+0000","last_active":"2024-04-25T12:22:34.886612+0000","last_peered":"2024-04-25T12:22:34.886612+0000","last_clean":"2024-04-25T12:22:34.886612+0000","last_became_active":"2024-04-25T12:21:54.200123+0000","last_became_peered":"2024-04-25T12:21:54.200123+0000","last_unstale":"2024-04-25T12:22:34.886612+0000","last_undegraded":"2024-04-25T12:22:34.886612+0000","last_fullsized":"2024-04-25T12:22:34.886612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:04.504889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.889718+0000","last_change":"2024-04-25T12:21:54.220717+0000","last_active":"2024-04-25T12:22:34.889718+0000","last_peered":"2024-04-25T12:22:34.889718+0000","last_clean":"2024-04-25T12:22:34.889718+0000","last_became_active":"2024-04-25T12:21:54.220272+0000","last_became_peered":"2024-04-25T12:21:54.220272+0000","last_unstale":"2024-04-25T12:22:34.889718+0000","last_undegraded":"2024-04-25T12:22:34.889718+0000","last_fullsized":"2024-04-25T12:22:34.889718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:51.165297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.886279+0000","last_change":"2024-04-25T12:21:54.190288+0000","last_active":"2024-04-25T12:22:34.886279+0000","last_peered":"2024-04-25T12:22:34.886279+0000","last_clean":"2024-04-25T12:22:34.886279+0000","last_became_active":"2024-04-25T12:21:54.189535+0000","last_became_peered":"2024-04-25T12:21:54.189535+0000","last_unstale":"2024-04-25T12:22:34.886279+0000","last_undegraded":"2024-04-25T12:22:34.886279+0000","last_fullsized":"2024-04-25T12:22:34.886279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:03.757883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292136+0000","last_change":"2024-04-25T12:21:54.202898+0000","last_active":"2024-04-25T12:22:35.292136+0000","last_peered":"2024-04-25T12:22:35.292136+0000","last_clean":"2024-04-25T12:22:35.292136+0000","last_became_active":"2024-04-25T12:21:54.201641+0000","last_became_peered":"2024-04-25T12:21:54.201641+0000","last_unstale":"2024-04-25T12:22:35.292136+0000","last_undegraded":"2024-04-25T12:22:35.292136+0000","last_fullsized":"2024-04-25T12:22:35.292136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:42.865496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916388+0000","last_change":"2024-04-25T12:21:54.192818+0000","last_active":"2024-04-25T12:22:34.916388+0000","last_peered":"2024-04-25T12:22:34.916388+0000","last_clean":"2024-04-25T12:22:34.916388+0000","last_became_active":"2024-04-25T12:21:54.192052+0000","last_became_peered":"2024-04-25T12:21:54.192052+0000","last_unstale":"2024-04-25T12:22:34.916388+0000","last_undegraded":"2024-04-25T12:22:34.916388+0000","last_fullsized":"2024-04-25T12:22:34.916388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:26.048483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978815+0000","last_change":"2024-04-25T12:21:54.203798+0000","last_active":"2024-04-25T12:22:34.978815+0000","last_peered":"2024-04-25T12:22:34.978815+0000","last_clean":"2024-04-25T12:22:34.978815+0000","last_became_active":"2024-04-25T12:21:54.203472+0000","last_became_peered":"2024-04-25T12:21:54.203472+0000","last_unstale":"2024-04-25T12:22:34.978815+0000","last_undegraded":"2024-04-25T12:22:34.978815+0000","last_fullsized":"2024-04-25T12:22:34.978815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:19.958172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894317+0000","last_change":"2024-04-25T12:21:54.206055+0000","last_active":"2024-04-25T12:22:34.894317+0000","last_peered":"2024-04-25T12:22:34.894317+0000","last_clean":"2024-04-25T12:22:34.894317+0000","last_became_active":"2024-04-25T12:21:54.203030+0000","last_became_peered":"2024-04-25T12:21:54.203030+0000","last_unstale":"2024-04-25T12:22:34.894317+0000","last_undegraded":"2024-04-25T12:22:34.894317+0000","last_fullsized":"2024-04-25T12:22:34.894317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:58.836301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030468+0000","last_change":"2024-04-25T12:21:54.199660+0000","last_active":"2024-04-25T12:22:35.030468+0000","last_peered":"2024-04-25T12:22:35.030468+0000","last_clean":"2024-04-25T12:22:35.030468+0000","last_became_active":"2024-04-25T12:21:54.199362+0000","last_became_peered":"2024-04-25T12:21:54.199362+0000","last_unstale":"2024-04-25T12:22:35.030468+0000","last_undegraded":"2024-04-25T12:22:35.030468+0000","last_fullsized":"2024-04-25T12:22:35.030468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:57.706566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029976+0000","last_change":"2024-04-25T12:21:54.198710+0000","last_active":"2024-04-25T12:22:35.029976+0000","last_peered":"2024-04-25T12:22:35.029976+0000","last_clean":"2024-04-25T12:22:35.029976+0000","last_became_active":"2024-04-25T12:21:54.198432+0000","last_became_peered":"2024-04-25T12:21:54.198432+0000","last_unstale":"2024-04-25T12:22:35.029976+0000","last_undegraded":"2024-04-25T12:22:35.029976+0000","last_fullsized":"2024-04-25T12:22:35.029976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:33.124005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.892012+0000","last_change":"2024-04-25T12:21:54.218474+0000","last_active":"2024-04-25T12:22:34.892012+0000","last_peered":"2024-04-25T12:22:34.892012+0000","last_clean":"2024-04-25T12:22:34.892012+0000","last_became_active":"2024-04-25T12:21:54.216949+0000","last_became_peered":"2024-04-25T12:21:54.216949+0000","last_unstale":"2024-04-25T12:22:34.892012+0000","last_undegraded":"2024-04-25T12:22:34.892012+0000","last_fullsized":"2024-04-25T12:22:34.892012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:56.162843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978395+0000","last_change":"2024-04-25T12:21:54.200590+0000","last_active":"2024-04-25T12:22:34.978395+0000","last_peered":"2024-04-25T12:22:34.978395+0000","last_clean":"2024-04-25T12:22:34.978395+0000","last_became_active":"2024-04-25T12:21:54.200248+0000","last_became_peered":"2024-04-25T12:21:54.200248+0000","last_unstale":"2024-04-25T12:22:34.978395+0000","last_undegraded":"2024-04-25T12:22:34.978395+0000","last_fullsized":"2024-04-25T12:22:34.978395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:12.875315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890043+0000","last_change":"2024-04-25T12:21:54.197805+0000","last_active":"2024-04-25T12:22:34.890043+0000","last_peered":"2024-04-25T12:22:34.890043+0000","last_clean":"2024-04-25T12:22:34.890043+0000","last_became_active":"2024-04-25T12:21:54.197028+0000","last_became_peered":"2024-04-25T12:21:54.197028+0000","last_unstale":"2024-04-25T12:22:34.890043+0000","last_undegraded":"2024-04-25T12:22:34.890043+0000","last_fullsized":"2024-04-25T12:22:34.890043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:03.069305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887087+0000","last_change":"2024-04-25T12:21:54.190517+0000","last_active":"2024-04-25T12:22:34.887087+0000","last_peered":"2024-04-25T12:22:34.887087+0000","last_clean":"2024-04-25T12:22:34.887087+0000","last_became_active":"2024-04-25T12:21:54.189711+0000","last_became_peered":"2024-04-25T12:21:54.189711+0000","last_unstale":"2024-04-25T12:22:34.887087+0000","last_undegraded":"2024-04-25T12:22:34.887087+0000","last_fullsized":"2024-04-25T12:22:34.887087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:17.879060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890320+0000","last_change":"2024-04-25T12:21:54.197205+0000","last_active":"2024-04-25T12:22:34.890320+0000","last_peered":"2024-04-25T12:22:34.890320+0000","last_clean":"2024-04-25T12:22:34.890320+0000","last_became_active":"2024-04-25T12:21:54.196933+0000","last_became_peered":"2024-04-25T12:21:54.196933+0000","last_unstale":"2024-04-25T12:22:34.890320+0000","last_undegraded":"2024-04-25T12:22:34.890320+0000","last_fullsized":"2024-04-25T12:22:34.890320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:32.003058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887450+0000","last_change":"2024-04-25T12:21:54.207709+0000","last_active":"2024-04-25T12:22:34.887450+0000","last_peered":"2024-04-25T12:22:34.887450+0000","last_clean":"2024-04-25T12:22:34.887450+0000","last_became_active":"2024-04-25T12:21:54.207027+0000","last_became_peered":"2024-04-25T12:21:54.207027+0000","last_unstale":"2024-04-25T12:22:34.887450+0000","last_undegraded":"2024-04-25T12:22:34.887450+0000","last_fullsized":"2024-04-25T12:22:34.887450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:15.116440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915838+0000","last_change":"2024-04-25T12:21:54.185338+0000","last_active":"2024-04-25T12:22:34.915838+0000","last_peered":"2024-04-25T12:22:34.915838+0000","last_clean":"2024-04-25T12:22:34.915838+0000","last_became_active":"2024-04-25T12:21:54.184502+0000","last_became_peered":"2024-04-25T12:21:54.184502+0000","last_unstale":"2024-04-25T12:22:34.915838+0000","last_undegraded":"2024-04-25T12:22:34.915838+0000","last_fullsized":"2024-04-25T12:22:34.915838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:29.865959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292679+0000","last_change":"2024-04-25T12:21:54.183773+0000","last_active":"2024-04-25T12:22:35.292679+0000","last_peered":"2024-04-25T12:22:35.292679+0000","last_clean":"2024-04-25T12:22:35.292679+0000","last_became_active":"2024-04-25T12:21:54.182924+0000","last_became_peered":"2024-04-25T12:21:54.182924+0000","last_unstale":"2024-04-25T12:22:35.292679+0000","last_undegraded":"2024-04-25T12:22:35.292679+0000","last_fullsized":"2024-04-25T12:22:35.292679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:22.046777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891694+0000","last_change":"2024-04-25T12:21:54.210631+0000","last_active":"2024-04-25T12:22:34.891694+0000","last_peered":"2024-04-25T12:22:34.891694+0000","last_clean":"2024-04-25T12:22:34.891694+0000","last_became_active":"2024-04-25T12:21:54.210333+0000","last_became_peered":"2024-04-25T12:21:54.210333+0000","last_unstale":"2024-04-25T12:22:34.891694+0000","last_undegraded":"2024-04-25T12:22:34.891694+0000","last_fullsized":"2024-04-25T12:22:34.891694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:39.783406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12028,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":24056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190,"ondisk_log_size":190,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476778,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":921600,"data_stored":712729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476779,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":125334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476778,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":124193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476777,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":121591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542186,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":125368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542187,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":121723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542186,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":121352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542186,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":913408,"data_stored":711062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:24:58.250 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T12:24:58.250 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:24:58.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.398+0000 7f3b43841640 1 Processor -- start 2024-04-25T12:24:58.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.398+0000 7f3b43841640 1 -- start start 2024-04-25T12:24:58.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.398+0000 7f3b43841640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f3b3c14ffa0 0x7f3b3c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:58.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.398+0000 7f3b43841640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3b3c074100 0x7f3b3c0c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:58.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.398+0000 7f3b43841640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b3c0c5d70 con 0x7f3b3c14fbc0 2024-04-25T12:24:58.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.398+0000 7f3b43841640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f3b3c0c6050 con 0x7f3b3c074100 2024-04-25T12:24:58.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.398+0000 7f3b43841640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f3b3c0c6330 con 0x7f3b3c14ffa0 2024-04-25T12:24:58.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.398+0000 7f3b415dd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f3b3c14fbc0 0x7f3b3c0c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58452/0 (socket says 172.21.15.94:58452) 2024-04-25T12:24:58.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.398+0000 7f3b415dd640 1 -- 172.21.15.94:0/3234451797 learned_addr learned my addr 172.21.15.94:0/3234451797 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:24:58.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.398+0000 7f3b41dde640 1 --2- 172.21.15.94:0/3234451797 >> v2:172.21.15.94:3300/0 conn(0x7f3b3c074100 0x7f3b3c0c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:58.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.398+0000 7f3b40ddc640 1 --2- 172.21.15.94:0/3234451797 >> v2:172.21.15.111:3300/0 conn(0x7f3b3c14ffa0 0x7f3b3c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:58.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.398+0000 7f3b33fff640 1 -- 172.21.15.94:0/3234451797 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3879222701 0 0) 0x7f3b3c0c5d70 con 0x7f3b3c14fbc0 2024-04-25T12:24:58.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.398+0000 7f3b33fff640 1 -- 172.21.15.94:0/3234451797 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b28003530 con 0x7f3b3c14fbc0 2024-04-25T12:24:58.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.398+0000 7f3b41dde640 1 -- 172.21.15.94:0/3234451797 >> v2:172.21.15.111:3300/0 conn(0x7f3b3c14ffa0 msgr2=0x7f3b3c06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:58.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.398+0000 7f3b41dde640 1 --2- 172.21.15.94:0/3234451797 >> v2:172.21.15.111:3300/0 conn(0x7f3b3c14ffa0 0x7f3b3c06f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.398+0000 7f3b41dde640 1 -- 172.21.15.94:0/3234451797 >> v1:172.21.15.94:6789/0 conn(0x7f3b3c14fbc0 legacy=0x7f3b3c0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:58.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.398+0000 7f3b41dde640 1 -- 172.21.15.94:0/3234451797 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3c0c6610 con 0x7f3b3c074100 2024-04-25T12:24:58.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b41dde640 1 --2- 172.21.15.94:0/3234451797 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b3c074100 0x7f3b3c0c7250 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3b34009d90 tx=0x7f3b3401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed88e0083438a019 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:58.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b33fff640 1 -- 172.21.15.94:0/3234451797 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b340b2070 con 0x7f3b3c074100 2024-04-25T12:24:58.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b33fff640 1 -- 172.21.15.94:0/3234451797 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b340a5a10 con 0x7f3b3c074100 2024-04-25T12:24:58.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b33fff640 1 -- 172.21.15.94:0/3234451797 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b340a5de0 con 0x7f3b3c074100 2024-04-25T12:24:58.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b43841640 1 -- 172.21.15.94:0/3234451797 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b3c074100 msgr2=0x7f3b3c0c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:58.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b43841640 1 --2- 172.21.15.94:0/3234451797 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b3c074100 0x7f3b3c0c7250 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3b34009d90 tx=0x7f3b3401c930 comp rx=0 tx=0).stop 2024-04-25T12:24:58.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b43841640 1 -- 172.21.15.94:0/3234451797 shutdown_connections 2024-04-25T12:24:58.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b43841640 1 --2- 172.21.15.94:0/3234451797 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b3c074100 0x7f3b3c0c7250 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b43841640 1 --2- 172.21.15.94:0/3234451797 >> v2:172.21.15.111:3300/0 conn(0x7f3b3c14ffa0 0x7f3b3c06f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b43841640 1 -- 172.21.15.94:0/3234451797 >> 172.21.15.94:0/3234451797 conn(0x7f3b3c06b9d0 msgr2=0x7f3b3c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:58.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b43841640 1 -- 172.21.15.94:0/3234451797 shutdown_connections 2024-04-25T12:24:58.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b43841640 1 -- 172.21.15.94:0/3234451797 wait complete. 2024-04-25T12:24:58.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b43841640 1 Processor -- start 2024-04-25T12:24:58.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b43841640 1 -- start start 2024-04-25T12:24:58.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b43841640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b3c074100 0x7f3b3c1f2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:58.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b43841640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3b3c14fbc0 0x7f3b3c1505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:58.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b43841640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b3c14ffa0 0x7f3b3c13ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:58.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b43841640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3c0c8ab0 con 0x7f3b3c14ffa0 2024-04-25T12:24:58.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b43841640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3c0c8930 con 0x7f3b3c074100 2024-04-25T12:24:58.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b43841640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f3b3c166090 con 0x7f3b3c14fbc0 2024-04-25T12:24:58.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b41dde640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b3c14ffa0 0x7f3b3c13ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:58.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b41dde640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b3c14ffa0 0x7f3b3c13ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36066/0 (socket says 172.21.15.94:36066) 2024-04-25T12:24:58.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b41dde640 1 -- 172.21.15.94:0/3999493679 learned_addr learned my addr 172.21.15.94:0/3999493679 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:58.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b415dd640 1 --2- 172.21.15.94:0/3999493679 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b3c074100 0x7f3b3c1f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:58.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b41dde640 1 -- 172.21.15.94:0/3999493679 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3b3c14fbc0 msgr2=0x7f3b3c1505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:58.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b41dde640 1 --2- 172.21.15.94:0/3999493679 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3b3c14fbc0 0x7f3b3c1505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b41dde640 1 -- 172.21.15.94:0/3999493679 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b3c074100 msgr2=0x7f3b3c1f2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:58.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b41dde640 1 --2- 172.21.15.94:0/3999493679 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b3c074100 0x7f3b3c1f2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b41dde640 1 -- 172.21.15.94:0/3999493679 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3c15c950 con 0x7f3b3c14ffa0 2024-04-25T12:24:58.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b41dde640 1 --2- 172.21.15.94:0/3999493679 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b3c14ffa0 0x7f3b3c13ceb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3b34009d90 tx=0x7f3b340196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:58.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b31ffb640 1 -- 172.21.15.94:0/3999493679 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b340b2050 con 0x7f3b3c14ffa0 2024-04-25T12:24:58.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b31ffb640 1 -- 172.21.15.94:0/3999493679 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b340be070 con 0x7f3b3c14ffa0 2024-04-25T12:24:58.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b31ffb640 1 -- 172.21.15.94:0/3999493679 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b340ada70 con 0x7f3b3c14ffa0 2024-04-25T12:24:58.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b43841640 1 -- 172.21.15.94:0/3999493679 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b3c15cc30 con 0x7f3b3c14ffa0 2024-04-25T12:24:58.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.402+0000 7f3b43841640 1 -- 172.21.15.94:0/3999493679 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b3c15d1f0 con 0x7f3b3c14ffa0 2024-04-25T12:24:58.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.406+0000 7f3b43841640 1 -- 172.21.15.94:0/3999493679 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b3c151c90 con 0x7f3b3c14ffa0 2024-04-25T12:24:58.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.406+0000 7f3b31ffb640 1 -- 172.21.15.94:0/3999493679 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3b340adc10 con 0x7f3b3c14ffa0 2024-04-25T12:24:58.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.406+0000 7f3b31ffb640 1 --2- 172.21.15.94:0/3999493679 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f3b200683b0 0x7f3b2006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:58.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.406+0000 7f3b31ffb640 1 -- 172.21.15.94:0/3999493679 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f3b34121880 con 0x7f3b3c14ffa0 2024-04-25T12:24:58.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.406+0000 7f3b415dd640 1 --2- 172.21.15.94:0/3999493679 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f3b200683b0 0x7f3b2006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:58.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.406+0000 7f3b415dd640 1 --2- 172.21.15.94:0/3999493679 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f3b200683b0 0x7f3b2006a870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c007fd0 tx=0x7f3b2c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:58.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.410+0000 7f3b31ffb640 1 -- 172.21.15.94:0/3999493679 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3b340c7020 con 0x7f3b3c14ffa0 2024-04-25T12:24:58.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.566+0000 7f3b43841640 1 -- 172.21.15.94:0/3999493679 --> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3b3c15d430 con 0x7f3b200683b0 2024-04-25T12:24:58.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.574+0000 7f3b31ffb640 1 -- 172.21.15.94:0/3999493679 <== mgr.4101 v2:172.21.15.94:6832/549402167 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332671 (secure 0 0 0) 0x7f3b2c0058e0 con 0x7f3b200683b0 2024-04-25T12:24:58.583 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:58.585 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-04-25T12:24:58.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.578+0000 7f3b43841640 1 -- 172.21.15.94:0/3999493679 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f3b200683b0 msgr2=0x7f3b2006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:58.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.578+0000 7f3b43841640 1 --2- 172.21.15.94:0/3999493679 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f3b200683b0 0x7f3b2006a870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c007fd0 tx=0x7f3b2c009040 comp rx=0 tx=0).stop 2024-04-25T12:24:58.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.578+0000 7f3b43841640 1 -- 172.21.15.94:0/3999493679 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b3c14ffa0 msgr2=0x7f3b3c13ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:58.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.578+0000 7f3b43841640 1 --2- 172.21.15.94:0/3999493679 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b3c14ffa0 0x7f3b3c13ceb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3b34009d90 tx=0x7f3b340196d0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.578+0000 7f3b43841640 1 -- 172.21.15.94:0/3999493679 shutdown_connections 2024-04-25T12:24:58.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.578+0000 7f3b43841640 1 --2- 172.21.15.94:0/3999493679 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f3b200683b0 0x7f3b2006a870 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.578+0000 7f3b43841640 1 --2- 172.21.15.94:0/3999493679 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3b3c14fbc0 0x7f3b3c1505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.578+0000 7f3b43841640 1 --2- 172.21.15.94:0/3999493679 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b3c14ffa0 0x7f3b3c13ceb0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.578+0000 7f3b43841640 1 --2- 172.21.15.94:0/3999493679 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b3c074100 0x7f3b3c1f2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.578+0000 7f3b43841640 1 -- 172.21.15.94:0/3999493679 >> 172.21.15.94:0/3999493679 conn(0x7f3b3c06b9d0 msgr2=0x7f3b3c06ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:58.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.578+0000 7f3b43841640 1 -- 172.21.15.94:0/3999493679 shutdown_connections 2024-04-25T12:24:58.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.578+0000 7f3b43841640 1 -- 172.21.15.94:0/3999493679 wait complete. 2024-04-25T12:24:58.601 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2024-04-25T12:24:57.816707+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602396,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":375,"num_write_kb":2490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307,"ondisk_log_size":307,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236456,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738264,"statfs":{"total":773094113280,"available":772851982336,"internally_reserved":0,"allocated":3776512,"data_stored":2163352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3058,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004428"},"pg_stats":[{"pgid":"2.1f","version":"28'13","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.915197+0000","last_change":"2024-04-25T12:21:53.194776+0000","last_active":"2024-04-25T12:24:43.915197+0000","last_peered":"2024-04-25T12:24:43.915197+0000","last_clean":"2024-04-25T12:24:43.915197+0000","last_became_active":"2024-04-25T12:21:53.194480+0000","last_became_peered":"2024-04-25T12:21:53.194480+0000","last_unstale":"2024-04-25T12:24:43.915197+0000","last_undegraded":"2024-04-25T12:24:43.915197+0000","last_fullsized":"2024-04-25T12:24:43.915197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:52.906255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979743+0000","last_change":"2024-04-25T12:21:54.200481+0000","last_active":"2024-04-25T12:22:34.979743+0000","last_peered":"2024-04-25T12:22:34.979743+0000","last_clean":"2024-04-25T12:22:34.979743+0000","last_became_active":"2024-04-25T12:21:54.199679+0000","last_became_peered":"2024-04-25T12:21:54.199679+0000","last_unstale":"2024-04-25T12:22:34.979743+0000","last_undegraded":"2024-04-25T12:22:34.979743+0000","last_fullsized":"2024-04-25T12:22:34.979743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:59.395265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978348+0000","last_change":"2024-04-25T12:21:58.346732+0000","last_active":"2024-04-25T12:22:34.978348+0000","last_peered":"2024-04-25T12:22:34.978348+0000","last_clean":"2024-04-25T12:22:34.978348+0000","last_became_active":"2024-04-25T12:21:58.346337+0000","last_became_peered":"2024-04-25T12:21:58.346337+0000","last_unstale":"2024-04-25T12:22:34.978348+0000","last_undegraded":"2024-04-25T12:22:34.978348+0000","last_fullsized":"2024-04-25T12:22:34.978348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:20.028661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:23:54.774933+0000","last_change":"2024-04-25T12:21:53.166281+0000","last_active":"2024-04-25T12:23:54.774933+0000","last_peered":"2024-04-25T12:23:54.774933+0000","last_clean":"2024-04-25T12:23:54.774933+0000","last_became_active":"2024-04-25T12:21:53.165990+0000","last_became_peered":"2024-04-25T12:21:53.165990+0000","last_unstale":"2024-04-25T12:23:54.774933+0000","last_undegraded":"2024-04-25T12:23:54.774933+0000","last_fullsized":"2024-04-25T12:23:54.774933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:07.228743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916094+0000","last_change":"2024-04-25T12:21:54.189754+0000","last_active":"2024-04-25T12:22:34.916094+0000","last_peered":"2024-04-25T12:22:34.916094+0000","last_clean":"2024-04-25T12:22:34.916094+0000","last_became_active":"2024-04-25T12:21:54.188987+0000","last_became_peered":"2024-04-25T12:21:54.188987+0000","last_unstale":"2024-04-25T12:22:34.916094+0000","last_undegraded":"2024-04-25T12:22:34.916094+0000","last_fullsized":"2024-04-25T12:22:34.916094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:29.603368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.892805+0000","last_change":"2024-04-25T12:21:58.251628+0000","last_active":"2024-04-25T12:22:34.892805+0000","last_peered":"2024-04-25T12:22:34.892805+0000","last_clean":"2024-04-25T12:22:34.892805+0000","last_became_active":"2024-04-25T12:21:58.250542+0000","last_became_peered":"2024-04-25T12:21:58.250542+0000","last_unstale":"2024-04-25T12:22:34.892805+0000","last_undegraded":"2024-04-25T12:22:34.892805+0000","last_fullsized":"2024-04-25T12:22:34.892805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:33.434685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'12","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.918854+0000","last_change":"2024-04-25T12:21:53.203427+0000","last_active":"2024-04-25T12:24:43.918854+0000","last_peered":"2024-04-25T12:24:43.918854+0000","last_clean":"2024-04-25T12:24:43.918854+0000","last_became_active":"2024-04-25T12:21:53.202760+0000","last_became_peered":"2024-04-25T12:21:53.202760+0000","last_unstale":"2024-04-25T12:24:43.918854+0000","last_undegraded":"2024-04-25T12:24:43.918854+0000","last_fullsized":"2024-04-25T12:24:43.918854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:44.397450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887718+0000","last_change":"2024-04-25T12:21:54.208420+0000","last_active":"2024-04-25T12:22:34.887718+0000","last_peered":"2024-04-25T12:22:34.887718+0000","last_clean":"2024-04-25T12:22:34.887718+0000","last_became_active":"2024-04-25T12:21:54.208093+0000","last_became_peered":"2024-04-25T12:21:54.208093+0000","last_unstale":"2024-04-25T12:22:34.887718+0000","last_undegraded":"2024-04-25T12:22:34.887718+0000","last_fullsized":"2024-04-25T12:22:34.887718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:08.762268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893123+0000","last_change":"2024-04-25T12:21:58.255963+0000","last_active":"2024-04-25T12:22:34.893123+0000","last_peered":"2024-04-25T12:22:34.893123+0000","last_clean":"2024-04-25T12:22:34.893123+0000","last_became_active":"2024-04-25T12:21:58.254021+0000","last_became_peered":"2024-04-25T12:21:58.254021+0000","last_unstale":"2024-04-25T12:22:34.893123+0000","last_undegraded":"2024-04-25T12:22:34.893123+0000","last_fullsized":"2024-04-25T12:22:34.893123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:20.528034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.916352+0000","last_change":"2024-04-25T12:21:53.208470+0000","last_active":"2024-04-25T12:24:43.916352+0000","last_peered":"2024-04-25T12:24:43.916352+0000","last_clean":"2024-04-25T12:24:43.916352+0000","last_became_active":"2024-04-25T12:21:53.207929+0000","last_became_peered":"2024-04-25T12:21:53.207929+0000","last_unstale":"2024-04-25T12:24:43.916352+0000","last_undegraded":"2024-04-25T12:24:43.916352+0000","last_fullsized":"2024-04-25T12:24:43.916352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:14.904832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887684+0000","last_change":"2024-04-25T12:21:54.206567+0000","last_active":"2024-04-25T12:22:34.887684+0000","last_peered":"2024-04-25T12:22:34.887684+0000","last_clean":"2024-04-25T12:22:34.887684+0000","last_became_active":"2024-04-25T12:21:54.206138+0000","last_became_peered":"2024-04-25T12:21:54.206138+0000","last_unstale":"2024-04-25T12:22:34.887684+0000","last_undegraded":"2024-04-25T12:22:34.887684+0000","last_fullsized":"2024-04-25T12:22:34.887684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:31.698845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893399+0000","last_change":"2024-04-25T12:21:58.245331+0000","last_active":"2024-04-25T12:22:34.893399+0000","last_peered":"2024-04-25T12:22:34.893399+0000","last_clean":"2024-04-25T12:22:34.893399+0000","last_became_active":"2024-04-25T12:21:58.244313+0000","last_became_peered":"2024-04-25T12:21:58.244313+0000","last_unstale":"2024-04-25T12:22:34.893399+0000","last_undegraded":"2024-04-25T12:22:34.893399+0000","last_fullsized":"2024-04-25T12:22:34.893399+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:21.595492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029274+0000","last_change":"2024-04-25T12:21:54.208935+0000","last_active":"2024-04-25T12:22:35.029274+0000","last_peered":"2024-04-25T12:22:35.029274+0000","last_clean":"2024-04-25T12:22:35.029274+0000","last_became_active":"2024-04-25T12:21:54.208338+0000","last_became_peered":"2024-04-25T12:21:54.208338+0000","last_unstale":"2024-04-25T12:22:35.029274+0000","last_undegraded":"2024-04-25T12:22:35.029274+0000","last_fullsized":"2024-04-25T12:22:35.029274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:08.485037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:25.185372+0000","last_change":"2024-04-25T12:21:53.203519+0000","last_active":"2024-04-25T12:24:25.185372+0000","last_peered":"2024-04-25T12:24:25.185372+0000","last_clean":"2024-04-25T12:24:25.185372+0000","last_became_active":"2024-04-25T12:21:53.197141+0000","last_became_peered":"2024-04-25T12:21:53.197141+0000","last_unstale":"2024-04-25T12:24:25.185372+0000","last_undegraded":"2024-04-25T12:24:25.185372+0000","last_fullsized":"2024-04-25T12:24:25.185372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:03.010472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894179+0000","last_change":"2024-04-25T12:21:58.250871+0000","last_active":"2024-04-25T12:22:34.894179+0000","last_peered":"2024-04-25T12:22:34.894179+0000","last_clean":"2024-04-25T12:22:34.894179+0000","last_became_active":"2024-04-25T12:21:58.249079+0000","last_became_peered":"2024-04-25T12:21:58.249079+0000","last_unstale":"2024-04-25T12:22:34.894179+0000","last_undegraded":"2024-04-25T12:22:34.894179+0000","last_fullsized":"2024-04-25T12:22:34.894179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:54.201824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978908+0000","last_change":"2024-04-25T12:21:54.209195+0000","last_active":"2024-04-25T12:22:34.978908+0000","last_peered":"2024-04-25T12:22:34.978908+0000","last_clean":"2024-04-25T12:22:34.978908+0000","last_became_active":"2024-04-25T12:21:54.208802+0000","last_became_peered":"2024-04-25T12:21:54.208802+0000","last_unstale":"2024-04-25T12:22:34.978908+0000","last_undegraded":"2024-04-25T12:22:34.978908+0000","last_fullsized":"2024-04-25T12:22:34.978908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:10.846624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.892354+0000","last_change":"2024-04-25T12:21:53.165498+0000","last_active":"2024-04-25T12:24:37.892354+0000","last_peered":"2024-04-25T12:24:37.892354+0000","last_clean":"2024-04-25T12:24:37.892354+0000","last_became_active":"2024-04-25T12:21:53.164867+0000","last_became_peered":"2024-04-25T12:21:53.164867+0000","last_unstale":"2024-04-25T12:24:37.892354+0000","last_undegraded":"2024-04-25T12:24:37.892354+0000","last_fullsized":"2024-04-25T12:24:37.892354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:07.312761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893517+0000","last_change":"2024-04-25T12:21:58.260620+0000","last_active":"2024-04-25T12:22:34.893517+0000","last_peered":"2024-04-25T12:22:34.893517+0000","last_clean":"2024-04-25T12:22:34.893517+0000","last_became_active":"2024-04-25T12:21:58.259595+0000","last_became_peered":"2024-04-25T12:21:58.259595+0000","last_unstale":"2024-04-25T12:22:34.893517+0000","last_undegraded":"2024-04-25T12:22:34.893517+0000","last_fullsized":"2024-04-25T12:22:34.893517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:43.230479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979100+0000","last_change":"2024-04-25T12:21:54.206960+0000","last_active":"2024-04-25T12:22:34.979100+0000","last_peered":"2024-04-25T12:22:34.979100+0000","last_clean":"2024-04-25T12:22:34.979100+0000","last_became_active":"2024-04-25T12:21:54.204650+0000","last_became_peered":"2024-04-25T12:21:54.204650+0000","last_unstale":"2024-04-25T12:22:34.979100+0000","last_undegraded":"2024-04-25T12:22:34.979100+0000","last_fullsized":"2024-04-25T12:22:34.979100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:15.888865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'7","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.916785+0000","last_change":"2024-04-25T12:21:53.193797+0000","last_active":"2024-04-25T12:24:43.916785+0000","last_peered":"2024-04-25T12:24:43.916785+0000","last_clean":"2024-04-25T12:24:43.916785+0000","last_became_active":"2024-04-25T12:21:53.193466+0000","last_became_peered":"2024-04-25T12:21:53.193466+0000","last_unstale":"2024-04-25T12:24:43.916785+0000","last_undegraded":"2024-04-25T12:24:43.916785+0000","last_fullsized":"2024-04-25T12:24:43.916785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:23.341451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292912+0000","last_change":"2024-04-25T12:21:58.348047+0000","last_active":"2024-04-25T12:22:35.292912+0000","last_peered":"2024-04-25T12:22:35.292912+0000","last_clean":"2024-04-25T12:22:35.292912+0000","last_became_active":"2024-04-25T12:21:58.347583+0000","last_became_peered":"2024-04-25T12:21:58.347583+0000","last_unstale":"2024-04-25T12:22:35.292912+0000","last_undegraded":"2024-04-25T12:22:35.292912+0000","last_fullsized":"2024-04-25T12:22:35.292912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:21:48.878907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894218+0000","last_change":"2024-04-25T12:21:54.196479+0000","last_active":"2024-04-25T12:22:34.894218+0000","last_peered":"2024-04-25T12:22:34.894218+0000","last_clean":"2024-04-25T12:22:34.894218+0000","last_became_active":"2024-04-25T12:21:54.195939+0000","last_became_peered":"2024-04-25T12:21:54.195939+0000","last_unstale":"2024-04-25T12:22:34.894218+0000","last_undegraded":"2024-04-25T12:22:34.894218+0000","last_fullsized":"2024-04-25T12:22:34.894218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:17.787145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:25.185667+0000","last_change":"2024-04-25T12:21:53.198034+0000","last_active":"2024-04-25T12:24:25.185667+0000","last_peered":"2024-04-25T12:24:25.185667+0000","last_clean":"2024-04-25T12:24:25.185667+0000","last_became_active":"2024-04-25T12:21:53.196252+0000","last_became_peered":"2024-04-25T12:21:53.196252+0000","last_unstale":"2024-04-25T12:24:25.185667+0000","last_undegraded":"2024-04-25T12:24:25.185667+0000","last_fullsized":"2024-04-25T12:24:25.185667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:08.329111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.033926+0000","last_change":"2024-04-25T12:22:35.032802+0000","last_active":"2024-04-25T12:22:35.033926+0000","last_peered":"2024-04-25T12:22:35.033926+0000","last_clean":"2024-04-25T12:22:35.033926+0000","last_became_active":"2024-04-25T12:22:35.031906+0000","last_became_peered":"2024-04-25T12:22:35.031906+0000","last_unstale":"2024-04-25T12:22:35.033926+0000","last_undegraded":"2024-04-25T12:22:35.033926+0000","last_fullsized":"2024-04-25T12:22:35.033926+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:40.346041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916736+0000","last_change":"2024-04-25T12:21:54.192601+0000","last_active":"2024-04-25T12:22:34.916736+0000","last_peered":"2024-04-25T12:22:34.916736+0000","last_clean":"2024-04-25T12:22:34.916736+0000","last_became_active":"2024-04-25T12:21:54.191864+0000","last_became_peered":"2024-04-25T12:21:54.191864+0000","last_unstale":"2024-04-25T12:22:34.916736+0000","last_undegraded":"2024-04-25T12:22:34.916736+0000","last_fullsized":"2024-04-25T12:22:34.916736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:50.392769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.916643+0000","last_change":"2024-04-25T12:21:53.197793+0000","last_active":"2024-04-25T12:24:43.916643+0000","last_peered":"2024-04-25T12:24:43.916643+0000","last_clean":"2024-04-25T12:24:43.916643+0000","last_became_active":"2024-04-25T12:21:53.197059+0000","last_became_peered":"2024-04-25T12:21:53.197059+0000","last_unstale":"2024-04-25T12:24:43.916643+0000","last_undegraded":"2024-04-25T12:24:43.916643+0000","last_fullsized":"2024-04-25T12:24:43.916643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:58.471408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893581+0000","last_change":"2024-04-25T12:21:58.355166+0000","last_active":"2024-04-25T12:22:34.893581+0000","last_peered":"2024-04-25T12:22:34.893581+0000","last_clean":"2024-04-25T12:22:34.893581+0000","last_became_active":"2024-04-25T12:21:58.353996+0000","last_became_peered":"2024-04-25T12:21:58.353996+0000","last_unstale":"2024-04-25T12:22:34.893581+0000","last_undegraded":"2024-04-25T12:22:34.893581+0000","last_fullsized":"2024-04-25T12:22:34.893581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:22.681720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980643+0000","last_change":"2024-04-25T12:21:54.219182+0000","last_active":"2024-04-25T12:22:34.980643+0000","last_peered":"2024-04-25T12:22:34.980643+0000","last_clean":"2024-04-25T12:22:34.980643+0000","last_became_active":"2024-04-25T12:21:54.218854+0000","last_became_peered":"2024-04-25T12:21:54.218854+0000","last_unstale":"2024-04-25T12:22:34.980643+0000","last_undegraded":"2024-04-25T12:22:34.980643+0000","last_fullsized":"2024-04-25T12:22:34.980643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:08.985962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'7","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.900945+0000","last_change":"2024-04-25T12:21:53.190102+0000","last_active":"2024-04-25T12:24:37.900945+0000","last_peered":"2024-04-25T12:24:37.900945+0000","last_clean":"2024-04-25T12:24:37.900945+0000","last_became_active":"2024-04-25T12:21:53.189781+0000","last_became_peered":"2024-04-25T12:21:53.189781+0000","last_unstale":"2024-04-25T12:24:37.900945+0000","last_undegraded":"2024-04-25T12:24:37.900945+0000","last_fullsized":"2024-04-25T12:24:37.900945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:52.533217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978106+0000","last_change":"2024-04-25T12:21:58.341932+0000","last_active":"2024-04-25T12:22:34.978106+0000","last_peered":"2024-04-25T12:22:34.978106+0000","last_clean":"2024-04-25T12:22:34.978106+0000","last_became_active":"2024-04-25T12:21:58.341492+0000","last_became_peered":"2024-04-25T12:21:58.341492+0000","last_unstale":"2024-04-25T12:22:34.978106+0000","last_undegraded":"2024-04-25T12:22:34.978106+0000","last_fullsized":"2024-04-25T12:22:34.978106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:51.576036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293382+0000","last_change":"2024-04-25T12:21:54.182541+0000","last_active":"2024-04-25T12:22:35.293382+0000","last_peered":"2024-04-25T12:22:35.293382+0000","last_clean":"2024-04-25T12:22:35.293382+0000","last_became_active":"2024-04-25T12:21:54.181720+0000","last_became_peered":"2024-04-25T12:21:54.181720+0000","last_unstale":"2024-04-25T12:22:35.293382+0000","last_undegraded":"2024-04-25T12:22:35.293382+0000","last_fullsized":"2024-04-25T12:22:35.293382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:00.544076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.893209+0000","last_change":"2024-04-25T12:21:53.200521+0000","last_active":"2024-04-25T12:24:37.893209+0000","last_peered":"2024-04-25T12:24:37.893209+0000","last_clean":"2024-04-25T12:24:37.893209+0000","last_became_active":"2024-04-25T12:21:53.196102+0000","last_became_peered":"2024-04-25T12:21:53.196102+0000","last_unstale":"2024-04-25T12:24:37.893209+0000","last_undegraded":"2024-04-25T12:24:37.893209+0000","last_fullsized":"2024-04-25T12:24:37.893209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:54.350452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916195+0000","last_change":"2024-04-25T12:21:58.342064+0000","last_active":"2024-04-25T12:22:34.916195+0000","last_peered":"2024-04-25T12:22:34.916195+0000","last_clean":"2024-04-25T12:22:34.916195+0000","last_became_active":"2024-04-25T12:21:58.341558+0000","last_became_peered":"2024-04-25T12:21:58.341558+0000","last_unstale":"2024-04-25T12:22:34.916195+0000","last_undegraded":"2024-04-25T12:22:34.916195+0000","last_fullsized":"2024-04-25T12:22:34.916195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:11.378767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887849+0000","last_change":"2024-04-25T12:21:54.206427+0000","last_active":"2024-04-25T12:22:34.887849+0000","last_peered":"2024-04-25T12:22:34.887849+0000","last_clean":"2024-04-25T12:22:34.887849+0000","last_became_active":"2024-04-25T12:21:54.205519+0000","last_became_peered":"2024-04-25T12:21:54.205519+0000","last_unstale":"2024-04-25T12:22:34.887849+0000","last_undegraded":"2024-04-25T12:22:34.887849+0000","last_fullsized":"2024-04-25T12:22:34.887849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:59.659460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:23:59.776320+0000","last_change":"2024-04-25T12:21:53.162914+0000","last_active":"2024-04-25T12:23:59.776320+0000","last_peered":"2024-04-25T12:23:59.776320+0000","last_clean":"2024-04-25T12:23:59.776320+0000","last_became_active":"2024-04-25T12:21:53.162599+0000","last_became_peered":"2024-04-25T12:21:53.162599+0000","last_unstale":"2024-04-25T12:23:59.776320+0000","last_undegraded":"2024-04-25T12:23:59.776320+0000","last_fullsized":"2024-04-25T12:23:59.776320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:23.448280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.920456+0000","last_change":"2024-04-25T12:22:34.919463+0000","last_active":"2024-04-25T12:22:34.920456+0000","last_peered":"2024-04-25T12:22:34.920456+0000","last_clean":"2024-04-25T12:22:34.920456+0000","last_became_active":"2024-04-25T12:22:34.917798+0000","last_became_peered":"2024-04-25T12:22:34.917798+0000","last_unstale":"2024-04-25T12:22:34.920456+0000","last_undegraded":"2024-04-25T12:22:34.920456+0000","last_fullsized":"2024-04-25T12:22:34.920456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:35.620229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894822+0000","last_change":"2024-04-25T12:21:54.202462+0000","last_active":"2024-04-25T12:22:34.894822+0000","last_peered":"2024-04-25T12:22:34.894822+0000","last_clean":"2024-04-25T12:22:34.894822+0000","last_became_active":"2024-04-25T12:21:54.202112+0000","last_became_peered":"2024-04-25T12:21:54.202112+0000","last_unstale":"2024-04-25T12:22:34.894822+0000","last_undegraded":"2024-04-25T12:22:34.894822+0000","last_fullsized":"2024-04-25T12:22:34.894822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:20.813264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.916490+0000","last_change":"2024-04-25T12:21:53.188606+0000","last_active":"2024-04-25T12:24:43.916490+0000","last_peered":"2024-04-25T12:24:43.916490+0000","last_clean":"2024-04-25T12:24:43.916490+0000","last_became_active":"2024-04-25T12:21:53.187855+0000","last_became_peered":"2024-04-25T12:21:53.187855+0000","last_unstale":"2024-04-25T12:24:43.916490+0000","last_undegraded":"2024-04-25T12:24:43.916490+0000","last_fullsized":"2024-04-25T12:24:43.916490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:52.874270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293184+0000","last_change":"2024-04-25T12:21:58.264074+0000","last_active":"2024-04-25T12:22:35.293184+0000","last_peered":"2024-04-25T12:22:35.293184+0000","last_clean":"2024-04-25T12:22:35.293184+0000","last_became_active":"2024-04-25T12:21:58.263425+0000","last_became_peered":"2024-04-25T12:21:58.263425+0000","last_unstale":"2024-04-25T12:22:35.293184+0000","last_undegraded":"2024-04-25T12:22:35.293184+0000","last_fullsized":"2024-04-25T12:22:35.293184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:02.083494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292583+0000","last_change":"2024-04-25T12:21:54.189512+0000","last_active":"2024-04-25T12:22:35.292583+0000","last_peered":"2024-04-25T12:22:35.292583+0000","last_clean":"2024-04-25T12:22:35.292583+0000","last_became_active":"2024-04-25T12:21:54.188587+0000","last_became_peered":"2024-04-25T12:21:54.188587+0000","last_unstale":"2024-04-25T12:22:35.292583+0000","last_undegraded":"2024-04-25T12:22:35.292583+0000","last_fullsized":"2024-04-25T12:22:35.292583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:00.810648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.913498+0000","last_change":"2024-04-25T12:21:53.159998+0000","last_active":"2024-04-25T12:24:43.913498+0000","last_peered":"2024-04-25T12:24:43.913498+0000","last_clean":"2024-04-25T12:24:43.913498+0000","last_became_active":"2024-04-25T12:21:53.159714+0000","last_became_peered":"2024-04-25T12:21:53.159714+0000","last_unstale":"2024-04-25T12:24:43.913498+0000","last_undegraded":"2024-04-25T12:24:43.913498+0000","last_fullsized":"2024-04-25T12:24:43.913498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:38.665874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.983753+0000","last_change":"2024-04-25T12:22:34.982542+0000","last_active":"2024-04-25T12:22:34.983753+0000","last_peered":"2024-04-25T12:22:34.983753+0000","last_clean":"2024-04-25T12:22:34.983753+0000","last_became_active":"2024-04-25T12:22:34.981347+0000","last_became_peered":"2024-04-25T12:22:34.981347+0000","last_unstale":"2024-04-25T12:22:34.983753+0000","last_undegraded":"2024-04-25T12:22:34.983753+0000","last_fullsized":"2024-04-25T12:22:34.983753+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:55.180698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915214+0000","last_change":"2024-04-25T12:21:54.205348+0000","last_active":"2024-04-25T12:22:34.915214+0000","last_peered":"2024-04-25T12:22:34.915214+0000","last_clean":"2024-04-25T12:22:34.915214+0000","last_became_active":"2024-04-25T12:21:54.205023+0000","last_became_peered":"2024-04-25T12:21:54.205023+0000","last_unstale":"2024-04-25T12:22:34.915214+0000","last_undegraded":"2024-04-25T12:22:34.915214+0000","last_fullsized":"2024-04-25T12:22:34.915214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:46.381368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:31.226144+0000","last_change":"2024-04-25T12:21:53.201066+0000","last_active":"2024-04-25T12:24:31.226144+0000","last_peered":"2024-04-25T12:24:31.226144+0000","last_clean":"2024-04-25T12:24:31.226144+0000","last_became_active":"2024-04-25T12:21:53.197081+0000","last_became_peered":"2024-04-25T12:21:53.197081+0000","last_unstale":"2024-04-25T12:24:31.226144+0000","last_undegraded":"2024-04-25T12:24:31.226144+0000","last_fullsized":"2024-04-25T12:24:31.226144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:19.865455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916511+0000","last_change":"2024-04-25T12:21:58.343823+0000","last_active":"2024-04-25T12:22:34.916511+0000","last_peered":"2024-04-25T12:22:34.916511+0000","last_clean":"2024-04-25T12:22:34.916511+0000","last_became_active":"2024-04-25T12:21:58.342796+0000","last_became_peered":"2024-04-25T12:21:58.342796+0000","last_unstale":"2024-04-25T12:22:34.916511+0000","last_undegraded":"2024-04-25T12:22:34.916511+0000","last_fullsized":"2024-04-25T12:22:34.916511+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:14.849636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979107+0000","last_change":"2024-04-25T12:21:54.204569+0000","last_active":"2024-04-25T12:22:34.979107+0000","last_peered":"2024-04-25T12:22:34.979107+0000","last_clean":"2024-04-25T12:22:34.979107+0000","last_became_active":"2024-04-25T12:21:54.204212+0000","last_became_peered":"2024-04-25T12:21:54.204212+0000","last_unstale":"2024-04-25T12:22:34.979107+0000","last_undegraded":"2024-04-25T12:22:34.979107+0000","last_fullsized":"2024-04-25T12:22:34.979107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:44.245327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.897489+0000","last_change":"2024-04-25T12:21:53.169844+0000","last_active":"2024-04-25T12:24:37.897489+0000","last_peered":"2024-04-25T12:24:37.897489+0000","last_clean":"2024-04-25T12:24:37.897489+0000","last_became_active":"2024-04-25T12:21:53.168939+0000","last_became_peered":"2024-04-25T12:21:53.168939+0000","last_unstale":"2024-04-25T12:24:37.897489+0000","last_undegraded":"2024-04-25T12:24:37.897489+0000","last_fullsized":"2024-04-25T12:24:37.897489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:57.836476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.888439+0000","last_change":"2024-04-25T12:21:42.610528+0000","last_active":"2024-04-25T12:22:34.888439+0000","last_peered":"2024-04-25T12:22:34.888439+0000","last_clean":"2024-04-25T12:22:34.888439+0000","last_became_active":"2024-04-25T12:21:42.608579+0000","last_became_peered":"2024-04-25T12:21:42.608579+0000","last_unstale":"2024-04-25T12:22:34.888439+0000","last_undegraded":"2024-04-25T12:22:34.888439+0000","last_fullsized":"2024-04-25T12:22:34.888439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:39.904333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:39.904333+0000","last_clean_scrub_stamp":"2024-04-25T12:21:39.904333+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:16.122851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029891+0000","last_change":"2024-04-25T12:21:58.351105+0000","last_active":"2024-04-25T12:22:35.029891+0000","last_peered":"2024-04-25T12:22:35.029891+0000","last_clean":"2024-04-25T12:22:35.029891+0000","last_became_active":"2024-04-25T12:21:58.350087+0000","last_became_peered":"2024-04-25T12:21:58.350087+0000","last_unstale":"2024-04-25T12:22:35.029891+0000","last_undegraded":"2024-04-25T12:22:35.029891+0000","last_fullsized":"2024-04-25T12:22:35.029891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:22.686410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891042+0000","last_change":"2024-04-25T12:21:54.215530+0000","last_active":"2024-04-25T12:22:34.891042+0000","last_peered":"2024-04-25T12:22:34.891042+0000","last_clean":"2024-04-25T12:22:34.891042+0000","last_became_active":"2024-04-25T12:21:54.211077+0000","last_became_peered":"2024-04-25T12:21:54.211077+0000","last_unstale":"2024-04-25T12:22:34.891042+0000","last_undegraded":"2024-04-25T12:22:34.891042+0000","last_fullsized":"2024-04-25T12:22:34.891042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:03.079964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.903231+0000","last_change":"2024-04-25T12:21:53.175259+0000","last_active":"2024-04-25T12:24:37.903231+0000","last_peered":"2024-04-25T12:24:37.903231+0000","last_clean":"2024-04-25T12:24:37.903231+0000","last_became_active":"2024-04-25T12:21:53.174980+0000","last_became_peered":"2024-04-25T12:21:53.174980+0000","last_unstale":"2024-04-25T12:24:37.903231+0000","last_undegraded":"2024-04-25T12:24:37.903231+0000","last_fullsized":"2024-04-25T12:24:37.903231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:51.852590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029315+0000","last_change":"2024-04-25T12:21:58.344660+0000","last_active":"2024-04-25T12:22:35.029315+0000","last_peered":"2024-04-25T12:22:35.029315+0000","last_clean":"2024-04-25T12:22:35.029315+0000","last_became_active":"2024-04-25T12:21:58.343502+0000","last_became_peered":"2024-04-25T12:21:58.343502+0000","last_unstale":"2024-04-25T12:22:35.029315+0000","last_undegraded":"2024-04-25T12:22:35.029315+0000","last_fullsized":"2024-04-25T12:22:35.029315+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:46.127740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887959+0000","last_change":"2024-04-25T12:21:54.207666+0000","last_active":"2024-04-25T12:22:34.887959+0000","last_peered":"2024-04-25T12:22:34.887959+0000","last_clean":"2024-04-25T12:22:34.887959+0000","last_became_active":"2024-04-25T12:21:54.206749+0000","last_became_peered":"2024-04-25T12:21:54.206749+0000","last_unstale":"2024-04-25T12:22:34.887959+0000","last_undegraded":"2024-04-25T12:22:34.887959+0000","last_fullsized":"2024-04-25T12:22:34.887959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:36.113364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.900925+0000","last_change":"2024-04-25T12:21:53.179412+0000","last_active":"2024-04-25T12:24:37.900925+0000","last_peered":"2024-04-25T12:24:37.900925+0000","last_clean":"2024-04-25T12:24:37.900925+0000","last_became_active":"2024-04-25T12:21:53.179142+0000","last_became_peered":"2024-04-25T12:21:53.179142+0000","last_unstale":"2024-04-25T12:24:37.900925+0000","last_undegraded":"2024-04-25T12:24:37.900925+0000","last_fullsized":"2024-04-25T12:24:37.900925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:08.771439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915942+0000","last_change":"2024-04-25T12:21:58.254119+0000","last_active":"2024-04-25T12:22:34.915942+0000","last_peered":"2024-04-25T12:22:34.915942+0000","last_clean":"2024-04-25T12:22:34.915942+0000","last_became_active":"2024-04-25T12:21:58.253624+0000","last_became_peered":"2024-04-25T12:21:58.253624+0000","last_unstale":"2024-04-25T12:22:34.915942+0000","last_undegraded":"2024-04-25T12:22:34.915942+0000","last_fullsized":"2024-04-25T12:22:34.915942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:54.719908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891979+0000","last_change":"2024-04-25T12:21:54.219803+0000","last_active":"2024-04-25T12:22:34.891979+0000","last_peered":"2024-04-25T12:22:34.891979+0000","last_clean":"2024-04-25T12:22:34.891979+0000","last_became_active":"2024-04-25T12:21:54.219513+0000","last_became_peered":"2024-04-25T12:21:54.219513+0000","last_unstale":"2024-04-25T12:22:34.891979+0000","last_undegraded":"2024-04-25T12:22:34.891979+0000","last_fullsized":"2024-04-25T12:22:34.891979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:03.617773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.912860+0000","last_change":"2024-04-25T12:21:53.159382+0000","last_active":"2024-04-25T12:24:43.912860+0000","last_peered":"2024-04-25T12:24:43.912860+0000","last_clean":"2024-04-25T12:24:43.912860+0000","last_became_active":"2024-04-25T12:21:53.159018+0000","last_became_peered":"2024-04-25T12:21:53.159018+0000","last_unstale":"2024-04-25T12:24:43.912860+0000","last_undegraded":"2024-04-25T12:24:43.912860+0000","last_fullsized":"2024-04-25T12:24:43.912860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:39.868721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.885990+0000","last_change":"2024-04-25T12:21:58.344915+0000","last_active":"2024-04-25T12:22:34.885990+0000","last_peered":"2024-04-25T12:22:34.885990+0000","last_clean":"2024-04-25T12:22:34.885990+0000","last_became_active":"2024-04-25T12:21:58.343839+0000","last_became_peered":"2024-04-25T12:21:58.343839+0000","last_unstale":"2024-04-25T12:22:34.885990+0000","last_undegraded":"2024-04-25T12:22:34.885990+0000","last_fullsized":"2024-04-25T12:22:34.885990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:20.784047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891353+0000","last_change":"2024-04-25T12:21:54.215509+0000","last_active":"2024-04-25T12:22:34.891353+0000","last_peered":"2024-04-25T12:22:34.891353+0000","last_clean":"2024-04-25T12:22:34.891353+0000","last_became_active":"2024-04-25T12:21:54.211719+0000","last_became_peered":"2024-04-25T12:21:54.211719+0000","last_unstale":"2024-04-25T12:22:34.891353+0000","last_undegraded":"2024-04-25T12:22:34.891353+0000","last_fullsized":"2024-04-25T12:22:34.891353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:21.047044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'2","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:10.988142+0000","last_change":"2024-04-25T12:21:53.170513+0000","last_active":"2024-04-25T12:24:10.988142+0000","last_peered":"2024-04-25T12:24:10.988142+0000","last_clean":"2024-04-25T12:24:10.988142+0000","last_became_active":"2024-04-25T12:21:53.169743+0000","last_became_peered":"2024-04-25T12:21:53.169743+0000","last_unstale":"2024-04-25T12:24:10.988142+0000","last_undegraded":"2024-04-25T12:24:10.988142+0000","last_fullsized":"2024-04-25T12:24:10.988142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:03.566639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893058+0000","last_change":"2024-04-25T12:21:58.254432+0000","last_active":"2024-04-25T12:22:34.893058+0000","last_peered":"2024-04-25T12:22:34.893058+0000","last_clean":"2024-04-25T12:22:34.893058+0000","last_became_active":"2024-04-25T12:21:58.253256+0000","last_became_peered":"2024-04-25T12:21:58.253256+0000","last_unstale":"2024-04-25T12:22:34.893058+0000","last_undegraded":"2024-04-25T12:22:34.893058+0000","last_fullsized":"2024-04-25T12:22:34.893058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:13.469118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.897492+0000","last_change":"2024-04-25T12:22:34.896289+0000","last_active":"2024-04-25T12:22:34.897492+0000","last_peered":"2024-04-25T12:22:34.897492+0000","last_clean":"2024-04-25T12:22:34.897492+0000","last_became_active":"2024-04-25T12:22:34.895584+0000","last_became_peered":"2024-04-25T12:22:34.895584+0000","last_unstale":"2024-04-25T12:22:34.897492+0000","last_undegraded":"2024-04-25T12:22:34.897492+0000","last_fullsized":"2024-04-25T12:22:34.897492+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:54.648002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"28'17","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.895231+0000","last_change":"2024-04-25T12:21:53.163846+0000","last_active":"2024-04-25T12:24:37.895231+0000","last_peered":"2024-04-25T12:24:37.895231+0000","last_clean":"2024-04-25T12:24:37.895231+0000","last_became_active":"2024-04-25T12:21:53.163565+0000","last_became_peered":"2024-04-25T12:21:53.163565+0000","last_unstale":"2024-04-25T12:24:37.895231+0000","last_undegraded":"2024-04-25T12:24:37.895231+0000","last_fullsized":"2024-04-25T12:24:37.895231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:22.297830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916263+0000","last_change":"2024-04-25T12:21:58.250582+0000","last_active":"2024-04-25T12:22:34.916263+0000","last_peered":"2024-04-25T12:22:34.916263+0000","last_clean":"2024-04-25T12:22:34.916263+0000","last_became_active":"2024-04-25T12:21:58.250136+0000","last_became_peered":"2024-04-25T12:21:58.250136+0000","last_unstale":"2024-04-25T12:22:34.916263+0000","last_undegraded":"2024-04-25T12:22:34.916263+0000","last_fullsized":"2024-04-25T12:22:34.916263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:23.786586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030261+0000","last_change":"2024-04-25T12:21:54.200492+0000","last_active":"2024-04-25T12:22:35.030261+0000","last_peered":"2024-04-25T12:22:35.030261+0000","last_clean":"2024-04-25T12:22:35.030261+0000","last_became_active":"2024-04-25T12:21:54.200187+0000","last_became_peered":"2024-04-25T12:21:54.200187+0000","last_unstale":"2024-04-25T12:22:35.030261+0000","last_undegraded":"2024-04-25T12:22:35.030261+0000","last_fullsized":"2024-04-25T12:22:35.030261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:17.428348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.895785+0000","last_change":"2024-04-25T12:21:53.186752+0000","last_active":"2024-04-25T12:24:37.895785+0000","last_peered":"2024-04-25T12:24:37.895785+0000","last_clean":"2024-04-25T12:24:37.895785+0000","last_became_active":"2024-04-25T12:21:53.184866+0000","last_became_peered":"2024-04-25T12:21:53.184866+0000","last_unstale":"2024-04-25T12:24:37.895785+0000","last_undegraded":"2024-04-25T12:24:37.895785+0000","last_fullsized":"2024-04-25T12:24:37.895785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:07.228743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980381+0000","last_change":"2024-04-25T12:21:58.344241+0000","last_active":"2024-04-25T12:22:34.980381+0000","last_peered":"2024-04-25T12:22:34.980381+0000","last_clean":"2024-04-25T12:22:34.980381+0000","last_became_active":"2024-04-25T12:21:58.343764+0000","last_became_peered":"2024-04-25T12:21:58.343764+0000","last_unstale":"2024-04-25T12:22:34.980381+0000","last_undegraded":"2024-04-25T12:22:34.980381+0000","last_fullsized":"2024-04-25T12:22:34.980381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:25.931918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890533+0000","last_change":"2024-04-25T12:21:54.216405+0000","last_active":"2024-04-25T12:22:34.890533+0000","last_peered":"2024-04-25T12:22:34.890533+0000","last_clean":"2024-04-25T12:22:34.890533+0000","last_became_active":"2024-04-25T12:21:54.215575+0000","last_became_peered":"2024-04-25T12:21:54.215575+0000","last_unstale":"2024-04-25T12:22:34.890533+0000","last_undegraded":"2024-04-25T12:22:34.890533+0000","last_fullsized":"2024-04-25T12:22:34.890533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:57.935295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.896331+0000","last_change":"2024-04-25T12:21:53.198384+0000","last_active":"2024-04-25T12:24:37.896331+0000","last_peered":"2024-04-25T12:24:37.896331+0000","last_clean":"2024-04-25T12:24:37.896331+0000","last_became_active":"2024-04-25T12:21:53.197618+0000","last_became_peered":"2024-04-25T12:21:53.197618+0000","last_unstale":"2024-04-25T12:24:37.896331+0000","last_undegraded":"2024-04-25T12:24:37.896331+0000","last_fullsized":"2024-04-25T12:24:37.896331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:23.368197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979881+0000","last_change":"2024-04-25T12:21:58.342445+0000","last_active":"2024-04-25T12:22:34.979881+0000","last_peered":"2024-04-25T12:22:34.979881+0000","last_clean":"2024-04-25T12:22:34.979881+0000","last_became_active":"2024-04-25T12:21:58.341575+0000","last_became_peered":"2024-04-25T12:21:58.341575+0000","last_unstale":"2024-04-25T12:22:34.979881+0000","last_undegraded":"2024-04-25T12:22:34.979881+0000","last_fullsized":"2024-04-25T12:22:34.979881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:34.553686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915983+0000","last_change":"2024-04-25T12:21:54.200799+0000","last_active":"2024-04-25T12:22:34.915983+0000","last_peered":"2024-04-25T12:22:34.915983+0000","last_clean":"2024-04-25T12:22:34.915983+0000","last_became_active":"2024-04-25T12:21:54.200209+0000","last_became_peered":"2024-04-25T12:21:54.200209+0000","last_unstale":"2024-04-25T12:22:34.915983+0000","last_undegraded":"2024-04-25T12:22:34.915983+0000","last_fullsized":"2024-04-25T12:22:34.915983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:57.958942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.912380+0000","last_change":"2024-04-25T12:21:53.168731+0000","last_active":"2024-04-25T12:24:43.912380+0000","last_peered":"2024-04-25T12:24:43.912380+0000","last_clean":"2024-04-25T12:24:43.912380+0000","last_became_active":"2024-04-25T12:21:53.168461+0000","last_became_peered":"2024-04-25T12:21:53.168461+0000","last_unstale":"2024-04-25T12:24:43.912380+0000","last_undegraded":"2024-04-25T12:24:43.912380+0000","last_fullsized":"2024-04-25T12:24:43.912380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:34.935857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887582+0000","last_change":"2024-04-25T12:21:58.344622+0000","last_active":"2024-04-25T12:22:34.887582+0000","last_peered":"2024-04-25T12:22:34.887582+0000","last_clean":"2024-04-25T12:22:34.887582+0000","last_became_active":"2024-04-25T12:21:58.343533+0000","last_became_peered":"2024-04-25T12:21:58.343533+0000","last_unstale":"2024-04-25T12:22:34.887582+0000","last_undegraded":"2024-04-25T12:22:34.887582+0000","last_fullsized":"2024-04-25T12:22:34.887582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:35.536857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891003+0000","last_change":"2024-04-25T12:21:54.216903+0000","last_active":"2024-04-25T12:22:34.891003+0000","last_peered":"2024-04-25T12:22:34.891003+0000","last_clean":"2024-04-25T12:22:34.891003+0000","last_became_active":"2024-04-25T12:21:54.216312+0000","last_became_peered":"2024-04-25T12:21:54.216312+0000","last_unstale":"2024-04-25T12:22:34.891003+0000","last_undegraded":"2024-04-25T12:22:34.891003+0000","last_fullsized":"2024-04-25T12:22:34.891003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:12.963783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'16","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:51.472761+0000","last_change":"2024-04-25T12:21:53.179160+0000","last_active":"2024-04-25T12:24:51.472761+0000","last_peered":"2024-04-25T12:24:51.472761+0000","last_clean":"2024-04-25T12:24:51.472761+0000","last_became_active":"2024-04-25T12:21:53.177229+0000","last_became_peered":"2024-04-25T12:21:53.177229+0000","last_unstale":"2024-04-25T12:24:51.472761+0000","last_undegraded":"2024-04-25T12:24:51.472761+0000","last_fullsized":"2024-04-25T12:24:51.472761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:09.082459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4283,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293725+0000","last_change":"2024-04-25T12:21:58.245003+0000","last_active":"2024-04-25T12:22:35.293725+0000","last_peered":"2024-04-25T12:22:35.293725+0000","last_clean":"2024-04-25T12:22:35.293725+0000","last_became_active":"2024-04-25T12:21:58.244500+0000","last_became_peered":"2024-04-25T12:21:58.244500+0000","last_unstale":"2024-04-25T12:22:35.293725+0000","last_undegraded":"2024-04-25T12:22:35.293725+0000","last_fullsized":"2024-04-25T12:22:35.293725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:35.010344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.895285+0000","last_change":"2024-04-25T12:21:54.213845+0000","last_active":"2024-04-25T12:22:34.895285+0000","last_peered":"2024-04-25T12:22:34.895285+0000","last_clean":"2024-04-25T12:22:34.895285+0000","last_became_active":"2024-04-25T12:21:54.213413+0000","last_became_peered":"2024-04-25T12:21:54.213413+0000","last_unstale":"2024-04-25T12:22:34.895285+0000","last_undegraded":"2024-04-25T12:22:34.895285+0000","last_fullsized":"2024-04-25T12:22:34.895285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:59.864079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:25.191571+0000","last_change":"2024-04-25T12:21:53.186487+0000","last_active":"2024-04-25T12:24:25.191571+0000","last_peered":"2024-04-25T12:24:25.191571+0000","last_clean":"2024-04-25T12:24:25.191571+0000","last_became_active":"2024-04-25T12:21:53.186227+0000","last_became_peered":"2024-04-25T12:21:53.186227+0000","last_unstale":"2024-04-25T12:24:25.191571+0000","last_undegraded":"2024-04-25T12:24:25.191571+0000","last_fullsized":"2024-04-25T12:24:25.191571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:20.317103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894312+0000","last_change":"2024-04-25T12:21:58.249806+0000","last_active":"2024-04-25T12:22:34.894312+0000","last_peered":"2024-04-25T12:22:34.894312+0000","last_clean":"2024-04-25T12:22:34.894312+0000","last_became_active":"2024-04-25T12:21:58.248841+0000","last_became_peered":"2024-04-25T12:21:58.248841+0000","last_unstale":"2024-04-25T12:22:34.894312+0000","last_undegraded":"2024-04-25T12:22:34.894312+0000","last_fullsized":"2024-04-25T12:22:34.894312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:18.448118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916576+0000","last_change":"2024-04-25T12:21:54.189948+0000","last_active":"2024-04-25T12:22:34.916576+0000","last_peered":"2024-04-25T12:22:34.916576+0000","last_clean":"2024-04-25T12:22:34.916576+0000","last_became_active":"2024-04-25T12:21:54.189097+0000","last_became_peered":"2024-04-25T12:21:54.189097+0000","last_unstale":"2024-04-25T12:22:34.916576+0000","last_undegraded":"2024-04-25T12:22:34.916576+0000","last_fullsized":"2024-04-25T12:22:34.916576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:09.029536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'4","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.916749+0000","last_change":"2024-04-25T12:21:53.206472+0000","last_active":"2024-04-25T12:24:43.916749+0000","last_peered":"2024-04-25T12:24:43.916749+0000","last_clean":"2024-04-25T12:24:43.916749+0000","last_became_active":"2024-04-25T12:21:53.205742+0000","last_became_peered":"2024-04-25T12:21:53.205742+0000","last_unstale":"2024-04-25T12:24:43.916749+0000","last_undegraded":"2024-04-25T12:24:43.916749+0000","last_fullsized":"2024-04-25T12:24:43.916749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:37.444336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978676+0000","last_change":"2024-04-25T12:21:58.261490+0000","last_active":"2024-04-25T12:22:34.978676+0000","last_peered":"2024-04-25T12:22:34.978676+0000","last_clean":"2024-04-25T12:22:34.978676+0000","last_became_active":"2024-04-25T12:21:58.260979+0000","last_became_peered":"2024-04-25T12:21:58.260979+0000","last_unstale":"2024-04-25T12:22:34.978676+0000","last_undegraded":"2024-04-25T12:22:34.978676+0000","last_fullsized":"2024-04-25T12:22:34.978676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:51.396618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890271+0000","last_change":"2024-04-25T12:22:34.890271+0000","last_active":"2024-04-25T12:22:34.890271+0000","last_peered":"2024-04-25T12:22:34.890271+0000","last_clean":"2024-04-25T12:22:34.890271+0000","last_became_active":"2024-04-25T12:22:34.889562+0000","last_became_peered":"2024-04-25T12:22:34.889562+0000","last_unstale":"2024-04-25T12:22:34.890271+0000","last_undegraded":"2024-04-25T12:22:34.890271+0000","last_fullsized":"2024-04-25T12:22:34.890271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:17.476913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.895701+0000","last_change":"2024-04-25T12:21:53.206850+0000","last_active":"2024-04-25T12:24:37.895701+0000","last_peered":"2024-04-25T12:24:37.895701+0000","last_clean":"2024-04-25T12:24:37.895701+0000","last_became_active":"2024-04-25T12:21:53.206274+0000","last_became_peered":"2024-04-25T12:21:53.206274+0000","last_unstale":"2024-04-25T12:24:37.895701+0000","last_undegraded":"2024-04-25T12:24:37.895701+0000","last_fullsized":"2024-04-25T12:24:37.895701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:25.867387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979375+0000","last_change":"2024-04-25T12:21:58.346593+0000","last_active":"2024-04-25T12:22:34.979375+0000","last_peered":"2024-04-25T12:22:34.979375+0000","last_clean":"2024-04-25T12:22:34.979375+0000","last_became_active":"2024-04-25T12:21:58.346195+0000","last_became_peered":"2024-04-25T12:21:58.346195+0000","last_unstale":"2024-04-25T12:22:34.979375+0000","last_undegraded":"2024-04-25T12:22:34.979375+0000","last_fullsized":"2024-04-25T12:22:34.979375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:47.745861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915960+0000","last_change":"2024-04-25T12:21:58.347908+0000","last_active":"2024-04-25T12:22:34.915960+0000","last_peered":"2024-04-25T12:22:34.915960+0000","last_clean":"2024-04-25T12:22:34.915960+0000","last_became_active":"2024-04-25T12:21:58.346887+0000","last_became_peered":"2024-04-25T12:21:58.346887+0000","last_unstale":"2024-04-25T12:22:34.915960+0000","last_undegraded":"2024-04-25T12:22:34.915960+0000","last_fullsized":"2024-04-25T12:22:34.915960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:06.228605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.291914+0000","last_change":"2024-04-25T12:21:54.203140+0000","last_active":"2024-04-25T12:22:35.291914+0000","last_peered":"2024-04-25T12:22:35.291914+0000","last_clean":"2024-04-25T12:22:35.291914+0000","last_became_active":"2024-04-25T12:21:54.202399+0000","last_became_peered":"2024-04-25T12:21:54.202399+0000","last_unstale":"2024-04-25T12:22:35.291914+0000","last_undegraded":"2024-04-25T12:22:35.291914+0000","last_fullsized":"2024-04-25T12:22:35.291914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:19.691760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'3","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.900829+0000","last_change":"2024-04-25T12:21:53.202038+0000","last_active":"2024-04-25T12:24:37.900829+0000","last_peered":"2024-04-25T12:24:37.900829+0000","last_clean":"2024-04-25T12:24:37.900829+0000","last_became_active":"2024-04-25T12:21:53.189592+0000","last_became_peered":"2024-04-25T12:21:53.189592+0000","last_unstale":"2024-04-25T12:24:37.900829+0000","last_undegraded":"2024-04-25T12:24:37.900829+0000","last_fullsized":"2024-04-25T12:24:37.900829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:38.052120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030482+0000","last_change":"2024-04-25T12:21:58.246247+0000","last_active":"2024-04-25T12:22:35.030482+0000","last_peered":"2024-04-25T12:22:35.030482+0000","last_clean":"2024-04-25T12:22:35.030482+0000","last_became_active":"2024-04-25T12:21:58.245085+0000","last_became_peered":"2024-04-25T12:21:58.245085+0000","last_unstale":"2024-04-25T12:22:35.030482+0000","last_undegraded":"2024-04-25T12:22:35.030482+0000","last_fullsized":"2024-04-25T12:22:35.030482+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:24.660921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978856+0000","last_change":"2024-04-25T12:21:54.207534+0000","last_active":"2024-04-25T12:22:34.978856+0000","last_peered":"2024-04-25T12:22:34.978856+0000","last_clean":"2024-04-25T12:22:34.978856+0000","last_became_active":"2024-04-25T12:21:54.206786+0000","last_became_peered":"2024-04-25T12:21:54.206786+0000","last_unstale":"2024-04-25T12:22:34.978856+0000","last_undegraded":"2024-04-25T12:22:34.978856+0000","last_fullsized":"2024-04-25T12:22:34.978856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:48.775827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:31.226688+0000","last_change":"2024-04-25T12:21:53.190402+0000","last_active":"2024-04-25T12:24:31.226688+0000","last_peered":"2024-04-25T12:24:31.226688+0000","last_clean":"2024-04-25T12:24:31.226688+0000","last_became_active":"2024-04-25T12:21:53.189936+0000","last_became_peered":"2024-04-25T12:21:53.189936+0000","last_unstale":"2024-04-25T12:24:31.226688+0000","last_undegraded":"2024-04-25T12:24:31.226688+0000","last_fullsized":"2024-04-25T12:24:31.226688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:30.984588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.895874+0000","last_change":"2024-04-25T12:21:53.186071+0000","last_active":"2024-04-25T12:24:37.895874+0000","last_peered":"2024-04-25T12:24:37.895874+0000","last_clean":"2024-04-25T12:24:37.895874+0000","last_became_active":"2024-04-25T12:21:53.185357+0000","last_became_peered":"2024-04-25T12:21:53.185357+0000","last_unstale":"2024-04-25T12:24:37.895874+0000","last_undegraded":"2024-04-25T12:24:37.895874+0000","last_fullsized":"2024-04-25T12:24:37.895874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:10.148702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916445+0000","last_change":"2024-04-25T12:21:54.205678+0000","last_active":"2024-04-25T12:22:34.916445+0000","last_peered":"2024-04-25T12:22:34.916445+0000","last_clean":"2024-04-25T12:22:34.916445+0000","last_became_active":"2024-04-25T12:21:54.205219+0000","last_became_peered":"2024-04-25T12:21:54.205219+0000","last_unstale":"2024-04-25T12:22:34.916445+0000","last_undegraded":"2024-04-25T12:22:34.916445+0000","last_fullsized":"2024-04-25T12:22:34.916445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:55.152284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884465+0000","last_change":"2024-04-25T12:21:58.257395+0000","last_active":"2024-04-25T12:22:34.884465+0000","last_peered":"2024-04-25T12:22:34.884465+0000","last_clean":"2024-04-25T12:22:34.884465+0000","last_became_active":"2024-04-25T12:21:58.256219+0000","last_became_peered":"2024-04-25T12:21:58.256219+0000","last_unstale":"2024-04-25T12:22:34.884465+0000","last_undegraded":"2024-04-25T12:22:34.884465+0000","last_fullsized":"2024-04-25T12:22:34.884465+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:15.119967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:25.197594+0000","last_change":"2024-04-25T12:21:53.194633+0000","last_active":"2024-04-25T12:24:25.197594+0000","last_peered":"2024-04-25T12:24:25.197594+0000","last_clean":"2024-04-25T12:24:25.197594+0000","last_became_active":"2024-04-25T12:21:53.194306+0000","last_became_peered":"2024-04-25T12:21:53.194306+0000","last_unstale":"2024-04-25T12:24:25.197594+0000","last_undegraded":"2024-04-25T12:24:25.197594+0000","last_fullsized":"2024-04-25T12:24:25.197594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:03.566639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1063,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894127+0000","last_change":"2024-04-25T12:21:54.201494+0000","last_active":"2024-04-25T12:22:34.894127+0000","last_peered":"2024-04-25T12:22:34.894127+0000","last_clean":"2024-04-25T12:22:34.894127+0000","last_became_active":"2024-04-25T12:21:54.196085+0000","last_became_peered":"2024-04-25T12:21:54.196085+0000","last_unstale":"2024-04-25T12:22:34.894127+0000","last_undegraded":"2024-04-25T12:22:34.894127+0000","last_fullsized":"2024-04-25T12:22:34.894127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:21.183608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979718+0000","last_change":"2024-04-25T12:21:58.261744+0000","last_active":"2024-04-25T12:22:34.979718+0000","last_peered":"2024-04-25T12:22:34.979718+0000","last_clean":"2024-04-25T12:22:34.979718+0000","last_became_active":"2024-04-25T12:21:58.260821+0000","last_became_peered":"2024-04-25T12:21:58.260821+0000","last_unstale":"2024-04-25T12:22:34.979718+0000","last_undegraded":"2024-04-25T12:22:34.979718+0000","last_fullsized":"2024-04-25T12:22:34.979718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:14.169485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029125+0000","last_change":"2024-04-25T12:21:54.201042+0000","last_active":"2024-04-25T12:22:35.029125+0000","last_peered":"2024-04-25T12:22:35.029125+0000","last_clean":"2024-04-25T12:22:35.029125+0000","last_became_active":"2024-04-25T12:21:54.200446+0000","last_became_peered":"2024-04-25T12:21:54.200446+0000","last_unstale":"2024-04-25T12:22:35.029125+0000","last_undegraded":"2024-04-25T12:22:35.029125+0000","last_fullsized":"2024-04-25T12:22:35.029125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:37.866196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884359+0000","last_change":"2024-04-25T12:21:54.188004+0000","last_active":"2024-04-25T12:22:34.884359+0000","last_peered":"2024-04-25T12:22:34.884359+0000","last_clean":"2024-04-25T12:22:34.884359+0000","last_became_active":"2024-04-25T12:21:54.187254+0000","last_became_peered":"2024-04-25T12:21:54.187254+0000","last_unstale":"2024-04-25T12:22:34.884359+0000","last_undegraded":"2024-04-25T12:22:34.884359+0000","last_fullsized":"2024-04-25T12:22:34.884359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:32.252676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887407+0000","last_change":"2024-04-25T12:21:54.206788+0000","last_active":"2024-04-25T12:22:34.887407+0000","last_peered":"2024-04-25T12:22:34.887407+0000","last_clean":"2024-04-25T12:22:34.887407+0000","last_became_active":"2024-04-25T12:21:54.204904+0000","last_became_peered":"2024-04-25T12:21:54.204904+0000","last_unstale":"2024-04-25T12:22:34.887407+0000","last_undegraded":"2024-04-25T12:22:34.887407+0000","last_fullsized":"2024-04-25T12:22:34.887407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:24.928840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916233+0000","last_change":"2024-04-25T12:21:54.204288+0000","last_active":"2024-04-25T12:22:34.916233+0000","last_peered":"2024-04-25T12:22:34.916233+0000","last_clean":"2024-04-25T12:22:34.916233+0000","last_became_active":"2024-04-25T12:21:54.203922+0000","last_became_peered":"2024-04-25T12:21:54.203922+0000","last_unstale":"2024-04-25T12:22:34.916233+0000","last_undegraded":"2024-04-25T12:22:34.916233+0000","last_fullsized":"2024-04-25T12:22:34.916233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:36.299452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980303+0000","last_change":"2024-04-25T12:21:54.208621+0000","last_active":"2024-04-25T12:22:34.980303+0000","last_peered":"2024-04-25T12:22:34.980303+0000","last_clean":"2024-04-25T12:22:34.980303+0000","last_became_active":"2024-04-25T12:21:54.206993+0000","last_became_peered":"2024-04-25T12:21:54.206993+0000","last_unstale":"2024-04-25T12:22:34.980303+0000","last_undegraded":"2024-04-25T12:22:34.980303+0000","last_fullsized":"2024-04-25T12:22:34.980303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:56:08.605883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292881+0000","last_change":"2024-04-25T12:21:54.202203+0000","last_active":"2024-04-25T12:22:35.292881+0000","last_peered":"2024-04-25T12:22:35.292881+0000","last_clean":"2024-04-25T12:22:35.292881+0000","last_became_active":"2024-04-25T12:21:54.201551+0000","last_became_peered":"2024-04-25T12:21:54.201551+0000","last_unstale":"2024-04-25T12:22:35.292881+0000","last_undegraded":"2024-04-25T12:22:35.292881+0000","last_fullsized":"2024-04-25T12:22:35.292881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:12.846584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030100+0000","last_change":"2024-04-25T12:21:54.220705+0000","last_active":"2024-04-25T12:22:35.030100+0000","last_peered":"2024-04-25T12:22:35.030100+0000","last_clean":"2024-04-25T12:22:35.030100+0000","last_became_active":"2024-04-25T12:21:54.220435+0000","last_became_peered":"2024-04-25T12:21:54.220435+0000","last_unstale":"2024-04-25T12:22:35.030100+0000","last_undegraded":"2024-04-25T12:22:35.030100+0000","last_fullsized":"2024-04-25T12:22:35.030100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:27.885210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980397+0000","last_change":"2024-04-25T12:21:54.206568+0000","last_active":"2024-04-25T12:22:34.980397+0000","last_peered":"2024-04-25T12:22:34.980397+0000","last_clean":"2024-04-25T12:22:34.980397+0000","last_became_active":"2024-04-25T12:21:54.204587+0000","last_became_peered":"2024-04-25T12:21:54.204587+0000","last_unstale":"2024-04-25T12:22:34.980397+0000","last_undegraded":"2024-04-25T12:22:34.980397+0000","last_fullsized":"2024-04-25T12:22:34.980397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:37.419230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.297659+0000","last_change":"2024-04-25T12:22:35.295869+0000","last_active":"2024-04-25T12:22:35.297659+0000","last_peered":"2024-04-25T12:22:35.297659+0000","last_clean":"2024-04-25T12:22:35.297659+0000","last_became_active":"2024-04-25T12:22:35.295116+0000","last_became_peered":"2024-04-25T12:22:35.295116+0000","last_unstale":"2024-04-25T12:22:35.297659+0000","last_undegraded":"2024-04-25T12:22:35.297659+0000","last_fullsized":"2024-04-25T12:22:35.297659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:08.665587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979578+0000","last_change":"2024-04-25T12:21:54.203886+0000","last_active":"2024-04-25T12:22:34.979578+0000","last_peered":"2024-04-25T12:22:34.979578+0000","last_clean":"2024-04-25T12:22:34.979578+0000","last_became_active":"2024-04-25T12:21:54.203464+0000","last_became_peered":"2024-04-25T12:21:54.203464+0000","last_unstale":"2024-04-25T12:22:34.979578+0000","last_undegraded":"2024-04-25T12:22:34.979578+0000","last_fullsized":"2024-04-25T12:22:34.979578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:41.646353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887358+0000","last_change":"2024-04-25T12:21:54.213114+0000","last_active":"2024-04-25T12:22:34.887358+0000","last_peered":"2024-04-25T12:22:34.887358+0000","last_clean":"2024-04-25T12:22:34.887358+0000","last_became_active":"2024-04-25T12:21:54.212559+0000","last_became_peered":"2024-04-25T12:21:54.212559+0000","last_unstale":"2024-04-25T12:22:34.887358+0000","last_undegraded":"2024-04-25T12:22:34.887358+0000","last_fullsized":"2024-04-25T12:22:34.887358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:13.824789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915648+0000","last_change":"2024-04-25T12:21:54.215749+0000","last_active":"2024-04-25T12:22:34.915648+0000","last_peered":"2024-04-25T12:22:34.915648+0000","last_clean":"2024-04-25T12:22:34.915648+0000","last_became_active":"2024-04-25T12:21:54.215446+0000","last_became_peered":"2024-04-25T12:21:54.215446+0000","last_unstale":"2024-04-25T12:22:34.915648+0000","last_undegraded":"2024-04-25T12:22:34.915648+0000","last_fullsized":"2024-04-25T12:22:34.915648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:31.642141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029876+0000","last_change":"2024-04-25T12:21:54.210099+0000","last_active":"2024-04-25T12:22:35.029876+0000","last_peered":"2024-04-25T12:22:35.029876+0000","last_clean":"2024-04-25T12:22:35.029876+0000","last_became_active":"2024-04-25T12:21:54.209393+0000","last_became_peered":"2024-04-25T12:21:54.209393+0000","last_unstale":"2024-04-25T12:22:35.029876+0000","last_undegraded":"2024-04-25T12:22:35.029876+0000","last_fullsized":"2024-04-25T12:22:35.029876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:32.318047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891441+0000","last_change":"2024-04-25T12:21:54.216255+0000","last_active":"2024-04-25T12:22:34.891441+0000","last_peered":"2024-04-25T12:22:34.891441+0000","last_clean":"2024-04-25T12:22:34.891441+0000","last_became_active":"2024-04-25T12:21:54.211787+0000","last_became_peered":"2024-04-25T12:21:54.211787+0000","last_unstale":"2024-04-25T12:22:34.891441+0000","last_undegraded":"2024-04-25T12:22:34.891441+0000","last_fullsized":"2024-04-25T12:22:34.891441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:32.351790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.886612+0000","last_change":"2024-04-25T12:21:54.200503+0000","last_active":"2024-04-25T12:22:34.886612+0000","last_peered":"2024-04-25T12:22:34.886612+0000","last_clean":"2024-04-25T12:22:34.886612+0000","last_became_active":"2024-04-25T12:21:54.200123+0000","last_became_peered":"2024-04-25T12:21:54.200123+0000","last_unstale":"2024-04-25T12:22:34.886612+0000","last_undegraded":"2024-04-25T12:22:34.886612+0000","last_fullsized":"2024-04-25T12:22:34.886612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:04.504889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.889718+0000","last_change":"2024-04-25T12:21:54.220717+0000","last_active":"2024-04-25T12:22:34.889718+0000","last_peered":"2024-04-25T12:22:34.889718+0000","last_clean":"2024-04-25T12:22:34.889718+0000","last_became_active":"2024-04-25T12:21:54.220272+0000","last_became_peered":"2024-04-25T12:21:54.220272+0000","last_unstale":"2024-04-25T12:22:34.889718+0000","last_undegraded":"2024-04-25T12:22:34.889718+0000","last_fullsized":"2024-04-25T12:22:34.889718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:51.165297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.886279+0000","last_change":"2024-04-25T12:21:54.190288+0000","last_active":"2024-04-25T12:22:34.886279+0000","last_peered":"2024-04-25T12:22:34.886279+0000","last_clean":"2024-04-25T12:22:34.886279+0000","last_became_active":"2024-04-25T12:21:54.189535+0000","last_became_peered":"2024-04-25T12:21:54.189535+0000","last_unstale":"2024-04-25T12:22:34.886279+0000","last_undegraded":"2024-04-25T12:22:34.886279+0000","last_fullsized":"2024-04-25T12:22:34.886279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:03.757883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292136+0000","last_change":"2024-04-25T12:21:54.202898+0000","last_active":"2024-04-25T12:22:35.292136+0000","last_peered":"2024-04-25T12:22:35.292136+0000","last_clean":"2024-04-25T12:22:35.292136+0000","last_became_active":"2024-04-25T12:21:54.201641+0000","last_became_peered":"2024-04-25T12:21:54.201641+0000","last_unstale":"2024-04-25T12:22:35.292136+0000","last_undegraded":"2024-04-25T12:22:35.292136+0000","last_fullsized":"2024-04-25T12:22:35.292136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:42.865496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916388+0000","last_change":"2024-04-25T12:21:54.192818+0000","last_active":"2024-04-25T12:22:34.916388+0000","last_peered":"2024-04-25T12:22:34.916388+0000","last_clean":"2024-04-25T12:22:34.916388+0000","last_became_active":"2024-04-25T12:21:54.192052+0000","last_became_peered":"2024-04-25T12:21:54.192052+0000","last_unstale":"2024-04-25T12:22:34.916388+0000","last_undegraded":"2024-04-25T12:22:34.916388+0000","last_fullsized":"2024-04-25T12:22:34.916388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:26.048483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978815+0000","last_change":"2024-04-25T12:21:54.203798+0000","last_active":"2024-04-25T12:22:34.978815+0000","last_peered":"2024-04-25T12:22:34.978815+0000","last_clean":"2024-04-25T12:22:34.978815+0000","last_became_active":"2024-04-25T12:21:54.203472+0000","last_became_peered":"2024-04-25T12:21:54.203472+0000","last_unstale":"2024-04-25T12:22:34.978815+0000","last_undegraded":"2024-04-25T12:22:34.978815+0000","last_fullsized":"2024-04-25T12:22:34.978815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:19.958172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894317+0000","last_change":"2024-04-25T12:21:54.206055+0000","last_active":"2024-04-25T12:22:34.894317+0000","last_peered":"2024-04-25T12:22:34.894317+0000","last_clean":"2024-04-25T12:22:34.894317+0000","last_became_active":"2024-04-25T12:21:54.203030+0000","last_became_peered":"2024-04-25T12:21:54.203030+0000","last_unstale":"2024-04-25T12:22:34.894317+0000","last_undegraded":"2024-04-25T12:22:34.894317+0000","last_fullsized":"2024-04-25T12:22:34.894317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:58.836301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030468+0000","last_change":"2024-04-25T12:21:54.199660+0000","last_active":"2024-04-25T12:22:35.030468+0000","last_peered":"2024-04-25T12:22:35.030468+0000","last_clean":"2024-04-25T12:22:35.030468+0000","last_became_active":"2024-04-25T12:21:54.199362+0000","last_became_peered":"2024-04-25T12:21:54.199362+0000","last_unstale":"2024-04-25T12:22:35.030468+0000","last_undegraded":"2024-04-25T12:22:35.030468+0000","last_fullsized":"2024-04-25T12:22:35.030468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:57.706566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029976+0000","last_change":"2024-04-25T12:21:54.198710+0000","last_active":"2024-04-25T12:22:35.029976+0000","last_peered":"2024-04-25T12:22:35.029976+0000","last_clean":"2024-04-25T12:22:35.029976+0000","last_became_active":"2024-04-25T12:21:54.198432+0000","last_became_peered":"2024-04-25T12:21:54.198432+0000","last_unstale":"2024-04-25T12:22:35.029976+0000","last_undegraded":"2024-04-25T12:22:35.029976+0000","last_fullsized":"2024-04-25T12:22:35.029976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:33.124005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.892012+0000","last_change":"2024-04-25T12:21:54.218474+0000","last_active":"2024-04-25T12:22:34.892012+0000","last_peered":"2024-04-25T12:22:34.892012+0000","last_clean":"2024-04-25T12:22:34.892012+0000","last_became_active":"2024-04-25T12:21:54.216949+0000","last_became_peered":"2024-04-25T12:21:54.216949+0000","last_unstale":"2024-04-25T12:22:34.892012+0000","last_undegraded":"2024-04-25T12:22:34.892012+0000","last_fullsized":"2024-04-25T12:22:34.892012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:56.162843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978395+0000","last_change":"2024-04-25T12:21:54.200590+0000","last_active":"2024-04-25T12:22:34.978395+0000","last_peered":"2024-04-25T12:22:34.978395+0000","last_clean":"2024-04-25T12:22:34.978395+0000","last_became_active":"2024-04-25T12:21:54.200248+0000","last_became_peered":"2024-04-25T12:21:54.200248+0000","last_unstale":"2024-04-25T12:22:34.978395+0000","last_undegraded":"2024-04-25T12:22:34.978395+0000","last_fullsized":"2024-04-25T12:22:34.978395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:12.875315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890043+0000","last_change":"2024-04-25T12:21:54.197805+0000","last_active":"2024-04-25T12:22:34.890043+0000","last_peered":"2024-04-25T12:22:34.890043+0000","last_clean":"2024-04-25T12:22:34.890043+0000","last_became_active":"2024-04-25T12:21:54.197028+0000","last_became_peered":"2024-04-25T12:21:54.197028+0000","last_unstale":"2024-04-25T12:22:34.890043+0000","last_undegraded":"2024-04-25T12:22:34.890043+0000","last_fullsized":"2024-04-25T12:22:34.890043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:03.069305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887087+0000","last_change":"2024-04-25T12:21:54.190517+0000","last_active":"2024-04-25T12:22:34.887087+0000","last_peered":"2024-04-25T12:22:34.887087+0000","last_clean":"2024-04-25T12:22:34.887087+0000","last_became_active":"2024-04-25T12:21:54.189711+0000","last_became_peered":"2024-04-25T12:21:54.189711+0000","last_unstale":"2024-04-25T12:22:34.887087+0000","last_undegraded":"2024-04-25T12:22:34.887087+0000","last_fullsized":"2024-04-25T12:22:34.887087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:17.879060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890320+0000","last_change":"2024-04-25T12:21:54.197205+0000","last_active":"2024-04-25T12:22:34.890320+0000","last_peered":"2024-04-25T12:22:34.890320+0000","last_clean":"2024-04-25T12:22:34.890320+0000","last_became_active":"2024-04-25T12:21:54.196933+0000","last_became_peered":"2024-04-25T12:21:54.196933+0000","last_unstale":"2024-04-25T12:22:34.890320+0000","last_undegraded":"2024-04-25T12:22:34.890320+0000","last_fullsized":"2024-04-25T12:22:34.890320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:32.003058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887450+0000","last_change":"2024-04-25T12:21:54.207709+0000","last_active":"2024-04-25T12:22:34.887450+0000","last_peered":"2024-04-25T12:22:34.887450+0000","last_clean":"2024-04-25T12:22:34.887450+0000","last_became_active":"2024-04-25T12:21:54.207027+0000","last_became_peered":"2024-04-25T12:21:54.207027+0000","last_unstale":"2024-04-25T12:22:34.887450+0000","last_undegraded":"2024-04-25T12:22:34.887450+0000","last_fullsized":"2024-04-25T12:22:34.887450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:15.116440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915838+0000","last_change":"2024-04-25T12:21:54.185338+0000","last_active":"2024-04-25T12:22:34.915838+0000","last_peered":"2024-04-25T12:22:34.915838+0000","last_clean":"2024-04-25T12:22:34.915838+0000","last_became_active":"2024-04-25T12:21:54.184502+0000","last_became_peered":"2024-04-25T12:21:54.184502+0000","last_unstale":"2024-04-25T12:22:34.915838+0000","last_undegraded":"2024-04-25T12:22:34.915838+0000","last_fullsized":"2024-04-25T12:22:34.915838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:29.865959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292679+0000","last_change":"2024-04-25T12:21:54.183773+0000","last_active":"2024-04-25T12:22:35.292679+0000","last_peered":"2024-04-25T12:22:35.292679+0000","last_clean":"2024-04-25T12:22:35.292679+0000","last_became_active":"2024-04-25T12:21:54.182924+0000","last_became_peered":"2024-04-25T12:21:54.182924+0000","last_unstale":"2024-04-25T12:22:35.292679+0000","last_undegraded":"2024-04-25T12:22:35.292679+0000","last_fullsized":"2024-04-25T12:22:35.292679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:22.046777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891694+0000","last_change":"2024-04-25T12:21:54.210631+0000","last_active":"2024-04-25T12:22:34.891694+0000","last_peered":"2024-04-25T12:22:34.891694+0000","last_clean":"2024-04-25T12:22:34.891694+0000","last_became_active":"2024-04-25T12:21:54.210333+0000","last_became_peered":"2024-04-25T12:21:54.210333+0000","last_unstale":"2024-04-25T12:22:34.891694+0000","last_undegraded":"2024-04-25T12:22:34.891694+0000","last_fullsized":"2024-04-25T12:22:34.891694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:39.783406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12028,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":24056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190,"ondisk_log_size":190,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476778,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":921600,"data_stored":712729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476779,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":125334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476778,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":124193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476777,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":121591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542186,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":125368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542187,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":121723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542186,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":121352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542186,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":913408,"data_stored":711062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:24:58.606 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:24:58.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.758+0000 7f84b8d88640 1 Processor -- start 2024-04-25T12:24:58.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.758+0000 7f84b8d88640 1 -- start start 2024-04-25T12:24:58.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.762+0000 7f84b8d88640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f84b414fbc0 0x7f84b406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:58.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.762+0000 7f84b8d88640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f84b414ffa0 0x7f84b40c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:58.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.762+0000 7f84b8d88640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84b40c5d70 con 0x7f84b4074100 2024-04-25T12:24:58.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.762+0000 7f84b8d88640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f84b40c6050 con 0x7f84b414ffa0 2024-04-25T12:24:58.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.762+0000 7f84b8d88640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f84b40c6330 con 0x7f84b414fbc0 2024-04-25T12:24:58.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.762+0000 7f84b1d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f84b414ffa0 0x7f84b40c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:58.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.762+0000 7f84b1d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f84b414ffa0 0x7f84b40c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36070/0 (socket says 172.21.15.94:36070) 2024-04-25T12:24:58.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.762+0000 7f84b1d9b640 1 -- 172.21.15.94:0/3055292859 learned_addr learned my addr 172.21.15.94:0/3055292859 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:58.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.762+0000 7f84b259c640 1 --2- 172.21.15.94:0/3055292859 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f84b414fbc0 0x7f84b406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:58.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.762+0000 7f84b1d9b640 1 -- 172.21.15.94:0/3055292859 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f84b414fbc0 msgr2=0x7f84b406f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:24:58.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.762+0000 7f84b1d9b640 1 --2- 172.21.15.94:0/3055292859 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f84b414fbc0 0x7f84b406f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.762+0000 7f84b1d9b640 1 -- 172.21.15.94:0/3055292859 >> v1:172.21.15.111:6789/0 conn(0x7f84b4074100 legacy=0x7f84b40c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:58.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.762+0000 7f84b1d9b640 1 -- 172.21.15.94:0/3055292859 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b40c6610 con 0x7f84b414ffa0 2024-04-25T12:24:58.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.762+0000 7f84b1d9b640 1 --2- 172.21.15.94:0/3055292859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84b414ffa0 0x7f84b40c8220 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f84a8009870 tx=0x7f84a801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce92bbb7cc7ccf92 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:58.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.762+0000 7f84b159a640 1 -- 172.21.15.94:0/3055292859 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a80a9640 con 0x7f84b414ffa0 2024-04-25T12:24:58.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.762+0000 7f84b159a640 1 -- 172.21.15.94:0/3055292859 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a80a97e0 con 0x7f84b414ffa0 2024-04-25T12:24:58.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.762+0000 7f84b159a640 1 -- 172.21.15.94:0/3055292859 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a80a9bb0 con 0x7f84b414ffa0 2024-04-25T12:24:58.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b8d88640 1 -- 172.21.15.94:0/3055292859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84b414ffa0 msgr2=0x7f84b40c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:58.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b8d88640 1 --2- 172.21.15.94:0/3055292859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84b414ffa0 0x7f84b40c8220 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f84a8009870 tx=0x7f84a801c560 comp rx=0 tx=0).stop 2024-04-25T12:24:58.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b8d88640 1 -- 172.21.15.94:0/3055292859 shutdown_connections 2024-04-25T12:24:58.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b8d88640 1 --2- 172.21.15.94:0/3055292859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84b414ffa0 0x7f84b40c8220 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b8d88640 1 --2- 172.21.15.94:0/3055292859 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f84b414fbc0 0x7f84b406f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b8d88640 1 -- 172.21.15.94:0/3055292859 >> 172.21.15.94:0/3055292859 conn(0x7f84b406b9d0 msgr2=0x7f84b406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:58.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b8d88640 1 -- 172.21.15.94:0/3055292859 shutdown_connections 2024-04-25T12:24:58.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b8d88640 1 -- 172.21.15.94:0/3055292859 wait complete. 2024-04-25T12:24:58.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b8d88640 1 Processor -- start 2024-04-25T12:24:58.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b8d88640 1 -- start start 2024-04-25T12:24:58.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b8d88640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84b4074100 0x7f84b4149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:58.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b8d88640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84b414fbc0 0x7f84b40cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:58.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b8d88640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f84b414ffa0 0x7f84b414b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:58.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b8d88640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f84b4166420 con 0x7f84b4074100 2024-04-25T12:24:58.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b8d88640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f84b41662a0 con 0x7f84b414fbc0 2024-04-25T12:24:58.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b8d88640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f84b41665a0 con 0x7f84b414ffa0 2024-04-25T12:24:58.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84b4074100 0x7f84b4149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:58.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84b4074100 0x7f84b4149e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36074/0 (socket says 172.21.15.94:36074) 2024-04-25T12:24:58.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b259c640 1 -- 172.21.15.94:0/245067933 learned_addr learned my addr 172.21.15.94:0/245067933 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:24:58.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b1d9b640 1 --2- 172.21.15.94:0/245067933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84b414fbc0 0x7f84b40cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:58.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b2d9d640 1 --2- 172.21.15.94:0/245067933 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f84b414ffa0 0x7f84b414b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:58.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b259c640 1 -- 172.21.15.94:0/245067933 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f84b414ffa0 msgr2=0x7f84b414b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:58.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b259c640 1 --2- 172.21.15.94:0/245067933 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f84b414ffa0 0x7f84b414b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b259c640 1 -- 172.21.15.94:0/245067933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84b414fbc0 msgr2=0x7f84b40cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:58.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b259c640 1 --2- 172.21.15.94:0/245067933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84b414fbc0 0x7f84b40cb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b259c640 1 -- 172.21.15.94:0/245067933 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b414b030 con 0x7f84b4074100 2024-04-25T12:24:58.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b259c640 1 --2- 172.21.15.94:0/245067933 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84b4074100 0x7f84b4149e70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f84a400d830 tx=0x7f84a400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:58.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84a2ffd640 1 -- 172.21.15.94:0/245067933 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a400b6c0 con 0x7f84b4074100 2024-04-25T12:24:58.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84a2ffd640 1 -- 172.21.15.94:0/245067933 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a4019070 con 0x7f84b4074100 2024-04-25T12:24:58.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b8d88640 1 -- 172.21.15.94:0/245067933 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b4143cb0 con 0x7f84b4074100 2024-04-25T12:24:58.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84a2ffd640 1 -- 172.21.15.94:0/245067933 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a400bae0 con 0x7f84b4074100 2024-04-25T12:24:58.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.766+0000 7f84b8d88640 1 -- 172.21.15.94:0/245067933 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b4141140 con 0x7f84b4074100 2024-04-25T12:24:58.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.770+0000 7f84b8d88640 1 -- 172.21.15.94:0/245067933 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84b4075df0 con 0x7f84b4074100 2024-04-25T12:24:58.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.770+0000 7f84a2ffd640 1 -- 172.21.15.94:0/245067933 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f84a401e460 con 0x7f84b4074100 2024-04-25T12:24:58.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.770+0000 7f84a2ffd640 1 --2- 172.21.15.94:0/245067933 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f84940683b0 0x7f849406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:24:58.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.770+0000 7f84a2ffd640 1 -- 172.21.15.94:0/245067933 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f84a40875a0 con 0x7f84b4074100 2024-04-25T12:24:58.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.770+0000 7f84b1d9b640 1 --2- 172.21.15.94:0/245067933 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f84940683b0 0x7f849406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:24:58.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.770+0000 7f84b1d9b640 1 --2- 172.21.15.94:0/245067933 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f84940683b0 0x7f849406a870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f84a80ae000 tx=0x7f84a80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:24:58.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.774+0000 7f84a2ffd640 1 -- 172.21.15.94:0/245067933 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f84a40576d0 con 0x7f84b4074100 2024-04-25T12:24:58.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.938+0000 7f84b8d88640 1 -- 172.21.15.94:0/245067933 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f84b40c7df0 con 0x7f84b4074100 2024-04-25T12:24:58.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.942+0000 7f84a2ffd640 1 -- 172.21.15.94:0/245067933 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18873 (secure 0 0 0) 0x7f84a4056fd0 con 0x7f84b4074100 2024-04-25T12:24:58.946 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:24:58.946 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"7059a9e2-aec4-4b84-b942-caf531e15da3","created":"2024-04-25T12:21:29.118508+0000","modified":"2024-04-25T12:22:34.871807+0000","last_up_change":"2024-04-25T12:21:40.912605+0000","last_in_change":"2024-04-25T12:21:31.372905+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:39.781011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:51.465886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:52.470540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:56.209936+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"640a65ef-0734-468a-a8f5-9ed70cf75c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6809","nonce":2553247564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6811","nonce":2553247564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6815","nonce":2553247564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6813","nonce":2553247564}]},"public_addr":"172.21.15.94:6809/2553247564","cluster_addr":"172.21.15.94:6811/2553247564","heartbeat_back_addr":"172.21.15.94:6815/2553247564","heartbeat_front_addr":"172.21.15.94:6813/2553247564","state":["exists","up"]},{"osd":1,"uuid":"d6e886e6-c8c1-4761-9a4c-abc6961c7c81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6818","nonce":2492806478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6822","nonce":2492806478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6830","nonce":2492806478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6826","nonce":2492806478}]},"public_addr":"172.21.15.94:6818/2492806478","cluster_addr":"172.21.15.94:6822/2492806478","heartbeat_back_addr":"172.21.15.94:6830/2492806478","heartbeat_front_addr":"172.21.15.94:6826/2492806478","state":["exists","up"]},{"osd":2,"uuid":"ba20f409-ed46-43b6-b16d-43dc4622c042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6801","nonce":1485061290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6803","nonce":1485061290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6807","nonce":1485061290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6805","nonce":1485061290}]},"public_addr":"172.21.15.94:6801/1485061290","cluster_addr":"172.21.15.94:6803/1485061290","heartbeat_back_addr":"172.21.15.94:6807/1485061290","heartbeat_front_addr":"172.21.15.94:6805/1485061290","state":["exists","up"]},{"osd":3,"uuid":"85816a2b-3a3f-4ec8-8373-8230d948396f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6819","nonce":1548488434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6823","nonce":1548488434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6829","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6831","nonce":1548488434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6827","nonce":1548488434}]},"public_addr":"172.21.15.94:6819/1548488434","cluster_addr":"172.21.15.94:6823/1548488434","heartbeat_back_addr":"172.21.15.94:6831/1548488434","heartbeat_front_addr":"172.21.15.94:6827/1548488434","state":["exists","up"]},{"osd":4,"uuid":"b4a953b7-01d6-4623-9324-63135fdaf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6811","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6814","nonce":4070977083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6817","nonce":4070977083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6823","nonce":4070977083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6819","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6821","nonce":4070977083}]},"public_addr":"172.21.15.111:6814/4070977083","cluster_addr":"172.21.15.111:6817/4070977083","heartbeat_back_addr":"172.21.15.111:6823/4070977083","heartbeat_front_addr":"172.21.15.111:6821/4070977083","state":["exists","up"]},{"osd":5,"uuid":"c0acc514-427d-41bf-a965-b8463cebf045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6803","nonce":1054925605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6809","nonce":1054925605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6820","nonce":1054925605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6815","nonce":1054925605}]},"public_addr":"172.21.15.111:6803/1054925605","cluster_addr":"172.21.15.111:6809/1054925605","heartbeat_back_addr":"172.21.15.111:6820/1054925605","heartbeat_front_addr":"172.21.15.111:6815/1054925605","state":["exists","up"]},{"osd":6,"uuid":"26ff742f-5a57-44a7-a095-f04d6e87f885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6825","nonce":3619235078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6827","nonce":3619235078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6831","nonce":3619235078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6829","nonce":3619235078}]},"public_addr":"172.21.15.111:6825/3619235078","cluster_addr":"172.21.15.111:6827/3619235078","heartbeat_back_addr":"172.21.15.111:6831/3619235078","heartbeat_front_addr":"172.21.15.111:6829/3619235078","state":["exists","up"]},{"osd":7,"uuid":"9c214cba-693a-4b25-aad7-05a5b0006e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6801","nonce":558758517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6805","nonce":558758517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6813","nonce":558758517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6807","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6808","nonce":558758517}]},"public_addr":"172.21.15.111:6801/558758517","cluster_addr":"172.21.15.111:6805/558758517","heartbeat_back_addr":"172.21.15.111:6813/558758517","heartbeat_front_addr":"172.21.15.111:6808/558758517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.664958+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.853375+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.654455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:37.033852+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.968691+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.856013+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.913496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.848565+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:24:58.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.942+0000 7f84b8d88640 1 -- 172.21.15.94:0/245067933 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f84940683b0 msgr2=0x7f849406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:58.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.942+0000 7f84b8d88640 1 --2- 172.21.15.94:0/245067933 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f84940683b0 0x7f849406a870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f84a80ae000 tx=0x7f84a80a7000 comp rx=0 tx=0).stop 2024-04-25T12:24:58.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.942+0000 7f84b8d88640 1 -- 172.21.15.94:0/245067933 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84b4074100 msgr2=0x7f84b4149e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:24:58.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.942+0000 7f84b8d88640 1 --2- 172.21.15.94:0/245067933 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84b4074100 0x7f84b4149e70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f84a400d830 tx=0x7f84a400dcf0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.942+0000 7f84b8d88640 1 -- 172.21.15.94:0/245067933 shutdown_connections 2024-04-25T12:24:58.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.942+0000 7f84b8d88640 1 --2- 172.21.15.94:0/245067933 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f84940683b0 0x7f849406a870 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.942+0000 7f84b8d88640 1 --2- 172.21.15.94:0/245067933 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f84b414ffa0 0x7f84b414b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.942+0000 7f84b8d88640 1 --2- 172.21.15.94:0/245067933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84b414fbc0 0x7f84b40cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.942+0000 7f84b8d88640 1 --2- 172.21.15.94:0/245067933 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84b4074100 0x7f84b4149e70 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:24:58.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.942+0000 7f84b8d88640 1 -- 172.21.15.94:0/245067933 >> 172.21.15.94:0/245067933 conn(0x7f84b406b9d0 msgr2=0x7f84b4162b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:24:58.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.942+0000 7f84b8d88640 1 -- 172.21.15.94:0/245067933 shutdown_connections 2024-04-25T12:24:58.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:24:58.942+0000 7f84b8d88640 1 -- 172.21.15.94:0/245067933 wait complete. 2024-04-25T12:24:59.966 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T12:24:59.967 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T12:25:00.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.094+0000 7f7f4bb8b640 1 Processor -- start 2024-04-25T12:25:00.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.094+0000 7f7f4bb8b640 1 -- start start 2024-04-25T12:25:00.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.098+0000 7f7f4bb8b640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f7f44151ee0 0x7f7f440722b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.098+0000 7f7f4bb8b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7f440c9ab0 0x7f7f44157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.098+0000 7f7f4bb8b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f440c8af0 con 0x7f7f440727f0 2024-04-25T12:25:00.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.098+0000 7f7f4bb8b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f7f4406d690 con 0x7f7f440c9ab0 2024-04-25T12:25:00.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.098+0000 7f7f4bb8b640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f7f4406d970 con 0x7f7f44151ee0 2024-04-25T12:25:00.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.098+0000 7f7f4a128640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f7f440727f0 0x7f7f44158210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58468/0 (socket says 172.21.15.94:58468) 2024-04-25T12:25:00.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.098+0000 7f7f4a128640 1 -- 172.21.15.94:0/2248013571 learned_addr learned my addr 172.21.15.94:0/2248013571 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:25:00.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.098+0000 7f7f49126640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7f440c9ab0 0x7f7f44157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.098+0000 7f7f49927640 1 --2- 172.21.15.94:0/2248013571 >> v2:172.21.15.111:3300/0 conn(0x7f7f44151ee0 0x7f7f440722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.098+0000 7f7f48925640 1 -- 172.21.15.94:0/2248013571 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 148107632 0 0) 0x7f7f440c8af0 con 0x7f7f440727f0 2024-04-25T12:25:00.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.098+0000 7f7f48925640 1 -- 172.21.15.94:0/2248013571 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f30005740 con 0x7f7f440727f0 2024-04-25T12:25:00.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.098+0000 7f7f49126640 1 -- 172.21.15.94:0/2248013571 >> v2:172.21.15.111:3300/0 conn(0x7f7f44151ee0 msgr2=0x7f7f440722b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:00.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.098+0000 7f7f49126640 1 --2- 172.21.15.94:0/2248013571 >> v2:172.21.15.111:3300/0 conn(0x7f7f44151ee0 0x7f7f440722b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.098+0000 7f7f49126640 1 -- 172.21.15.94:0/2248013571 >> v1:172.21.15.94:6789/0 conn(0x7f7f440727f0 legacy=0x7f7f44158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.098+0000 7f7f49126640 1 -- 172.21.15.94:0/2248013571 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4406dc50 con 0x7f7f440c9ab0 2024-04-25T12:25:00.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.098+0000 7f7f49126640 1 --2- 172.21.15.94:0/2248013571 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7f440c9ab0 0x7f7f44157cd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7f4406e580 tx=0x7f7f3401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=406670c889547c1d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:00.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.098+0000 7f7f48925640 1 -- 172.21.15.94:0/2248013571 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f340b0070 con 0x7f7f440c9ab0 2024-04-25T12:25:00.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.098+0000 7f7f48925640 1 -- 172.21.15.94:0/2248013571 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f340ab600 con 0x7f7f440c9ab0 2024-04-25T12:25:00.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.098+0000 7f7f48925640 1 -- 172.21.15.94:0/2248013571 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f340ab9b0 con 0x7f7f440c9ab0 2024-04-25T12:25:00.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f4bb8b640 1 -- 172.21.15.94:0/2248013571 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7f440c9ab0 msgr2=0x7f7f44157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f4bb8b640 1 --2- 172.21.15.94:0/2248013571 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7f440c9ab0 0x7f7f44157cd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7f4406e580 tx=0x7f7f3401c480 comp rx=0 tx=0).stop 2024-04-25T12:25:00.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f4bb8b640 1 -- 172.21.15.94:0/2248013571 shutdown_connections 2024-04-25T12:25:00.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f4bb8b640 1 --2- 172.21.15.94:0/2248013571 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7f440c9ab0 0x7f7f44157cd0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f4bb8b640 1 --2- 172.21.15.94:0/2248013571 >> v2:172.21.15.111:3300/0 conn(0x7f7f44151ee0 0x7f7f440722b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f4bb8b640 1 -- 172.21.15.94:0/2248013571 >> 172.21.15.94:0/2248013571 conn(0x7f7f440ca1b0 msgr2=0x7f7f440ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:00.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f4bb8b640 1 -- 172.21.15.94:0/2248013571 shutdown_connections 2024-04-25T12:25:00.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f4bb8b640 1 -- 172.21.15.94:0/2248013571 wait complete. 2024-04-25T12:25:00.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f4bb8b640 1 Processor -- start 2024-04-25T12:25:00.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f4bb8b640 1 -- start start 2024-04-25T12:25:00.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f4bb8b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7f440727f0 0x7f7f440c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f4bb8b640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7f440c9ab0 0x7f7f44144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f4bb8b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f44151ee0 0x7f7f44153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f4bb8b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4406c360 con 0x7f7f440727f0 2024-04-25T12:25:00.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f4bb8b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4406c1e0 con 0x7f7f44151ee0 2024-04-25T12:25:00.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f4bb8b640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f7f4406c4e0 con 0x7f7f440c9ab0 2024-04-25T12:25:00.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f49927640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7f440727f0 0x7f7f440c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f49927640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7f440727f0 0x7f7f440c6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36100/0 (socket says 172.21.15.94:36100) 2024-04-25T12:25:00.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f49927640 1 -- 172.21.15.94:0/2224337134 learned_addr learned my addr 172.21.15.94:0/2224337134 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:00.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f49126640 1 --2- 172.21.15.94:0/2224337134 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7f440c9ab0 0x7f7f44144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f4a128640 1 --2- 172.21.15.94:0/2224337134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f44151ee0 0x7f7f44153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f49927640 1 -- 172.21.15.94:0/2224337134 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7f440c9ab0 msgr2=0x7f7f44144c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f49927640 1 --2- 172.21.15.94:0/2224337134 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7f440c9ab0 0x7f7f44144c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f49927640 1 -- 172.21.15.94:0/2224337134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f44151ee0 msgr2=0x7f7f44153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f49927640 1 --2- 172.21.15.94:0/2224337134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f44151ee0 0x7f7f44153240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f49927640 1 -- 172.21.15.94:0/2224337134 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f440cc320 con 0x7f7f440727f0 2024-04-25T12:25:00.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f49927640 1 --2- 172.21.15.94:0/2224337134 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7f440727f0 0x7f7f440c6960 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c00efc0 tx=0x7f7f3c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:00.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f3a7fc640 1 -- 172.21.15.94:0/2224337134 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c018020 con 0x7f7f440727f0 2024-04-25T12:25:00.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f3a7fc640 1 -- 172.21.15.94:0/2224337134 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f3c014480 con 0x7f7f440727f0 2024-04-25T12:25:00.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f3a7fc640 1 -- 172.21.15.94:0/2224337134 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c014850 con 0x7f7f440727f0 2024-04-25T12:25:00.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f4bb8b640 1 -- 172.21.15.94:0/2224337134 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f440cc600 con 0x7f7f440727f0 2024-04-25T12:25:00.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.102+0000 7f7f4bb8b640 1 -- 172.21.15.94:0/2224337134 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f440ccbc0 con 0x7f7f440727f0 2024-04-25T12:25:00.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.106+0000 7f7f4bb8b640 1 -- 172.21.15.94:0/2224337134 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7f44075e60 con 0x7f7f440727f0 2024-04-25T12:25:00.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.106+0000 7f7f3a7fc640 1 -- 172.21.15.94:0/2224337134 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7f3c01b020 con 0x7f7f440727f0 2024-04-25T12:25:00.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.106+0000 7f7f3a7fc640 1 --2- 172.21.15.94:0/2224337134 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7f280683b0 0x7f7f2806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.106+0000 7f7f3a7fc640 1 -- 172.21.15.94:0/2224337134 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f7f3c087af0 con 0x7f7f440727f0 2024-04-25T12:25:00.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.106+0000 7f7f49126640 1 --2- 172.21.15.94:0/2224337134 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7f280683b0 0x7f7f2806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.106+0000 7f7f3a7fc640 1 --2- 172.21.15.94:0/2224337134 >> [v2:172.21.15.94:6808/2553247564,v1:172.21.15.94:6809/2553247564] conn(0x7f7f28071d40 0x7f7f280741e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.106+0000 7f7f3a7fc640 1 -- 172.21.15.94:0/2224337134 --> [v2:172.21.15.94:6808/2553247564,v1:172.21.15.94:6809/2553247564] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7f3c0020c0 con 0x7f7f28071d40 2024-04-25T12:25:00.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.106+0000 7f7f3a7fc640 1 -- 172.21.15.94:0/2224337134 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7f3c08c2c0 con 0x7f7f440727f0 2024-04-25T12:25:00.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.106+0000 7f7f4a128640 1 --2- 172.21.15.94:0/2224337134 >> [v2:172.21.15.94:6808/2553247564,v1:172.21.15.94:6809/2553247564] conn(0x7f7f28071d40 0x7f7f280741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.106+0000 7f7f49126640 1 --2- 172.21.15.94:0/2224337134 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7f280683b0 0x7f7f2806a870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7f340ad000 tx=0x7f7f34008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:00.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.106+0000 7f7f4a128640 1 --2- 172.21.15.94:0/2224337134 >> [v2:172.21.15.94:6808/2553247564,v1:172.21.15.94:6809/2553247564] conn(0x7f7f28071d40 0x7f7f280741e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:00.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.106+0000 7f7f3a7fc640 1 -- 172.21.15.94:0/2224337134 <== osd.0 v2:172.21.15.94:6808/2553247564 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7f3c0020c0 con 0x7f7f28071d40 2024-04-25T12:25:00.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.122+0000 7f7f4bb8b640 1 -- 172.21.15.94:0/2224337134 --> [v2:172.21.15.94:6808/2553247564,v1:172.21.15.94:6809/2553247564] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7f440c46d0 con 0x7f7f28071d40 2024-04-25T12:25:00.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.122+0000 7f7f3a7fc640 1 -- 172.21.15.94:0/2224337134 <== osd.0 v2:172.21.15.94:6808/2553247564 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7f440c46d0 con 0x7f7f28071d40 2024-04-25T12:25:00.126 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-25T12:25:00.126 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T12:25:00.126 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-25T12:25:00.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.122+0000 7f7f4bb8b640 1 -- 172.21.15.94:0/2224337134 >> [v2:172.21.15.94:6808/2553247564,v1:172.21.15.94:6809/2553247564] conn(0x7f7f28071d40 msgr2=0x7f7f280741e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.122+0000 7f7f4bb8b640 1 --2- 172.21.15.94:0/2224337134 >> [v2:172.21.15.94:6808/2553247564,v1:172.21.15.94:6809/2553247564] conn(0x7f7f28071d40 0x7f7f280741e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.122+0000 7f7f4bb8b640 1 -- 172.21.15.94:0/2224337134 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7f280683b0 msgr2=0x7f7f2806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.122+0000 7f7f4bb8b640 1 --2- 172.21.15.94:0/2224337134 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7f280683b0 0x7f7f2806a870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7f340ad000 tx=0x7f7f34008040 comp rx=0 tx=0).stop 2024-04-25T12:25:00.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.122+0000 7f7f4bb8b640 1 -- 172.21.15.94:0/2224337134 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7f440727f0 msgr2=0x7f7f440c6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.122+0000 7f7f4bb8b640 1 --2- 172.21.15.94:0/2224337134 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7f440727f0 0x7f7f440c6960 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c00efc0 tx=0x7f7f3c00c490 comp rx=0 tx=0).stop 2024-04-25T12:25:00.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.122+0000 7f7f4a128640 1 -- 172.21.15.94:0/2224337134 reap_dead start 2024-04-25T12:25:00.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.122+0000 7f7f4bb8b640 1 -- 172.21.15.94:0/2224337134 shutdown_connections 2024-04-25T12:25:00.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.122+0000 7f7f4bb8b640 1 -- 172.21.15.94:0/2224337134 >> 172.21.15.94:0/2224337134 conn(0x7f7f440ca1b0 msgr2=0x7f7f4414f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:00.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.122+0000 7f7f4bb8b640 1 -- 172.21.15.94:0/2224337134 shutdown_connections 2024-04-25T12:25:00.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.122+0000 7f7f4bb8b640 1 -- 172.21.15.94:0/2224337134 wait complete. 2024-04-25T12:25:00.148 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T12:25:00.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff02b51c640 1 Processor -- start 2024-04-25T12:25:00.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff02b51c640 1 -- start start 2024-04-25T12:25:00.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff02b51c640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff024151fe0 0x7ff0240c4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff02b51c640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0240725c0 con 0x7ff024158a10 2024-04-25T12:25:00.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff02b51c640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0240728a0 con 0x7ff0240720d0 2024-04-25T12:25:00.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff02b51c640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff024157f30 con 0x7ff024151fe0 2024-04-25T12:25:00.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff029ab9640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7ff024158a10 0x7ff0240ca040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58480/0 (socket says 172.21.15.94:58480) 2024-04-25T12:25:00.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff029ab9640 1 -- 172.21.15.94:0/1266666495 learned_addr learned my addr 172.21.15.94:0/1266666495 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:25:00.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff0292b8640 1 --2- 172.21.15.94:0/1266666495 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff024151fe0 0x7ff0240c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff01bfff640 1 -- 172.21.15.94:0/1266666495 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 717244748 0 0) 0x7ff0240725c0 con 0x7ff024158a10 2024-04-25T12:25:00.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff01bfff640 1 -- 172.21.15.94:0/1266666495 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff010003530 con 0x7ff024158a10 2024-04-25T12:25:00.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff01bfff640 1 -- 172.21.15.94:0/1266666495 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1317511849 0 0) 0x7ff010003530 con 0x7ff024158a10 2024-04-25T12:25:00.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff01bfff640 1 -- 172.21.15.94:0/1266666495 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff024151fe0 msgr2=0x7ff0240c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:00.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff01bfff640 1 --2- 172.21.15.94:0/1266666495 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff024151fe0 0x7ff0240c4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff01bfff640 1 -- 172.21.15.94:0/1266666495 >> v1:172.21.15.111:6789/0 conn(0x7ff0240720d0 legacy=0x7ff02415b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff01bfff640 1 -- 172.21.15.94:0/1266666495 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff024158210 con 0x7ff024158a10 2024-04-25T12:25:00.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff01bfff640 1 -- 172.21.15.94:0/1266666495 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7ff01c001a00 con 0x7ff024158a10 2024-04-25T12:25:00.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff01bfff640 1 -- 172.21.15.94:0/1266666495 >> v1:172.21.15.94:6789/0 conn(0x7ff024158a10 legacy=0x7ff0240ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff01bfff640 1 --2- 172.21.15.94:0/1266666495 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff024151fe0 0x7ff0100039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff01bfff640 1 --2- 172.21.15.94:0/1266666495 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff010003f70 0x7ff010004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff01bfff640 1 --2- 172.21.15.94:0/1266666495 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff010004d50 0x7ff0100051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff01bfff640 1 -- 172.21.15.94:0/1266666495 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff024157f30 con 0x7ff010003f70 2024-04-25T12:25:00.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff01bfff640 1 -- 172.21.15.94:0/1266666495 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff01000bab0 con 0x7ff010004d50 2024-04-25T12:25:00.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff01bfff640 1 -- 172.21.15.94:0/1266666495 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff01000dec0 con 0x7ff024151fe0 2024-04-25T12:25:00.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff028ab7640 1 --2- 172.21.15.94:0/1266666495 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff010003f70 0x7ff010004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff0292b8640 1 --2- 172.21.15.94:0/1266666495 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff024151fe0 0x7ff0100039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff029ab9640 1 --2- 172.21.15.94:0/1266666495 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff010004d50 0x7ff0100051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff028ab7640 1 -- 172.21.15.94:0/1266666495 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff024151fe0 msgr2=0x7ff0100039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:00.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff028ab7640 1 --2- 172.21.15.94:0/1266666495 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff024151fe0 0x7ff0100039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff028ab7640 1 -- 172.21.15.94:0/1266666495 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff010004d50 msgr2=0x7ff0100051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:00.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff028ab7640 1 --2- 172.21.15.94:0/1266666495 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff010004d50 0x7ff0100051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff028ab7640 1 -- 172.21.15.94:0/1266666495 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff010003530 con 0x7ff010003f70 2024-04-25T12:25:00.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.258+0000 7ff0292b8640 1 --2- 172.21.15.94:0/1266666495 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff024151fe0 0x7ff0100039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:25:00.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.262+0000 7ff028ab7640 1 --2- 172.21.15.94:0/1266666495 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff010003f70 0x7ff010004810 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff014001750 tx=0x7ff01401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a975d10f460bd659 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:00.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.262+0000 7ff01bfff640 1 -- 172.21.15.94:0/1266666495 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0140013a0 con 0x7ff010003f70 2024-04-25T12:25:00.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.262+0000 7ff01bfff640 1 -- 172.21.15.94:0/1266666495 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0140052f0 con 0x7ff010003f70 2024-04-25T12:25:00.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.262+0000 7ff01bfff640 1 -- 172.21.15.94:0/1266666495 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff014003840 con 0x7ff010003f70 2024-04-25T12:25:00.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.262+0000 7ff02b51c640 1 -- 172.21.15.94:0/1266666495 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff010003f70 msgr2=0x7ff010004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.262+0000 7ff02b51c640 1 --2- 172.21.15.94:0/1266666495 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff010003f70 0x7ff010004810 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff014001750 tx=0x7ff01401c3e0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.262+0000 7ff029ab9640 1 -- 172.21.15.94:0/1266666495 reap_dead start 2024-04-25T12:25:00.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.262+0000 7ff02b51c640 1 -- 172.21.15.94:0/1266666495 shutdown_connections 2024-04-25T12:25:00.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.262+0000 7ff02b51c640 1 -- 172.21.15.94:0/1266666495 >> 172.21.15.94:0/1266666495 conn(0x7ff02406e070 msgr2=0x7ff02406e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:00.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.262+0000 7ff02b51c640 1 -- 172.21.15.94:0/1266666495 shutdown_connections 2024-04-25T12:25:00.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.262+0000 7ff02b51c640 1 -- 172.21.15.94:0/1266666495 wait complete. 2024-04-25T12:25:00.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.262+0000 7ff02b51c640 1 Processor -- start 2024-04-25T12:25:00.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.262+0000 7ff02b51c640 1 -- start start 2024-04-25T12:25:00.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.262+0000 7ff02b51c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff010003f70 0x7ff0241f05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.262+0000 7ff02b51c640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff02415ac80 0x7ff0241ec560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.262+0000 7ff02b51c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0240c5aa0 0x7ff024146570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.262+0000 7ff02b51c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff0240ca750 con 0x7ff010003f70 2024-04-25T12:25:00.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.262+0000 7ff02b51c640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff0241523c0 con 0x7ff0240c5aa0 2024-04-25T12:25:00.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.262+0000 7ff02b51c640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff0240ca8d0 con 0x7ff02415ac80 2024-04-25T12:25:00.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.262+0000 7ff0292b8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff010003f70 0x7ff0241f05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.262+0000 7ff0292b8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff010003f70 0x7ff0241f05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36116/0 (socket says 172.21.15.94:36116) 2024-04-25T12:25:00.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.262+0000 7ff0292b8640 1 -- 172.21.15.94:0/2010115324 learned_addr learned my addr 172.21.15.94:0/2010115324 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:00.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.262+0000 7ff028ab7640 1 --2- 172.21.15.94:0/2010115324 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff02415ac80 0x7ff0241ec560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.262+0000 7ff029ab9640 1 --2- 172.21.15.94:0/2010115324 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0240c5aa0 0x7ff024146570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.266+0000 7ff0292b8640 1 -- 172.21.15.94:0/2010115324 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff02415ac80 msgr2=0x7ff0241ec560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.266+0000 7ff0292b8640 1 --2- 172.21.15.94:0/2010115324 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff02415ac80 0x7ff0241ec560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.266+0000 7ff0292b8640 1 -- 172.21.15.94:0/2010115324 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0240c5aa0 msgr2=0x7ff024146570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.266+0000 7ff0292b8640 1 --2- 172.21.15.94:0/2010115324 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0240c5aa0 0x7ff024146570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.266+0000 7ff0292b8640 1 -- 172.21.15.94:0/2010115324 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0241efb70 con 0x7ff010003f70 2024-04-25T12:25:00.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.266+0000 7ff029ab9640 1 --2- 172.21.15.94:0/2010115324 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0240c5aa0 0x7ff024146570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:25:00.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.266+0000 7ff0292b8640 1 --2- 172.21.15.94:0/2010115324 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff010003f70 0x7ff0241f05e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff020009fd0 tx=0x7ff020011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:00.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.266+0000 7ff019ffb640 1 -- 172.21.15.94:0/2010115324 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02000f9c0 con 0x7ff010003f70 2024-04-25T12:25:00.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.266+0000 7ff019ffb640 1 -- 172.21.15.94:0/2010115324 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff02000fb60 con 0x7ff010003f70 2024-04-25T12:25:00.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.266+0000 7ff02b51c640 1 -- 172.21.15.94:0/2010115324 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff02406d560 con 0x7ff010003f70 2024-04-25T12:25:00.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.266+0000 7ff019ffb640 1 -- 172.21.15.94:0/2010115324 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff020015460 con 0x7ff010003f70 2024-04-25T12:25:00.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.266+0000 7ff02b51c640 1 -- 172.21.15.94:0/2010115324 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff02406d1e0 con 0x7ff010003f70 2024-04-25T12:25:00.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.266+0000 7ff02b51c640 1 -- 172.21.15.94:0/2010115324 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff024075df0 con 0x7ff010003f70 2024-04-25T12:25:00.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.266+0000 7ff019ffb640 1 -- 172.21.15.94:0/2010115324 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff020015600 con 0x7ff010003f70 2024-04-25T12:25:00.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.266+0000 7ff019ffb640 1 --2- 172.21.15.94:0/2010115324 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff008068380 0x7ff00806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.266+0000 7ff019ffb640 1 -- 172.21.15.94:0/2010115324 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7ff020087760 con 0x7ff010003f70 2024-04-25T12:25:00.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.266+0000 7ff028ab7640 1 --2- 172.21.15.94:0/2010115324 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff008068380 0x7ff00806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.266+0000 7ff028ab7640 1 --2- 172.21.15.94:0/2010115324 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff008068380 0x7ff00806a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff0240724f0 tx=0x7ff0140011a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:00.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.270+0000 7ff019ffb640 1 -- 172.21.15.94:0/2010115324 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff020019030 con 0x7ff010003f70 2024-04-25T12:25:00.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.426+0000 7ff02b51c640 1 -- 172.21.15.94:0/2010115324 --> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7ff02414ce80 con 0x7ff008068380 2024-04-25T12:25:00.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.426+0000 7ff019ffb640 1 -- 172.21.15.94:0/2010115324 <== mgr.4101 v2:172.21.15.94:6832/549402167 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff02414ce80 con 0x7ff008068380 2024-04-25T12:25:00.433 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T12:25:00.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.430+0000 7ff02b51c640 1 -- 172.21.15.94:0/2010115324 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff008068380 msgr2=0x7ff00806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.430+0000 7ff02b51c640 1 --2- 172.21.15.94:0/2010115324 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff008068380 0x7ff00806a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff0240724f0 tx=0x7ff0140011a0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.430+0000 7ff02b51c640 1 -- 172.21.15.94:0/2010115324 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff010003f70 msgr2=0x7ff0241f05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.430+0000 7ff02b51c640 1 --2- 172.21.15.94:0/2010115324 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff010003f70 0x7ff0241f05e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff020009fd0 tx=0x7ff020011b30 comp rx=0 tx=0).stop 2024-04-25T12:25:00.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.430+0000 7ff02b51c640 1 -- 172.21.15.94:0/2010115324 shutdown_connections 2024-04-25T12:25:00.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.430+0000 7ff02b51c640 1 --2- 172.21.15.94:0/2010115324 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff008068380 0x7ff00806a840 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.430+0000 7ff02b51c640 1 --2- 172.21.15.94:0/2010115324 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff02415ac80 0x7ff0241ec560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.430+0000 7ff02b51c640 1 --2- 172.21.15.94:0/2010115324 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0240c5aa0 0x7ff024146570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.430+0000 7ff02b51c640 1 --2- 172.21.15.94:0/2010115324 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff010003f70 0x7ff0241f05e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.430+0000 7ff02b51c640 1 -- 172.21.15.94:0/2010115324 >> 172.21.15.94:0/2010115324 conn(0x7ff02406e070 msgr2=0x7ff0240c8770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:00.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.430+0000 7ff02b51c640 1 -- 172.21.15.94:0/2010115324 shutdown_connections 2024-04-25T12:25:00.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.430+0000 7ff02b51c640 1 -- 172.21.15.94:0/2010115324 wait complete. 2024-04-25T12:25:00.450 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T12:25:00.450 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T12:25:00.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.558+0000 7f268ec2f640 1 Processor -- start 2024-04-25T12:25:00.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.558+0000 7f268ec2f640 1 -- start start 2024-04-25T12:25:00.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.558+0000 7f268ec2f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2688067a30 0x7f2688164800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.558+0000 7f268ec2f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f268815d3e0 con 0x7f26880742d0 2024-04-25T12:25:00.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.558+0000 7f268ec2f640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26880b27e0 con 0x7f2688153200 2024-04-25T12:25:00.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.558+0000 7f268ec2f640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f268815ced0 con 0x7f2688067a30 2024-04-25T12:25:00.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.558+0000 7f268d1cc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2688067a30 0x7f2688164800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.558+0000 7f268d1cc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2688067a30 0x7f2688164800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36126/0 (socket says 172.21.15.94:36126) 2024-04-25T12:25:00.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.558+0000 7f268d1cc640 1 -- 172.21.15.94:0/3252050914 learned_addr learned my addr 172.21.15.94:0/3252050914 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:00.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.558+0000 7f268d1cc640 1 -- 172.21.15.94:0/3252050914 >> v1:172.21.15.111:6789/0 conn(0x7f2688153200 legacy=0x7f268806f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:00.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.562+0000 7f268d1cc640 1 -- 172.21.15.94:0/3252050914 >> v1:172.21.15.94:6789/0 conn(0x7f26880742d0 legacy=0x7f26881595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.562+0000 7f268d1cc640 1 -- 172.21.15.94:0/3252050914 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f268815d100 con 0x7f2688067a30 2024-04-25T12:25:00.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.562+0000 7f268d1cc640 1 --2- 172.21.15.94:0/3252050914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2688067a30 0x7f2688164800 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2680009e50 tx=0x7f268001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2ed5773ac9b2ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:00.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.562+0000 7f26877fe640 1 -- 172.21.15.94:0/3252050914 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26800a57d0 con 0x7f2688067a30 2024-04-25T12:25:00.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.562+0000 7f26877fe640 1 -- 172.21.15.94:0/3252050914 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26800a5970 con 0x7f2688067a30 2024-04-25T12:25:00.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.562+0000 7f26877fe640 1 -- 172.21.15.94:0/3252050914 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26800a5d40 con 0x7f2688067a30 2024-04-25T12:25:00.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.562+0000 7f268ec2f640 1 -- 172.21.15.94:0/3252050914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2688067a30 msgr2=0x7f2688164800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.562+0000 7f268ec2f640 1 --2- 172.21.15.94:0/3252050914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2688067a30 0x7f2688164800 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2680009e50 tx=0x7f268001c9f0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.562+0000 7f268ec2f640 1 -- 172.21.15.94:0/3252050914 shutdown_connections 2024-04-25T12:25:00.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.562+0000 7f268ec2f640 1 --2- 172.21.15.94:0/3252050914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2688067a30 0x7f2688164800 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.562+0000 7f268ec2f640 1 -- 172.21.15.94:0/3252050914 >> 172.21.15.94:0/3252050914 conn(0x7f26880ccf00 msgr2=0x7f26880cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:00.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.562+0000 7f268ec2f640 1 -- 172.21.15.94:0/3252050914 shutdown_connections 2024-04-25T12:25:00.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.562+0000 7f268ec2f640 1 -- 172.21.15.94:0/3252050914 wait complete. 2024-04-25T12:25:00.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.562+0000 7f268ec2f640 1 Processor -- start 2024-04-25T12:25:00.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.562+0000 7f268ec2f640 1 -- start start 2024-04-25T12:25:00.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f268ec2f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2688067a30 0x7f26881f55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f268ec2f640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f26880742d0 0x7f26880c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f268ec2f640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2688153200 0x7f2688145500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f268ec2f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f26880c7a80 con 0x7f2688067a30 2024-04-25T12:25:00.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f268ec2f640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f26880c7900 con 0x7f2688153200 2024-04-25T12:25:00.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f268ec2f640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f268806f9b0 con 0x7f26880742d0 2024-04-25T12:25:00.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f268c9cb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2688067a30 0x7f26881f55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f268c9cb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2688067a30 0x7f26881f55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36130/0 (socket says 172.21.15.94:36130) 2024-04-25T12:25:00.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f268c9cb640 1 -- 172.21.15.94:0/860725036 learned_addr learned my addr 172.21.15.94:0/860725036 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:00.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f2687fff640 1 --2- 172.21.15.94:0/860725036 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f26880742d0 0x7f26880c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f268d1cc640 1 --2- 172.21.15.94:0/860725036 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2688153200 0x7f2688145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f268c9cb640 1 -- 172.21.15.94:0/860725036 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f26880742d0 msgr2=0x7f26880c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f268c9cb640 1 --2- 172.21.15.94:0/860725036 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f26880742d0 0x7f26880c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f268c9cb640 1 -- 172.21.15.94:0/860725036 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2688153200 msgr2=0x7f2688145500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f268c9cb640 1 --2- 172.21.15.94:0/860725036 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2688153200 0x7f2688145500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f268c9cb640 1 -- 172.21.15.94:0/860725036 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2688149610 con 0x7f2688067a30 2024-04-25T12:25:00.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f268c9cb640 1 --2- 172.21.15.94:0/860725036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2688067a30 0x7f26881f55d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f267800c450 tx=0x7f267800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:00.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f26857fa640 1 -- 172.21.15.94:0/860725036 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2678012830 con 0x7f2688067a30 2024-04-25T12:25:00.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f26857fa640 1 -- 172.21.15.94:0/860725036 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2678017070 con 0x7f2688067a30 2024-04-25T12:25:00.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f268ec2f640 1 -- 172.21.15.94:0/860725036 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2688149370 con 0x7f2688067a30 2024-04-25T12:25:00.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f26857fa640 1 -- 172.21.15.94:0/860725036 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2678012c30 con 0x7f2688067a30 2024-04-25T12:25:00.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f268ec2f640 1 -- 172.21.15.94:0/860725036 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26880c5910 con 0x7f2688067a30 2024-04-25T12:25:00.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f268ec2f640 1 -- 172.21.15.94:0/860725036 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2688075e60 con 0x7f2688067a30 2024-04-25T12:25:00.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f26857fa640 1 -- 172.21.15.94:0/860725036 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f267801c460 con 0x7f2688067a30 2024-04-25T12:25:00.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f26857fa640 1 --2- 172.21.15.94:0/860725036 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2674068380 0x7f267406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f26857fa640 1 -- 172.21.15.94:0/860725036 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f2678087640 con 0x7f2688067a30 2024-04-25T12:25:00.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f2687fff640 1 --2- 172.21.15.94:0/860725036 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2674068380 0x7f267406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f26857fa640 1 --2- 172.21.15.94:0/860725036 >> [v2:172.21.15.94:6816/2492806478,v1:172.21.15.94:6818/2492806478] conn(0x7f2674071d10 0x7f26740741b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f26857fa640 1 -- 172.21.15.94:0/860725036 --> [v2:172.21.15.94:6816/2492806478,v1:172.21.15.94:6818/2492806478] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2674074880 con 0x7f2674071d10 2024-04-25T12:25:00.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f26857fa640 1 -- 172.21.15.94:0/860725036 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2678087ad0 con 0x7f2688067a30 2024-04-25T12:25:00.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f268d1cc640 1 --2- 172.21.15.94:0/860725036 >> [v2:172.21.15.94:6816/2492806478,v1:172.21.15.94:6818/2492806478] conn(0x7f2674071d10 0x7f26740741b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f2687fff640 1 --2- 172.21.15.94:0/860725036 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2674068380 0x7f267406a840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f268814f680 tx=0x7f267c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:00.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.566+0000 7f268d1cc640 1 --2- 172.21.15.94:0/860725036 >> [v2:172.21.15.94:6816/2492806478,v1:172.21.15.94:6818/2492806478] conn(0x7f2674071d10 0x7f26740741b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:00.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.570+0000 7f26857fa640 1 -- 172.21.15.94:0/860725036 <== osd.1 v2:172.21.15.94:6816/2492806478 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2674074880 con 0x7f2674071d10 2024-04-25T12:25:00.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.582+0000 7f268ec2f640 1 -- 172.21.15.94:0/860725036 --> [v2:172.21.15.94:6816/2492806478,v1:172.21.15.94:6818/2492806478] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2688072cb0 con 0x7f2674071d10 2024-04-25T12:25:00.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.582+0000 7f26857fa640 1 -- 172.21.15.94:0/860725036 <== osd.1 v2:172.21.15.94:6816/2492806478 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2688072cb0 con 0x7f2674071d10 2024-04-25T12:25:00.587 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-25T12:25:00.588 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T12:25:00.588 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-25T12:25:00.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.582+0000 7f268ec2f640 1 -- 172.21.15.94:0/860725036 >> [v2:172.21.15.94:6816/2492806478,v1:172.21.15.94:6818/2492806478] conn(0x7f2674071d10 msgr2=0x7f26740741b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.582+0000 7f268ec2f640 1 --2- 172.21.15.94:0/860725036 >> [v2:172.21.15.94:6816/2492806478,v1:172.21.15.94:6818/2492806478] conn(0x7f2674071d10 0x7f26740741b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.582+0000 7f268ec2f640 1 -- 172.21.15.94:0/860725036 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2674068380 msgr2=0x7f267406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.582+0000 7f268ec2f640 1 --2- 172.21.15.94:0/860725036 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2674068380 0x7f267406a840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f268814f680 tx=0x7f267c009040 comp rx=0 tx=0).stop 2024-04-25T12:25:00.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.582+0000 7f268ec2f640 1 -- 172.21.15.94:0/860725036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2688067a30 msgr2=0x7f26881f55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.582+0000 7f268ec2f640 1 --2- 172.21.15.94:0/860725036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2688067a30 0x7f26881f55d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f267800c450 tx=0x7f267800c910 comp rx=0 tx=0).stop 2024-04-25T12:25:00.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.582+0000 7f268d1cc640 1 -- 172.21.15.94:0/860725036 reap_dead start 2024-04-25T12:25:00.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.582+0000 7f268ec2f640 1 -- 172.21.15.94:0/860725036 shutdown_connections 2024-04-25T12:25:00.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.582+0000 7f268ec2f640 1 -- 172.21.15.94:0/860725036 >> 172.21.15.94:0/860725036 conn(0x7f26880ccf00 msgr2=0x7f268814ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:00.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.582+0000 7f268ec2f640 1 -- 172.21.15.94:0/860725036 shutdown_connections 2024-04-25T12:25:00.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.582+0000 7f268ec2f640 1 -- 172.21.15.94:0/860725036 wait complete. 2024-04-25T12:25:00.602 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T12:25:00.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb483110640 1 Processor -- start 2024-04-25T12:25:00.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb483110640 1 -- start start 2024-04-25T12:25:00.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb483110640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb47c15ee20 0x7fb47c0c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb483110640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb47c0c4e80 con 0x7fb47c06f700 2024-04-25T12:25:00.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb483110640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb47c15f320 con 0x7fb47c155300 2024-04-25T12:25:00.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb483110640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fb47c0c4230 con 0x7fb47c15ee20 2024-04-25T12:25:00.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb4816ad640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fb47c06f700 0x7fb47c0c6f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58488/0 (socket says 172.21.15.94:58488) 2024-04-25T12:25:00.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb4816ad640 1 -- 172.21.15.94:0/3160945478 learned_addr learned my addr 172.21.15.94:0/3160945478 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:25:00.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb47bfff640 1 --2- 172.21.15.94:0/3160945478 >> v2:172.21.15.111:3300/0 conn(0x7fb47c15ee20 0x7fb47c0c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb47b7fe640 1 -- 172.21.15.94:0/3160945478 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1178522201 0 0) 0x7fb47c0c4e80 con 0x7fb47c06f700 2024-04-25T12:25:00.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb47b7fe640 1 -- 172.21.15.94:0/3160945478 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb468003530 con 0x7fb47c06f700 2024-04-25T12:25:00.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb47b7fe640 1 -- 172.21.15.94:0/3160945478 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1327285980 0 0) 0x7fb468003530 con 0x7fb47c06f700 2024-04-25T12:25:00.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb47b7fe640 1 -- 172.21.15.94:0/3160945478 >> v2:172.21.15.111:3300/0 conn(0x7fb47c15ee20 msgr2=0x7fb47c0c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:00.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb47b7fe640 1 --2- 172.21.15.94:0/3160945478 >> v2:172.21.15.111:3300/0 conn(0x7fb47c15ee20 0x7fb47c0c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb47b7fe640 1 -- 172.21.15.94:0/3160945478 >> v1:172.21.15.111:6789/0 conn(0x7fb47c155300 legacy=0x7fb47c15e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb47b7fe640 1 -- 172.21.15.94:0/3160945478 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb47c0c5120 con 0x7fb47c06f700 2024-04-25T12:25:00.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb47b7fe640 1 -- 172.21.15.94:0/3160945478 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7fb474001a00 con 0x7fb47c06f700 2024-04-25T12:25:00.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb47b7fe640 1 -- 172.21.15.94:0/3160945478 >> v1:172.21.15.94:6789/0 conn(0x7fb47c06f700 legacy=0x7fb47c0c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb47b7fe640 1 --2- 172.21.15.94:0/3160945478 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb468003a10 0x7fb468003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb47b7fe640 1 --2- 172.21.15.94:0/3160945478 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb468004810 0x7fb468004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb47b7fe640 1 --2- 172.21.15.94:0/3160945478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4680051d0 0x7fb46800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb47b7fe640 1 -- 172.21.15.94:0/3160945478 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb47c0c4230 con 0x7fb4680051d0 2024-04-25T12:25:00.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb47b7fe640 1 -- 172.21.15.94:0/3160945478 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb46800c0d0 con 0x7fb468004810 2024-04-25T12:25:00.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb47b7fe640 1 -- 172.21.15.94:0/3160945478 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fb46800c2d0 con 0x7fb468003a10 2024-04-25T12:25:00.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb4816ad640 1 --2- 172.21.15.94:0/3160945478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4680051d0 0x7fb46800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb47bfff640 1 --2- 172.21.15.94:0/3160945478 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb468004810 0x7fb468004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb480eac640 1 --2- 172.21.15.94:0/3160945478 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb468003a10 0x7fb468003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb4816ad640 1 -- 172.21.15.94:0/3160945478 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb468003a10 msgr2=0x7fb468003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:00.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb4816ad640 1 --2- 172.21.15.94:0/3160945478 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb468003a10 0x7fb468003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb4816ad640 1 -- 172.21.15.94:0/3160945478 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb468004810 msgr2=0x7fb468004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:00.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb4816ad640 1 --2- 172.21.15.94:0/3160945478 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb468004810 0x7fb468004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.710+0000 7fb4816ad640 1 -- 172.21.15.94:0/3160945478 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb468003530 con 0x7fb4680051d0 2024-04-25T12:25:00.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb4816ad640 1 -- 172.21.15.94:0/3160945478 reap_dead start 2024-04-25T12:25:00.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb4816ad640 1 --2- 172.21.15.94:0/3160945478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4680051d0 0x7fb46800b9d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb47400a7b0 tx=0x7fb47401d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c8ad50d4b5f417 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:00.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb47b7fe640 1 -- 172.21.15.94:0/3160945478 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47400a3d0 con 0x7fb4680051d0 2024-04-25T12:25:00.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb47b7fe640 1 -- 172.21.15.94:0/3160945478 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4740ad650 con 0x7fb4680051d0 2024-04-25T12:25:00.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb47b7fe640 1 -- 172.21.15.94:0/3160945478 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4740ada40 con 0x7fb4680051d0 2024-04-25T12:25:00.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb483110640 1 -- 172.21.15.94:0/3160945478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4680051d0 msgr2=0x7fb46800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb483110640 1 --2- 172.21.15.94:0/3160945478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4680051d0 0x7fb46800b9d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb47400a7b0 tx=0x7fb47401d2e0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb483110640 1 -- 172.21.15.94:0/3160945478 shutdown_connections 2024-04-25T12:25:00.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb483110640 1 --2- 172.21.15.94:0/3160945478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4680051d0 0x7fb46800b9d0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb483110640 1 -- 172.21.15.94:0/3160945478 >> 172.21.15.94:0/3160945478 conn(0x7fb47c06b9d0 msgr2=0x7fb47c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:00.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb483110640 1 -- 172.21.15.94:0/3160945478 shutdown_connections 2024-04-25T12:25:00.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb483110640 1 -- 172.21.15.94:0/3160945478 wait complete. 2024-04-25T12:25:00.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb483110640 1 Processor -- start 2024-04-25T12:25:00.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb483110640 1 -- start start 2024-04-25T12:25:00.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb483110640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4680051d0 0x7fb47c1523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb483110640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb47c1f05d0 0x7fb47c152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb483110640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb47c0740b0 0x7fb47c148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb483110640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb47c0681d0 con 0x7fb4680051d0 2024-04-25T12:25:00.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb483110640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb47c0c5770 con 0x7fb47c1f05d0 2024-04-25T12:25:00.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb483110640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fb47c068350 con 0x7fb47c0740b0 2024-04-25T12:25:00.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb480eac640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4680051d0 0x7fb47c1523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb480eac640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4680051d0 0x7fb47c1523c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36150/0 (socket says 172.21.15.94:36150) 2024-04-25T12:25:00.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb480eac640 1 -- 172.21.15.94:0/644847973 learned_addr learned my addr 172.21.15.94:0/644847973 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:00.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb47bfff640 1 --2- 172.21.15.94:0/644847973 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb47c1f05d0 0x7fb47c152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb4816ad640 1 --2- 172.21.15.94:0/644847973 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb47c0740b0 0x7fb47c148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb480eac640 1 -- 172.21.15.94:0/644847973 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb47c0740b0 msgr2=0x7fb47c148210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb480eac640 1 --2- 172.21.15.94:0/644847973 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb47c0740b0 0x7fb47c148210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb480eac640 1 -- 172.21.15.94:0/644847973 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb47c1f05d0 msgr2=0x7fb47c152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb480eac640 1 --2- 172.21.15.94:0/644847973 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb47c1f05d0 0x7fb47c152900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.714+0000 7fb480eac640 1 -- 172.21.15.94:0/644847973 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb47c157530 con 0x7fb4680051d0 2024-04-25T12:25:00.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.718+0000 7fb480eac640 1 --2- 172.21.15.94:0/644847973 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4680051d0 0x7fb47c1523c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00e530 tx=0x7fb46c00e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:00.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.718+0000 7fb4797fa640 1 -- 172.21.15.94:0/644847973 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb46c0052e0 con 0x7fb4680051d0 2024-04-25T12:25:00.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.718+0000 7fb4797fa640 1 -- 172.21.15.94:0/644847973 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb46c018070 con 0x7fb4680051d0 2024-04-25T12:25:00.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.718+0000 7fb483110640 1 -- 172.21.15.94:0/644847973 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb47c157810 con 0x7fb4680051d0 2024-04-25T12:25:00.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.718+0000 7fb4797fa640 1 -- 172.21.15.94:0/644847973 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb46c003820 con 0x7fb4680051d0 2024-04-25T12:25:00.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.718+0000 7fb483110640 1 -- 172.21.15.94:0/644847973 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb47c157dd0 con 0x7fb4680051d0 2024-04-25T12:25:00.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.718+0000 7fb483110640 1 -- 172.21.15.94:0/644847973 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb47c075df0 con 0x7fb4680051d0 2024-04-25T12:25:00.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.718+0000 7fb4797fa640 1 -- 172.21.15.94:0/644847973 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb46c0039c0 con 0x7fb4680051d0 2024-04-25T12:25:00.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.718+0000 7fb4797fa640 1 --2- 172.21.15.94:0/644847973 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fb45c068380 0x7fb45c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:00.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.718+0000 7fb4797fa640 1 -- 172.21.15.94:0/644847973 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fb46c086a40 con 0x7fb4680051d0 2024-04-25T12:25:00.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.718+0000 7fb47bfff640 1 --2- 172.21.15.94:0/644847973 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fb45c068380 0x7fb45c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:00.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.718+0000 7fb47bfff640 1 --2- 172.21.15.94:0/644847973 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fb45c068380 0x7fb45c06a840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb47c1520f0 tx=0x7fb464008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:00.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.722+0000 7fb4797fa640 1 -- 172.21.15.94:0/644847973 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb46c056c10 con 0x7fb4680051d0 2024-04-25T12:25:00.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.874+0000 7fb483110640 1 -- 172.21.15.94:0/644847973 --> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fb47c06c4f0 con 0x7fb45c068380 2024-04-25T12:25:00.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.878+0000 7fb4797fa640 1 -- 172.21.15.94:0/644847973 <== mgr.4101 v2:172.21.15.94:6832/549402167 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb47c06c4f0 con 0x7fb45c068380 2024-04-25T12:25:00.882 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T12:25:00.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.878+0000 7fb483110640 1 -- 172.21.15.94:0/644847973 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fb45c068380 msgr2=0x7fb45c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.878+0000 7fb483110640 1 --2- 172.21.15.94:0/644847973 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fb45c068380 0x7fb45c06a840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb47c1520f0 tx=0x7fb464008040 comp rx=0 tx=0).stop 2024-04-25T12:25:00.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.878+0000 7fb483110640 1 -- 172.21.15.94:0/644847973 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4680051d0 msgr2=0x7fb47c1523c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:00.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.878+0000 7fb483110640 1 --2- 172.21.15.94:0/644847973 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4680051d0 0x7fb47c1523c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00e530 tx=0x7fb46c00e9f0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.878+0000 7fb483110640 1 -- 172.21.15.94:0/644847973 shutdown_connections 2024-04-25T12:25:00.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.878+0000 7fb483110640 1 --2- 172.21.15.94:0/644847973 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fb45c068380 0x7fb45c06a840 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.878+0000 7fb483110640 1 --2- 172.21.15.94:0/644847973 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb47c0740b0 0x7fb47c148210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.878+0000 7fb483110640 1 --2- 172.21.15.94:0/644847973 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb47c1f05d0 0x7fb47c152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.878+0000 7fb483110640 1 --2- 172.21.15.94:0/644847973 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4680051d0 0x7fb47c1523c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:00.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.878+0000 7fb483110640 1 -- 172.21.15.94:0/644847973 >> 172.21.15.94:0/644847973 conn(0x7fb47c06b9d0 msgr2=0x7fb47c0c8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:00.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.878+0000 7fb483110640 1 -- 172.21.15.94:0/644847973 shutdown_connections 2024-04-25T12:25:00.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:00.878+0000 7fb483110640 1 -- 172.21.15.94:0/644847973 wait complete. 2024-04-25T12:25:00.900 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T12:25:00.900 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T12:25:01.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.014+0000 7f34369d0640 1 Processor -- start 2024-04-25T12:25:01.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.014+0000 7f34369d0640 1 -- start start 2024-04-25T12:25:01.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.014+0000 7f34369d0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f34300c5fa0 0x7f343015ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.014+0000 7f34369d0640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f343015d340 0x7f3430152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.014+0000 7f34369d0640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f343006ce60 con 0x7f34300c6380 2024-04-25T12:25:01.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.014+0000 7f34369d0640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f34300c8890 con 0x7f34300c5fa0 2024-04-25T12:25:01.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.014+0000 7f34369d0640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f343015c970 con 0x7f343015d340 2024-04-25T12:25:01.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.014+0000 7f342ffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f34300c5fa0 0x7f343015ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.014+0000 7f3434f6d640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f34300c6380 0x7f343006b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58496/0 (socket says 172.21.15.94:58496) 2024-04-25T12:25:01.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.014+0000 7f3434f6d640 1 -- 172.21.15.94:0/3950541322 learned_addr learned my addr 172.21.15.94:0/3950541322 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:25:01.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.014+0000 7f342ffff640 1 -- 172.21.15.94:0/3950541322 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f343015d340 msgr2=0x7f3430152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:01.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.014+0000 7f342f7fe640 1 --2- 172.21.15.94:0/3950541322 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f343015d340 0x7f3430152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.014+0000 7f342effd640 1 -- 172.21.15.94:0/3950541322 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1817558487 0 0) 0x7f343006ce60 con 0x7f34300c6380 2024-04-25T12:25:01.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.014+0000 7f342ffff640 1 --2- 172.21.15.94:0/3950541322 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f343015d340 0x7f3430152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.014+0000 7f342ffff640 1 -- 172.21.15.94:0/3950541322 >> v1:172.21.15.94:6789/0 conn(0x7f34300c6380 legacy=0x7f343006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.014+0000 7f342ffff640 1 -- 172.21.15.94:0/3950541322 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34300c8ae0 con 0x7f34300c5fa0 2024-04-25T12:25:01.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.014+0000 7f342f7fe640 1 --2- 172.21.15.94:0/3950541322 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f343015d340 0x7f3430152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:25:01.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f342ffff640 1 --2- 172.21.15.94:0/3950541322 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34300c5fa0 0x7f343015ce00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f34240097c0 tx=0x7f342401c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421146d9f04360a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:01.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f342effd640 1 -- 172.21.15.94:0/3950541322 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34240b0070 con 0x7f34300c5fa0 2024-04-25T12:25:01.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f342effd640 1 -- 172.21.15.94:0/3950541322 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3424004230 con 0x7f34300c5fa0 2024-04-25T12:25:01.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f342effd640 1 -- 172.21.15.94:0/3950541322 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3424003620 con 0x7f34300c5fa0 2024-04-25T12:25:01.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f34369d0640 1 -- 172.21.15.94:0/3950541322 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34300c5fa0 msgr2=0x7f343015ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f34369d0640 1 --2- 172.21.15.94:0/3950541322 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34300c5fa0 0x7f343015ce00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f34240097c0 tx=0x7f342401c350 comp rx=0 tx=0).stop 2024-04-25T12:25:01.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f34369d0640 1 -- 172.21.15.94:0/3950541322 shutdown_connections 2024-04-25T12:25:01.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f34369d0640 1 --2- 172.21.15.94:0/3950541322 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f343015d340 0x7f3430152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f34369d0640 1 --2- 172.21.15.94:0/3950541322 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34300c5fa0 0x7f343015ce00 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f34369d0640 1 -- 172.21.15.94:0/3950541322 >> 172.21.15.94:0/3950541322 conn(0x7f34300c9130 msgr2=0x7f34300c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:01.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f34369d0640 1 -- 172.21.15.94:0/3950541322 shutdown_connections 2024-04-25T12:25:01.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f34369d0640 1 -- 172.21.15.94:0/3950541322 wait complete. 2024-04-25T12:25:01.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f34369d0640 1 Processor -- start 2024-04-25T12:25:01.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f34369d0640 1 -- start start 2024-04-25T12:25:01.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f34369d0640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f34300c5fa0 0x7f343014c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f34369d0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34300c6380 0x7f3430151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f34369d0640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f343015d340 0x7f3430155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f34369d0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f343006cc10 con 0x7f34300c6380 2024-04-25T12:25:01.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f34369d0640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f343006ca90 con 0x7f343015d340 2024-04-25T12:25:01.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f34369d0640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f34300c6fa0 con 0x7f34300c5fa0 2024-04-25T12:25:01.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f342f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34300c6380 0x7f3430151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f342f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34300c6380 0x7f3430151260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36164/0 (socket says 172.21.15.94:36164) 2024-04-25T12:25:01.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f342f7fe640 1 -- 172.21.15.94:0/4201770225 learned_addr learned my addr 172.21.15.94:0/4201770225 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:01.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f342f7fe640 1 -- 172.21.15.94:0/4201770225 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f34300c5fa0 msgr2=0x7f343014c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f342f7fe640 1 --2- 172.21.15.94:0/4201770225 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f34300c5fa0 0x7f343014c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f342f7fe640 1 -- 172.21.15.94:0/4201770225 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f343015d340 msgr2=0x7f3430155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f342f7fe640 1 --2- 172.21.15.94:0/4201770225 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f343015d340 0x7f3430155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f342f7fe640 1 -- 172.21.15.94:0/4201770225 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34301517a0 con 0x7f34300c6380 2024-04-25T12:25:01.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f342f7fe640 1 --2- 172.21.15.94:0/4201770225 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34300c6380 0x7f3430151260 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f342000c7f0 tx=0x7f342000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:01.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f342cff9640 1 -- 172.21.15.94:0/4201770225 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3420015070 con 0x7f34300c6380 2024-04-25T12:25:01.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f342cff9640 1 -- 172.21.15.94:0/4201770225 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3420007a30 con 0x7f34300c6380 2024-04-25T12:25:01.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f34369d0640 1 -- 172.21.15.94:0/4201770225 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3430071190 con 0x7f34300c6380 2024-04-25T12:25:01.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f342cff9640 1 -- 172.21.15.94:0/4201770225 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3420007e00 con 0x7f34300c6380 2024-04-25T12:25:01.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.018+0000 7f34369d0640 1 -- 172.21.15.94:0/4201770225 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f343014ba00 con 0x7f34300c6380 2024-04-25T12:25:01.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.022+0000 7f34369d0640 1 -- 172.21.15.94:0/4201770225 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3430149040 con 0x7f34300c6380 2024-04-25T12:25:01.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.022+0000 7f342cff9640 1 -- 172.21.15.94:0/4201770225 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3420018070 con 0x7f34300c6380 2024-04-25T12:25:01.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.022+0000 7f342cff9640 1 --2- 172.21.15.94:0/4201770225 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f341c068380 0x7f341c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.022+0000 7f342ffff640 1 --2- 172.21.15.94:0/4201770225 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f341c068380 0x7f341c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.022+0000 7f342cff9640 1 -- 172.21.15.94:0/4201770225 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f3420087280 con 0x7f34300c6380 2024-04-25T12:25:01.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.022+0000 7f342cff9640 1 --2- 172.21.15.94:0/4201770225 >> [v2:172.21.15.94:6800/1485061290,v1:172.21.15.94:6801/1485061290] conn(0x7f341c071d10 0x7f341c0741b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.022+0000 7f342cff9640 1 -- 172.21.15.94:0/4201770225 --> [v2:172.21.15.94:6800/1485061290,v1:172.21.15.94:6801/1485061290] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f341c074880 con 0x7f341c071d10 2024-04-25T12:25:01.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.022+0000 7f342cff9640 1 -- 172.21.15.94:0/4201770225 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3420087710 con 0x7f34300c6380 2024-04-25T12:25:01.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.022+0000 7f3434f6d640 1 --2- 172.21.15.94:0/4201770225 >> [v2:172.21.15.94:6800/1485061290,v1:172.21.15.94:6801/1485061290] conn(0x7f341c071d10 0x7f341c0741b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.022+0000 7f342ffff640 1 --2- 172.21.15.94:0/4201770225 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f341c068380 0x7f341c06a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f34240ad000 tx=0x7f3424004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:01.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.022+0000 7f3434f6d640 1 --2- 172.21.15.94:0/4201770225 >> [v2:172.21.15.94:6800/1485061290,v1:172.21.15.94:6801/1485061290] conn(0x7f341c071d10 0x7f341c0741b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:01.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.022+0000 7f342cff9640 1 -- 172.21.15.94:0/4201770225 <== osd.2 v2:172.21.15.94:6800/1485061290 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f341c074880 con 0x7f341c071d10 2024-04-25T12:25:01.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.034+0000 7f34369d0640 1 -- 172.21.15.94:0/4201770225 --> [v2:172.21.15.94:6800/1485061290,v1:172.21.15.94:6801/1485061290] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3430075e60 con 0x7f341c071d10 2024-04-25T12:25:01.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.034+0000 7f342cff9640 1 -- 172.21.15.94:0/4201770225 <== osd.2 v2:172.21.15.94:6800/1485061290 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3430075e60 con 0x7f341c071d10 2024-04-25T12:25:01.042 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-25T12:25:01.042 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T12:25:01.042 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-25T12:25:01.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.038+0000 7f34369d0640 1 -- 172.21.15.94:0/4201770225 >> [v2:172.21.15.94:6800/1485061290,v1:172.21.15.94:6801/1485061290] conn(0x7f341c071d10 msgr2=0x7f341c0741b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.038+0000 7f34369d0640 1 --2- 172.21.15.94:0/4201770225 >> [v2:172.21.15.94:6800/1485061290,v1:172.21.15.94:6801/1485061290] conn(0x7f341c071d10 0x7f341c0741b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.038+0000 7f34369d0640 1 -- 172.21.15.94:0/4201770225 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f341c068380 msgr2=0x7f341c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.038+0000 7f34369d0640 1 --2- 172.21.15.94:0/4201770225 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f341c068380 0x7f341c06a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f34240ad000 tx=0x7f3424004740 comp rx=0 tx=0).stop 2024-04-25T12:25:01.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.038+0000 7f34369d0640 1 -- 172.21.15.94:0/4201770225 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34300c6380 msgr2=0x7f3430151260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.038+0000 7f34369d0640 1 --2- 172.21.15.94:0/4201770225 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34300c6380 0x7f3430151260 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f342000c7f0 tx=0x7f342000ccb0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.038+0000 7f3434f6d640 1 -- 172.21.15.94:0/4201770225 reap_dead start 2024-04-25T12:25:01.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.038+0000 7f34369d0640 1 -- 172.21.15.94:0/4201770225 shutdown_connections 2024-04-25T12:25:01.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.038+0000 7f34369d0640 1 -- 172.21.15.94:0/4201770225 >> 172.21.15.94:0/4201770225 conn(0x7f34300c9130 msgr2=0x7f3430159220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:01.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.038+0000 7f34369d0640 1 -- 172.21.15.94:0/4201770225 shutdown_connections 2024-04-25T12:25:01.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.038+0000 7f34369d0640 1 -- 172.21.15.94:0/4201770225 wait complete. 2024-04-25T12:25:01.057 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T12:25:01.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.154+0000 7f54329c7640 1 Processor -- start 2024-04-25T12:25:01.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.154+0000 7f54329c7640 1 -- start start 2024-04-25T12:25:01.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.158+0000 7f54329c7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f542c074100 0x7f542c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.158+0000 7f54329c7640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f542c0c5d70 con 0x7f542c14ffa0 2024-04-25T12:25:01.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.158+0000 7f54329c7640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f542c0c6050 con 0x7f542c14fbc0 2024-04-25T12:25:01.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.158+0000 7f54329c7640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f542c0c6330 con 0x7f542c074100 2024-04-25T12:25:01.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.158+0000 7f5430f64640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f542c074100 0x7f542c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.158+0000 7f542b7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f542c14ffa0 0x7f542c0c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58508/0 (socket says 172.21.15.94:58508) 2024-04-25T12:25:01.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.158+0000 7f542b7fe640 1 -- 172.21.15.94:0/2204766382 learned_addr learned my addr 172.21.15.94:0/2204766382 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:25:01.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.158+0000 7f5430f64640 1 -- 172.21.15.94:0/2204766382 >> v1:172.21.15.111:6789/0 conn(0x7f542c14fbc0 legacy=0x7f542c0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:01.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.158+0000 7f5430f64640 1 -- 172.21.15.94:0/2204766382 >> v1:172.21.15.94:6789/0 conn(0x7f542c14ffa0 legacy=0x7f542c0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.158+0000 7f5430f64640 1 -- 172.21.15.94:0/2204766382 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f542c0c6610 con 0x7f542c074100 2024-04-25T12:25:01.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.158+0000 7f5430f64640 1 --2- 172.21.15.94:0/2204766382 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f542c074100 0x7f542c06f700 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f54240097f0 tx=0x7f542401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476fbb6c5335c117 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:01.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.158+0000 7f542affd640 1 -- 172.21.15.94:0/2204766382 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54240ab680 con 0x7f542c074100 2024-04-25T12:25:01.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.158+0000 7f542affd640 1 -- 172.21.15.94:0/2204766382 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54240b0070 con 0x7f542c074100 2024-04-25T12:25:01.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.158+0000 7f542affd640 1 -- 172.21.15.94:0/2204766382 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54240aba40 con 0x7f542c074100 2024-04-25T12:25:01.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.158+0000 7f54329c7640 1 -- 172.21.15.94:0/2204766382 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f542c074100 msgr2=0x7f542c06f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.158+0000 7f54329c7640 1 --2- 172.21.15.94:0/2204766382 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f542c074100 0x7f542c06f700 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f54240097f0 tx=0x7f542401c460 comp rx=0 tx=0).stop 2024-04-25T12:25:01.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.158+0000 7f54329c7640 1 -- 172.21.15.94:0/2204766382 shutdown_connections 2024-04-25T12:25:01.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.158+0000 7f54329c7640 1 --2- 172.21.15.94:0/2204766382 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f542c074100 0x7f542c06f700 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.158+0000 7f54329c7640 1 -- 172.21.15.94:0/2204766382 >> 172.21.15.94:0/2204766382 conn(0x7f542c06b9d0 msgr2=0x7f542c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:01.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.162+0000 7f54329c7640 1 -- 172.21.15.94:0/2204766382 shutdown_connections 2024-04-25T12:25:01.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.162+0000 7f54329c7640 1 -- 172.21.15.94:0/2204766382 wait complete. 2024-04-25T12:25:01.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.162+0000 7f54329c7640 1 Processor -- start 2024-04-25T12:25:01.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.162+0000 7f54329c7640 1 -- start start 2024-04-25T12:25:01.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.162+0000 7f54329c7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f542c074100 0x7f542c144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.162+0000 7f54329c7640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f542c14fbc0 0x7f542c150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.162+0000 7f54329c7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f542c14ffa0 0x7f542c150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.162+0000 7f54329c7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f542c167630 con 0x7f542c14ffa0 2024-04-25T12:25:01.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.162+0000 7f54329c7640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f542c1674b0 con 0x7f542c074100 2024-04-25T12:25:01.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.162+0000 7f54329c7640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f542c1677b0 con 0x7f542c14fbc0 2024-04-25T12:25:01.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.162+0000 7f5430f64640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f542c14ffa0 0x7f542c150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.162+0000 7f5430f64640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f542c14ffa0 0x7f542c150ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36172/0 (socket says 172.21.15.94:36172) 2024-04-25T12:25:01.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.162+0000 7f5430f64640 1 -- 172.21.15.94:0/266780097 learned_addr learned my addr 172.21.15.94:0/266780097 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:01.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.162+0000 7f5430f64640 1 -- 172.21.15.94:0/266780097 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f542c14fbc0 msgr2=0x7f542c150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.162+0000 7f5430f64640 1 --2- 172.21.15.94:0/266780097 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f542c14fbc0 0x7f542c150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.162+0000 7f5430f64640 1 -- 172.21.15.94:0/266780097 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f542c074100 msgr2=0x7f542c144ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.162+0000 7f5430f64640 1 --2- 172.21.15.94:0/266780097 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f542c074100 0x7f542c144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.162+0000 7f5430f64640 1 -- 172.21.15.94:0/266780097 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f542c152b50 con 0x7f542c14ffa0 2024-04-25T12:25:01.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.162+0000 7f5430f64640 1 --2- 172.21.15.94:0/266780097 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f542c14ffa0 0x7f542c150ca0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f54240ad040 tx=0x7f542401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:01.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.162+0000 7f5428ff9640 1 -- 172.21.15.94:0/266780097 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54240bf610 con 0x7f542c14ffa0 2024-04-25T12:25:01.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.162+0000 7f5428ff9640 1 -- 172.21.15.94:0/266780097 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54240a7070 con 0x7f542c14ffa0 2024-04-25T12:25:01.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.162+0000 7f5428ff9640 1 -- 172.21.15.94:0/266780097 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54240bf9d0 con 0x7f542c14ffa0 2024-04-25T12:25:01.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.162+0000 7f54329c7640 1 -- 172.21.15.94:0/266780097 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f542c152e30 con 0x7f542c14ffa0 2024-04-25T12:25:01.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.162+0000 7f54329c7640 1 -- 172.21.15.94:0/266780097 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f542c1533f0 con 0x7f542c14ffa0 2024-04-25T12:25:01.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.162+0000 7f54329c7640 1 -- 172.21.15.94:0/266780097 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f542c075df0 con 0x7f542c14ffa0 2024-04-25T12:25:01.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.166+0000 7f5428ff9640 1 -- 172.21.15.94:0/266780097 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f54240bd020 con 0x7f542c14ffa0 2024-04-25T12:25:01.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.166+0000 7f5428ff9640 1 --2- 172.21.15.94:0/266780097 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5418068380 0x7f541806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.166+0000 7f5428ff9640 1 -- 172.21.15.94:0/266780097 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f5424121710 con 0x7f542c14ffa0 2024-04-25T12:25:01.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.166+0000 7f542bfff640 1 --2- 172.21.15.94:0/266780097 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5418068380 0x7f541806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.166+0000 7f542bfff640 1 --2- 172.21.15.94:0/266780097 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5418068380 0x7f541806a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f541c003cf0 tx=0x7f541c0079c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:01.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.170+0000 7f5428ff9640 1 -- 172.21.15.94:0/266780097 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5424016050 con 0x7f542c14ffa0 2024-04-25T12:25:01.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.318+0000 7f54329c7640 1 -- 172.21.15.94:0/266780097 --> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f542c149c50 con 0x7f5418068380 2024-04-25T12:25:01.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.318+0000 7f5428ff9640 1 -- 172.21.15.94:0/266780097 <== mgr.4101 v2:172.21.15.94:6832/549402167 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f542c149c50 con 0x7f5418068380 2024-04-25T12:25:01.323 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T12:25:01.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.318+0000 7f54329c7640 1 -- 172.21.15.94:0/266780097 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5418068380 msgr2=0x7f541806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.318+0000 7f54329c7640 1 --2- 172.21.15.94:0/266780097 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5418068380 0x7f541806a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f541c003cf0 tx=0x7f541c0079c0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.318+0000 7f54329c7640 1 -- 172.21.15.94:0/266780097 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f542c14ffa0 msgr2=0x7f542c150ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.318+0000 7f54329c7640 1 --2- 172.21.15.94:0/266780097 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f542c14ffa0 0x7f542c150ca0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f54240ad040 tx=0x7f542401aca0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.318+0000 7f54329c7640 1 -- 172.21.15.94:0/266780097 shutdown_connections 2024-04-25T12:25:01.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.318+0000 7f54329c7640 1 --2- 172.21.15.94:0/266780097 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5418068380 0x7f541806a840 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.318+0000 7f54329c7640 1 --2- 172.21.15.94:0/266780097 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f542c14fbc0 0x7f542c150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.318+0000 7f54329c7640 1 --2- 172.21.15.94:0/266780097 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f542c14ffa0 0x7f542c150ca0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.318+0000 7f54329c7640 1 --2- 172.21.15.94:0/266780097 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f542c074100 0x7f542c144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.318+0000 7f54329c7640 1 -- 172.21.15.94:0/266780097 >> 172.21.15.94:0/266780097 conn(0x7f542c06b9d0 msgr2=0x7f542c071030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:01.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.318+0000 7f54329c7640 1 -- 172.21.15.94:0/266780097 shutdown_connections 2024-04-25T12:25:01.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.318+0000 7f54329c7640 1 -- 172.21.15.94:0/266780097 wait complete. 2024-04-25T12:25:01.340 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T12:25:01.341 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T12:25:01.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f3661ffc640 1 Processor -- start 2024-04-25T12:25:01.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f3661ffc640 1 -- start start 2024-04-25T12:25:01.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f3661ffc640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f365c0c5fa0 0x7f365c15ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f3661ffc640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f365c0c6380 0x7f365c163990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f3661ffc640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f365c06ce60 con 0x7f365c15d340 2024-04-25T12:25:01.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f3661ffc640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f365c0c8890 con 0x7f365c0c6380 2024-04-25T12:25:01.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f3661ffc640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f365c15c970 con 0x7f365c0c5fa0 2024-04-25T12:25:01.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365affd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f365c15d340 0x7f365c152cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58510/0 (socket says 172.21.15.94:58510) 2024-04-25T12:25:01.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365affd640 1 -- 172.21.15.94:0/223454632 learned_addr learned my addr 172.21.15.94:0/223454632 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:25:01.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365b7fe640 1 --2- 172.21.15.94:0/223454632 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f365c0c5fa0 0x7f365c15ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365bfff640 1 --2- 172.21.15.94:0/223454632 >> v2:172.21.15.111:3300/0 conn(0x7f365c0c6380 0x7f365c163990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365a7fc640 1 -- 172.21.15.94:0/223454632 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 79945137 0 0) 0x7f365c06ce60 con 0x7f365c15d340 2024-04-25T12:25:01.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365a7fc640 1 -- 172.21.15.94:0/223454632 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3644003530 con 0x7f365c15d340 2024-04-25T12:25:01.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365a7fc640 1 -- 172.21.15.94:0/223454632 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1108520411 0 0) 0x7f3644003530 con 0x7f365c15d340 2024-04-25T12:25:01.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365a7fc640 1 -- 172.21.15.94:0/223454632 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f365c0c5fa0 msgr2=0x7f365c15ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:01.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365a7fc640 1 --2- 172.21.15.94:0/223454632 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f365c0c5fa0 0x7f365c15ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365a7fc640 1 -- 172.21.15.94:0/223454632 >> v2:172.21.15.111:3300/0 conn(0x7f365c0c6380 msgr2=0x7f365c163990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:01.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365a7fc640 1 --2- 172.21.15.94:0/223454632 >> v2:172.21.15.111:3300/0 conn(0x7f365c0c6380 0x7f365c163990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365a7fc640 1 -- 172.21.15.94:0/223454632 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365c0c8ae0 con 0x7f365c15d340 2024-04-25T12:25:01.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365a7fc640 1 -- 172.21.15.94:0/223454632 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7f3650001680 con 0x7f365c15d340 2024-04-25T12:25:01.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365a7fc640 1 -- 172.21.15.94:0/223454632 >> v1:172.21.15.94:6789/0 conn(0x7f365c15d340 legacy=0x7f365c152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365a7fc640 1 --2- 172.21.15.94:0/223454632 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f365c0c5fa0 0x7f36440039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365a7fc640 1 --2- 172.21.15.94:0/223454632 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3644003f40 0x7f3644004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365a7fc640 1 --2- 172.21.15.94:0/223454632 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36440043c0 0x7f3644004d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365a7fc640 1 -- 172.21.15.94:0/223454632 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f365c0c8890 con 0x7f36440043c0 2024-04-25T12:25:01.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365a7fc640 1 -- 172.21.15.94:0/223454632 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f365c15c970 con 0x7f3644003f40 2024-04-25T12:25:01.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365a7fc640 1 -- 172.21.15.94:0/223454632 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f3644005520 con 0x7f365c0c5fa0 2024-04-25T12:25:01.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365bfff640 1 --2- 172.21.15.94:0/223454632 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36440043c0 0x7f3644004d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365affd640 1 --2- 172.21.15.94:0/223454632 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3644003f40 0x7f3644004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365b7fe640 1 --2- 172.21.15.94:0/223454632 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f365c0c5fa0 0x7f36440039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365bfff640 1 -- 172.21.15.94:0/223454632 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f365c0c5fa0 msgr2=0x7f36440039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:01.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365bfff640 1 --2- 172.21.15.94:0/223454632 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f365c0c5fa0 0x7f36440039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365bfff640 1 -- 172.21.15.94:0/223454632 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3644003f40 msgr2=0x7f3644004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:01.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365bfff640 1 --2- 172.21.15.94:0/223454632 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3644003f40 0x7f3644004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.458+0000 7f365bfff640 1 -- 172.21.15.94:0/223454632 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3644003530 con 0x7f36440043c0 2024-04-25T12:25:01.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.462+0000 7f365bfff640 1 --2- 172.21.15.94:0/223454632 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36440043c0 0x7f3644004d50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3654009ab0 tx=0x7f365401ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185d8fe3ebad9e8d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:01.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.462+0000 7f365a7fc640 1 -- 172.21.15.94:0/223454632 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36540b2070 con 0x7f36440043c0 2024-04-25T12:25:01.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.462+0000 7f365a7fc640 1 -- 172.21.15.94:0/223454632 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36540a5630 con 0x7f36440043c0 2024-04-25T12:25:01.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.462+0000 7f365a7fc640 1 -- 172.21.15.94:0/223454632 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36540096b0 con 0x7f36440043c0 2024-04-25T12:25:01.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.462+0000 7f3661ffc640 1 -- 172.21.15.94:0/223454632 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36440043c0 msgr2=0x7f3644004d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.462+0000 7f3661ffc640 1 --2- 172.21.15.94:0/223454632 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36440043c0 0x7f3644004d50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3654009ab0 tx=0x7f365401ca60 comp rx=0 tx=0).stop 2024-04-25T12:25:01.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.462+0000 7f365bfff640 1 -- 172.21.15.94:0/223454632 reap_dead start 2024-04-25T12:25:01.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.462+0000 7f3661ffc640 1 -- 172.21.15.94:0/223454632 shutdown_connections 2024-04-25T12:25:01.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.462+0000 7f3661ffc640 1 -- 172.21.15.94:0/223454632 >> 172.21.15.94:0/223454632 conn(0x7f365c0c9130 msgr2=0x7f365c0c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:01.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.462+0000 7f3661ffc640 1 -- 172.21.15.94:0/223454632 shutdown_connections 2024-04-25T12:25:01.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.462+0000 7f3661ffc640 1 -- 172.21.15.94:0/223454632 wait complete. 2024-04-25T12:25:01.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.462+0000 7f3661ffc640 1 Processor -- start 2024-04-25T12:25:01.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.462+0000 7f3661ffc640 1 -- start start 2024-04-25T12:25:01.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f3661ffc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f365c0c4b40 0x7f365c0c0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f3661ffc640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f365c0c4f20 0x7f365c1efbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f3661ffc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f365c0720e0 0x7f365c1f0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f3661ffc640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f365c06cc10 con 0x7f365c0720e0 2024-04-25T12:25:01.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f3661ffc640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f365c06ca90 con 0x7f365c0c4b40 2024-04-25T12:25:01.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f3661ffc640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f365c0c6fa0 con 0x7f365c0c4f20 2024-04-25T12:25:01.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f365bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f365c0720e0 0x7f365c1f0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f365bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f365c0720e0 0x7f365c1f0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36184/0 (socket says 172.21.15.94:36184) 2024-04-25T12:25:01.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f365bfff640 1 -- 172.21.15.94:0/1973742186 learned_addr learned my addr 172.21.15.94:0/1973742186 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:01.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f365b7fe640 1 --2- 172.21.15.94:0/1973742186 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f365c0c4b40 0x7f365c0c0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f365affd640 1 --2- 172.21.15.94:0/1973742186 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f365c0c4f20 0x7f365c1efbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f365bfff640 1 -- 172.21.15.94:0/1973742186 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f365c0c4f20 msgr2=0x7f365c1efbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f365bfff640 1 --2- 172.21.15.94:0/1973742186 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f365c0c4f20 0x7f365c1efbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f365bfff640 1 -- 172.21.15.94:0/1973742186 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f365c0c4b40 msgr2=0x7f365c0c0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f365bfff640 1 --2- 172.21.15.94:0/1973742186 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f365c0c4b40 0x7f365c0c0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f365bfff640 1 -- 172.21.15.94:0/1973742186 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365c071b20 con 0x7f365c0720e0 2024-04-25T12:25:01.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f365bfff640 1 --2- 172.21.15.94:0/1973742186 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f365c0720e0 0x7f365c1f0120 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3654009ab0 tx=0x7f3644005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:01.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f3643fff640 1 -- 172.21.15.94:0/1973742186 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36540b2040 con 0x7f365c0720e0 2024-04-25T12:25:01.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f3643fff640 1 -- 172.21.15.94:0/1973742186 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36540bb070 con 0x7f365c0720e0 2024-04-25T12:25:01.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f3661ffc640 1 -- 172.21.15.94:0/1973742186 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f365c0710b0 con 0x7f365c0720e0 2024-04-25T12:25:01.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f3643fff640 1 -- 172.21.15.94:0/1973742186 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36540096b0 con 0x7f365c0720e0 2024-04-25T12:25:01.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f3661ffc640 1 -- 172.21.15.94:0/1973742186 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f365c071e00 con 0x7f365c0720e0 2024-04-25T12:25:01.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f3661ffc640 1 -- 172.21.15.94:0/1973742186 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f365c075e60 con 0x7f365c0720e0 2024-04-25T12:25:01.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f3643fff640 1 -- 172.21.15.94:0/1973742186 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f36540ad440 con 0x7f365c0720e0 2024-04-25T12:25:01.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f3643fff640 1 --2- 172.21.15.94:0/1973742186 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f36480683b0 0x7f364806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f3643fff640 1 -- 172.21.15.94:0/1973742186 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f36541203c0 con 0x7f365c0720e0 2024-04-25T12:25:01.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f365b7fe640 1 --2- 172.21.15.94:0/1973742186 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f36480683b0 0x7f364806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f3643fff640 1 --2- 172.21.15.94:0/1973742186 >> [v2:172.21.15.94:6817/1548488434,v1:172.21.15.94:6819/1548488434] conn(0x7f3648071d40 0x7f36480741e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f3643fff640 1 -- 172.21.15.94:0/1973742186 --> [v2:172.21.15.94:6817/1548488434,v1:172.21.15.94:6819/1548488434] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f36540afe90 con 0x7f3648071d40 2024-04-25T12:25:01.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f3643fff640 1 -- 172.21.15.94:0/1973742186 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3654127050 con 0x7f365c0720e0 2024-04-25T12:25:01.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f365affd640 1 --2- 172.21.15.94:0/1973742186 >> [v2:172.21.15.94:6817/1548488434,v1:172.21.15.94:6819/1548488434] conn(0x7f3648071d40 0x7f36480741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.466+0000 7f365b7fe640 1 --2- 172.21.15.94:0/1973742186 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f36480683b0 0x7f364806a870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f364c007520 tx=0x7f364c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:01.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.470+0000 7f365affd640 1 --2- 172.21.15.94:0/1973742186 >> [v2:172.21.15.94:6817/1548488434,v1:172.21.15.94:6819/1548488434] conn(0x7f3648071d40 0x7f36480741e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:01.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.470+0000 7f3643fff640 1 -- 172.21.15.94:0/1973742186 <== osd.3 v2:172.21.15.94:6817/1548488434 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f36540afe90 con 0x7f3648071d40 2024-04-25T12:25:01.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.482+0000 7f3661ffc640 1 -- 172.21.15.94:0/1973742186 --> [v2:172.21.15.94:6817/1548488434,v1:172.21.15.94:6819/1548488434] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f365c0715d0 con 0x7f3648071d40 2024-04-25T12:25:01.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.482+0000 7f3643fff640 1 -- 172.21.15.94:0/1973742186 <== osd.3 v2:172.21.15.94:6817/1548488434 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f365c0715d0 con 0x7f3648071d40 2024-04-25T12:25:01.488 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-25T12:25:01.488 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T12:25:01.488 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-25T12:25:01.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.482+0000 7f3661ffc640 1 -- 172.21.15.94:0/1973742186 >> [v2:172.21.15.94:6817/1548488434,v1:172.21.15.94:6819/1548488434] conn(0x7f3648071d40 msgr2=0x7f36480741e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.482+0000 7f3661ffc640 1 --2- 172.21.15.94:0/1973742186 >> [v2:172.21.15.94:6817/1548488434,v1:172.21.15.94:6819/1548488434] conn(0x7f3648071d40 0x7f36480741e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.482+0000 7f3661ffc640 1 -- 172.21.15.94:0/1973742186 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f36480683b0 msgr2=0x7f364806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.482+0000 7f3661ffc640 1 --2- 172.21.15.94:0/1973742186 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f36480683b0 0x7f364806a870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f364c007520 tx=0x7f364c00b040 comp rx=0 tx=0).stop 2024-04-25T12:25:01.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.482+0000 7f3661ffc640 1 -- 172.21.15.94:0/1973742186 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f365c0720e0 msgr2=0x7f365c1f0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.482+0000 7f3661ffc640 1 --2- 172.21.15.94:0/1973742186 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f365c0720e0 0x7f365c1f0120 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3654009ab0 tx=0x7f3644005840 comp rx=0 tx=0).stop 2024-04-25T12:25:01.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.482+0000 7f365bfff640 1 -- 172.21.15.94:0/1973742186 reap_dead start 2024-04-25T12:25:01.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.482+0000 7f3661ffc640 1 -- 172.21.15.94:0/1973742186 shutdown_connections 2024-04-25T12:25:01.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.482+0000 7f3661ffc640 1 -- 172.21.15.94:0/1973742186 >> 172.21.15.94:0/1973742186 conn(0x7f365c0c9130 msgr2=0x7f365c0c6790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:01.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.482+0000 7f3661ffc640 1 -- 172.21.15.94:0/1973742186 shutdown_connections 2024-04-25T12:25:01.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.482+0000 7f3661ffc640 1 -- 172.21.15.94:0/1973742186 wait complete. 2024-04-25T12:25:01.504 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T12:25:01.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.602+0000 7effbc599640 1 Processor -- start 2024-04-25T12:25:01.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.602+0000 7effbc599640 1 -- start start 2024-04-25T12:25:01.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.602+0000 7effbc599640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effb414fbc0 0x7effb406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.602+0000 7effbc599640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7effb4074100 0x7effb40c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.602+0000 7effbc599640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb40c5d70 con 0x7effb414ffa0 2024-04-25T12:25:01.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.602+0000 7effbc599640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7effb40c6050 con 0x7effb4074100 2024-04-25T12:25:01.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.602+0000 7effbc599640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7effb40c6330 con 0x7effb414fbc0 2024-04-25T12:25:01.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.602+0000 7effb9b34640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7effb414ffa0 0x7effb40c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58514/0 (socket says 172.21.15.94:58514) 2024-04-25T12:25:01.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.602+0000 7effb9b34640 1 -- 172.21.15.94:0/3255398414 learned_addr learned my addr 172.21.15.94:0/3255398414 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:25:01.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.602+0000 7effbab36640 1 --2- 172.21.15.94:0/3255398414 >> v2:172.21.15.94:3300/0 conn(0x7effb4074100 0x7effb40c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.602+0000 7effba335640 1 --2- 172.21.15.94:0/3255398414 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effb414fbc0 0x7effb406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.602+0000 7effb9333640 1 -- 172.21.15.94:0/3255398414 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 871168677 0 0) 0x7effb40c5d70 con 0x7effb414ffa0 2024-04-25T12:25:01.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.602+0000 7effb9333640 1 -- 172.21.15.94:0/3255398414 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effa0003530 con 0x7effb414ffa0 2024-04-25T12:25:01.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.602+0000 7effbab36640 1 -- 172.21.15.94:0/3255398414 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effb414fbc0 msgr2=0x7effb406f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:01.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.602+0000 7effbab36640 1 --2- 172.21.15.94:0/3255398414 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effb414fbc0 0x7effb406f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.602+0000 7effbab36640 1 -- 172.21.15.94:0/3255398414 >> v1:172.21.15.94:6789/0 conn(0x7effb414ffa0 legacy=0x7effb40c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.602+0000 7effbab36640 1 -- 172.21.15.94:0/3255398414 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb40c6610 con 0x7effb4074100 2024-04-25T12:25:01.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.602+0000 7effba335640 1 --2- 172.21.15.94:0/3255398414 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effb414fbc0 0x7effb406f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:25:01.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.602+0000 7effbab36640 1 --2- 172.21.15.94:0/3255398414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effb4074100 0x7effb40c7250 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7effac009d90 tx=0x7effac01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582ed9a576ebfb64 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:01.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.602+0000 7effb9333640 1 -- 172.21.15.94:0/3255398414 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac0b2070 con 0x7effb4074100 2024-04-25T12:25:01.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effb9333640 1 -- 172.21.15.94:0/3255398414 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effac0a5a50 con 0x7effb4074100 2024-04-25T12:25:01.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effb9333640 1 -- 172.21.15.94:0/3255398414 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac0a5e20 con 0x7effb4074100 2024-04-25T12:25:01.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effbc599640 1 -- 172.21.15.94:0/3255398414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effb4074100 msgr2=0x7effb40c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effbc599640 1 --2- 172.21.15.94:0/3255398414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effb4074100 0x7effb40c7250 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7effac009d90 tx=0x7effac01c970 comp rx=0 tx=0).stop 2024-04-25T12:25:01.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effbc599640 1 -- 172.21.15.94:0/3255398414 shutdown_connections 2024-04-25T12:25:01.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effbc599640 1 --2- 172.21.15.94:0/3255398414 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effb4074100 0x7effb40c7250 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effbc599640 1 --2- 172.21.15.94:0/3255398414 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effb414fbc0 0x7effb406f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effbc599640 1 -- 172.21.15.94:0/3255398414 >> 172.21.15.94:0/3255398414 conn(0x7effb406b9d0 msgr2=0x7effb406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:01.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effbc599640 1 -- 172.21.15.94:0/3255398414 shutdown_connections 2024-04-25T12:25:01.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effbc599640 1 -- 172.21.15.94:0/3255398414 wait complete. 2024-04-25T12:25:01.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effbc599640 1 Processor -- start 2024-04-25T12:25:01.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effbc599640 1 -- start start 2024-04-25T12:25:01.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effbc599640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effb4074100 0x7effb415ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effbc599640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effb414fbc0 0x7effb41489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effbc599640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effb414ffa0 0x7effb4147030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effbc599640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7effb40c8ab0 con 0x7effb4074100 2024-04-25T12:25:01.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effbc599640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7effb40c8930 con 0x7effb414ffa0 2024-04-25T12:25:01.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effbc599640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7effb4166090 con 0x7effb414fbc0 2024-04-25T12:25:01.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effba335640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effb4074100 0x7effb415ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effba335640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effb4074100 0x7effb415ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:36212/0 (socket says 172.21.15.94:36212) 2024-04-25T12:25:01.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effba335640 1 -- 172.21.15.94:0/1943892882 learned_addr learned my addr 172.21.15.94:0/1943892882 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:01.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effba335640 1 -- 172.21.15.94:0/1943892882 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effb414fbc0 msgr2=0x7effb41489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effba335640 1 --2- 172.21.15.94:0/1943892882 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effb414fbc0 0x7effb41489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effba335640 1 -- 172.21.15.94:0/1943892882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effb414ffa0 msgr2=0x7effb4147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effba335640 1 --2- 172.21.15.94:0/1943892882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effb414ffa0 0x7effb4147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effba335640 1 -- 172.21.15.94:0/1943892882 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb4147900 con 0x7effb4074100 2024-04-25T12:25:01.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effba335640 1 --2- 172.21.15.94:0/1943892882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effb4074100 0x7effb415ca00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7effb000c7c0 tx=0x7effb000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:01.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effaaffd640 1 -- 172.21.15.94:0/1943892882 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb0007a30 con 0x7effb4074100 2024-04-25T12:25:01.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effaaffd640 1 -- 172.21.15.94:0/1943892882 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effb0007bd0 con 0x7effb4074100 2024-04-25T12:25:01.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effbc599640 1 -- 172.21.15.94:0/1943892882 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb4147be0 con 0x7effb4074100 2024-04-25T12:25:01.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effaaffd640 1 -- 172.21.15.94:0/1943892882 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb00113f0 con 0x7effb4074100 2024-04-25T12:25:01.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.606+0000 7effbc599640 1 -- 172.21.15.94:0/1943892882 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb41481a0 con 0x7effb4074100 2024-04-25T12:25:01.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.610+0000 7effbc599640 1 -- 172.21.15.94:0/1943892882 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb4075df0 con 0x7effb4074100 2024-04-25T12:25:01.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.610+0000 7effaaffd640 1 -- 172.21.15.94:0/1943892882 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7effb0011590 con 0x7effb4074100 2024-04-25T12:25:01.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.610+0000 7effaaffd640 1 --2- 172.21.15.94:0/1943892882 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7eff98068380 0x7eff9806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.610+0000 7effaaffd640 1 -- 172.21.15.94:0/1943892882 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7effb0086fe0 con 0x7effb4074100 2024-04-25T12:25:01.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.610+0000 7effb9b34640 1 --2- 172.21.15.94:0/1943892882 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7eff98068380 0x7eff9806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.610+0000 7effb9b34640 1 --2- 172.21.15.94:0/1943892882 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7eff98068380 0x7eff9806a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7effa4007fd0 tx=0x7effa4007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:01.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.614+0000 7effaaffd640 1 -- 172.21.15.94:0/1943892882 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7effb0015020 con 0x7effb4074100 2024-04-25T12:25:01.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.770+0000 7effbc599640 1 -- 172.21.15.94:0/1943892882 --> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7effb4143810 con 0x7eff98068380 2024-04-25T12:25:01.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.770+0000 7effaaffd640 1 -- 172.21.15.94:0/1943892882 <== mgr.4101 v2:172.21.15.94:6832/549402167 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7effb4143810 con 0x7eff98068380 2024-04-25T12:25:01.777 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T12:25:01.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.774+0000 7effbc599640 1 -- 172.21.15.94:0/1943892882 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7eff98068380 msgr2=0x7eff9806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.774+0000 7effbc599640 1 --2- 172.21.15.94:0/1943892882 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7eff98068380 0x7eff9806a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7effa4007fd0 tx=0x7effa4007900 comp rx=0 tx=0).stop 2024-04-25T12:25:01.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.774+0000 7effbc599640 1 -- 172.21.15.94:0/1943892882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effb4074100 msgr2=0x7effb415ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.774+0000 7effbc599640 1 --2- 172.21.15.94:0/1943892882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effb4074100 0x7effb415ca00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7effb000c7c0 tx=0x7effb000cc80 comp rx=0 tx=0).stop 2024-04-25T12:25:01.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.774+0000 7effbc599640 1 -- 172.21.15.94:0/1943892882 shutdown_connections 2024-04-25T12:25:01.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.774+0000 7effbc599640 1 --2- 172.21.15.94:0/1943892882 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7eff98068380 0x7eff9806a840 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.774+0000 7effbc599640 1 --2- 172.21.15.94:0/1943892882 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effb414fbc0 0x7effb41489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.774+0000 7effbc599640 1 --2- 172.21.15.94:0/1943892882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effb414ffa0 0x7effb4147030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.774+0000 7effbc599640 1 --2- 172.21.15.94:0/1943892882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7effb4074100 0x7effb415ca00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.774+0000 7effbc599640 1 -- 172.21.15.94:0/1943892882 >> 172.21.15.94:0/1943892882 conn(0x7effb406b9d0 msgr2=0x7effb40cb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:01.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.774+0000 7effbc599640 1 -- 172.21.15.94:0/1943892882 shutdown_connections 2024-04-25T12:25:01.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.774+0000 7effbc599640 1 -- 172.21.15.94:0/1943892882 wait complete. 2024-04-25T12:25:01.795 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T12:25:01.795 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T12:25:01.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.910+0000 7f209b074640 1 Processor -- start 2024-04-25T12:25:01.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.910+0000 7f209b074640 1 -- start start 2024-04-25T12:25:01.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.914+0000 7f209b074640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2094151db0 0x7f209406c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.914+0000 7f209b074640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f20940c35e0 0x7f209406c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.914+0000 7f209b074640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2094158540 con 0x7f20941519d0 2024-04-25T12:25:01.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.914+0000 7f209b074640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f20940c7a00 con 0x7f2094151db0 2024-04-25T12:25:01.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.914+0000 7f209b074640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f20940c70d0 con 0x7f20940c35e0 2024-04-25T12:25:01.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.914+0000 7f2098e10640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f20941519d0 0x7f20940c1470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:44892/0 (socket says 172.21.15.94:44892) 2024-04-25T12:25:01.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.914+0000 7f2098e10640 1 -- 172.21.15.94:0/3531531136 learned_addr learned my addr 172.21.15.94:0/3531531136 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:25:01.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.914+0000 7f2093fff640 1 --2- 172.21.15.94:0/3531531136 >> v2:172.21.15.94:3300/0 conn(0x7f2094151db0 0x7f209406c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.914+0000 7f20937fe640 1 -- 172.21.15.94:0/3531531136 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1838690814 0 0) 0x7f2094158540 con 0x7f20941519d0 2024-04-25T12:25:01.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.914+0000 7f2099611640 1 --2- 172.21.15.94:0/3531531136 >> v2:172.21.15.111:3300/0 conn(0x7f20940c35e0 0x7f209406c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.914+0000 7f20937fe640 1 -- 172.21.15.94:0/3531531136 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2084003530 con 0x7f20941519d0 2024-04-25T12:25:01.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.914+0000 7f2093fff640 1 -- 172.21.15.94:0/3531531136 >> v2:172.21.15.111:3300/0 conn(0x7f20940c35e0 msgr2=0x7f209406c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:01.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.914+0000 7f2093fff640 1 --2- 172.21.15.94:0/3531531136 >> v2:172.21.15.111:3300/0 conn(0x7f20940c35e0 0x7f209406c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.914+0000 7f2093fff640 1 -- 172.21.15.94:0/3531531136 >> v1:172.21.15.94:6789/0 conn(0x7f20941519d0 legacy=0x7f20940c1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.914+0000 7f2093fff640 1 -- 172.21.15.94:0/3531531136 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20940c73b0 con 0x7f2094151db0 2024-04-25T12:25:01.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.914+0000 7f2099611640 1 --2- 172.21.15.94:0/3531531136 >> v2:172.21.15.111:3300/0 conn(0x7f20940c35e0 0x7f209406c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:25:01.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.914+0000 7f2093fff640 1 --2- 172.21.15.94:0/3531531136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2094151db0 0x7f209406c260 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f20940c1390 tx=0x7f208001e280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc536b912043344 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:01.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.914+0000 7f20937fe640 1 -- 172.21.15.94:0/3531531136 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20800b3070 con 0x7f2094151db0 2024-04-25T12:25:01.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.914+0000 7f20937fe640 1 -- 172.21.15.94:0/3531531136 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20800a6890 con 0x7f2094151db0 2024-04-25T12:25:01.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.914+0000 7f20937fe640 1 -- 172.21.15.94:0/3531531136 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208000b040 con 0x7f2094151db0 2024-04-25T12:25:01.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.914+0000 7f209b074640 1 -- 172.21.15.94:0/3531531136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2094151db0 msgr2=0x7f209406c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.914+0000 7f209b074640 1 --2- 172.21.15.94:0/3531531136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2094151db0 0x7f209406c260 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f20940c1390 tx=0x7f208001e280 comp rx=0 tx=0).stop 2024-04-25T12:25:01.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.914+0000 7f209b074640 1 -- 172.21.15.94:0/3531531136 shutdown_connections 2024-04-25T12:25:01.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.914+0000 7f209b074640 1 --2- 172.21.15.94:0/3531531136 >> v2:172.21.15.111:3300/0 conn(0x7f20940c35e0 0x7f209406c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.914+0000 7f209b074640 1 --2- 172.21.15.94:0/3531531136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2094151db0 0x7f209406c260 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.914+0000 7f209b074640 1 -- 172.21.15.94:0/3531531136 >> 172.21.15.94:0/3531531136 conn(0x7f20940c9130 msgr2=0x7f20940c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:01.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f209b074640 1 -- 172.21.15.94:0/3531531136 shutdown_connections 2024-04-25T12:25:01.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f209b074640 1 -- 172.21.15.94:0/3531531136 wait complete. 2024-04-25T12:25:01.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f209b074640 1 Processor -- start 2024-04-25T12:25:01.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f209b074640 1 -- start start 2024-04-25T12:25:01.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f209b074640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20940c35e0 0x7f209414b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f209b074640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f20941519d0 0x7f209406c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f209b074640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2094151db0 0x7f209414c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f209b074640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f20941579a0 con 0x7f2094151db0 2024-04-25T12:25:01.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f209b074640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2094157820 con 0x7f20940c35e0 2024-04-25T12:25:01.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f209b074640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2094157b20 con 0x7f20941519d0 2024-04-25T12:25:01.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f2099611640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2094151db0 0x7f209414c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f2099611640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2094151db0 0x7f209414c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52598/0 (socket says 172.21.15.94:52598) 2024-04-25T12:25:01.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f2099611640 1 -- 172.21.15.94:0/1127411473 learned_addr learned my addr 172.21.15.94:0/1127411473 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:01.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f2093fff640 1 --2- 172.21.15.94:0/1127411473 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f20941519d0 0x7f209406c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f2098e10640 1 --2- 172.21.15.94:0/1127411473 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20940c35e0 0x7f209414b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f2099611640 1 -- 172.21.15.94:0/1127411473 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f20941519d0 msgr2=0x7f209406c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f2099611640 1 --2- 172.21.15.94:0/1127411473 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f20941519d0 0x7f209406c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f2099611640 1 -- 172.21.15.94:0/1127411473 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20940c35e0 msgr2=0x7f209414b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f2099611640 1 --2- 172.21.15.94:0/1127411473 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20940c35e0 0x7f209414b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f2099611640 1 -- 172.21.15.94:0/1127411473 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209414c270 con 0x7f2094151db0 2024-04-25T12:25:01.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f2093fff640 1 --2- 172.21.15.94:0/1127411473 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f20941519d0 0x7f209406c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:25:01.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f2099611640 1 --2- 172.21.15.94:0/1127411473 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2094151db0 0x7f209414c7b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f208c00cef0 tx=0x7f208c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:01.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f20917fa640 1 -- 172.21.15.94:0/1127411473 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c01a070 con 0x7f2094151db0 2024-04-25T12:25:01.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f20917fa640 1 -- 172.21.15.94:0/1127411473 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f208c00d860 con 0x7f2094151db0 2024-04-25T12:25:01.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f209b074640 1 -- 172.21.15.94:0/1127411473 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f209414c550 con 0x7f2094151db0 2024-04-25T12:25:01.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f20917fa640 1 -- 172.21.15.94:0/1127411473 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c00dc50 con 0x7f2094151db0 2024-04-25T12:25:01.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f209b074640 1 -- 172.21.15.94:0/1127411473 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20940719f0 con 0x7f2094151db0 2024-04-25T12:25:01.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f209b074640 1 -- 172.21.15.94:0/1127411473 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2094075e60 con 0x7f2094151db0 2024-04-25T12:25:01.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.918+0000 7f20917fa640 1 -- 172.21.15.94:0/1127411473 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f208c01d070 con 0x7f2094151db0 2024-04-25T12:25:01.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.922+0000 7f20917fa640 1 --2- 172.21.15.94:0/1127411473 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f20780683b0 0x7f207806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.922+0000 7f20917fa640 1 -- 172.21.15.94:0/1127411473 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f208c087730 con 0x7f2094151db0 2024-04-25T12:25:01.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.922+0000 7f2098e10640 1 --2- 172.21.15.94:0/1127411473 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f20780683b0 0x7f207806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.922+0000 7f20917fa640 1 --2- 172.21.15.94:0/1127411473 >> [v2:172.21.15.111:6811/4070977083,v1:172.21.15.111:6814/4070977083] conn(0x7f2078071d40 0x7f20780741e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:01.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.922+0000 7f20917fa640 1 -- 172.21.15.94:0/1127411473 --> [v2:172.21.15.111:6811/4070977083,v1:172.21.15.111:6814/4070977083] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f20780748b0 con 0x7f2078071d40 2024-04-25T12:25:01.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.922+0000 7f20917fa640 1 -- 172.21.15.94:0/1127411473 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f208c08e050 con 0x7f2094151db0 2024-04-25T12:25:01.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.922+0000 7f2098e10640 1 --2- 172.21.15.94:0/1127411473 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f20780683b0 0x7f207806a870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2088007fd0 tx=0x7f2088009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:01.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.922+0000 7f2093fff640 1 --2- 172.21.15.94:0/1127411473 >> [v2:172.21.15.111:6811/4070977083,v1:172.21.15.111:6814/4070977083] conn(0x7f2078071d40 0x7f20780741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:01.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.922+0000 7f2093fff640 1 --2- 172.21.15.94:0/1127411473 >> [v2:172.21.15.111:6811/4070977083,v1:172.21.15.111:6814/4070977083] conn(0x7f2078071d40 0x7f20780741e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:01.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.922+0000 7f20917fa640 1 -- 172.21.15.94:0/1127411473 <== osd.4 v2:172.21.15.111:6811/4070977083 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f20780748b0 con 0x7f2078071d40 2024-04-25T12:25:01.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.938+0000 7f209b074640 1 -- 172.21.15.94:0/1127411473 --> [v2:172.21.15.111:6811/4070977083,v1:172.21.15.111:6814/4070977083] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f20940c8cc0 con 0x7f2078071d40 2024-04-25T12:25:01.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.938+0000 7f20917fa640 1 -- 172.21.15.94:0/1127411473 <== osd.4 v2:172.21.15.111:6811/4070977083 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f20940c8cc0 con 0x7f2078071d40 2024-04-25T12:25:01.942 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-25T12:25:01.942 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T12:25:01.943 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-25T12:25:01.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.938+0000 7f209b074640 1 -- 172.21.15.94:0/1127411473 >> [v2:172.21.15.111:6811/4070977083,v1:172.21.15.111:6814/4070977083] conn(0x7f2078071d40 msgr2=0x7f20780741e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.938+0000 7f209b074640 1 --2- 172.21.15.94:0/1127411473 >> [v2:172.21.15.111:6811/4070977083,v1:172.21.15.111:6814/4070977083] conn(0x7f2078071d40 0x7f20780741e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:01.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.938+0000 7f209b074640 1 -- 172.21.15.94:0/1127411473 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f20780683b0 msgr2=0x7f207806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.938+0000 7f209b074640 1 --2- 172.21.15.94:0/1127411473 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f20780683b0 0x7f207806a870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2088007fd0 tx=0x7f2088009040 comp rx=0 tx=0).stop 2024-04-25T12:25:01.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.938+0000 7f209b074640 1 -- 172.21.15.94:0/1127411473 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2094151db0 msgr2=0x7f209414c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:01.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.938+0000 7f209b074640 1 --2- 172.21.15.94:0/1127411473 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2094151db0 0x7f209414c7b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f208c00cef0 tx=0x7f208c00a710 comp rx=0 tx=0).stop 2024-04-25T12:25:01.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.938+0000 7f2099611640 1 -- 172.21.15.94:0/1127411473 reap_dead start 2024-04-25T12:25:01.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.938+0000 7f209b074640 1 -- 172.21.15.94:0/1127411473 shutdown_connections 2024-04-25T12:25:01.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.938+0000 7f209b074640 1 -- 172.21.15.94:0/1127411473 >> 172.21.15.94:0/1127411473 conn(0x7f20940c9130 msgr2=0x7f2094155930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:01.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.938+0000 7f209b074640 1 -- 172.21.15.94:0/1127411473 shutdown_connections 2024-04-25T12:25:01.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:01.938+0000 7f209b074640 1 -- 172.21.15.94:0/1127411473 wait complete. 2024-04-25T12:25:01.958 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T12:25:02.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.062+0000 7f39bfdaf640 1 Processor -- start 2024-04-25T12:25:02.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.066+0000 7f39bfdaf640 1 -- start start 2024-04-25T12:25:02.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.066+0000 7f39bfdaf640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f39b814ffa0 0x7f39b806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.066+0000 7f39bfdaf640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f39b8074100 0x7f39b80c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.066+0000 7f39bfdaf640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39b80c5d70 con 0x7f39b814fbc0 2024-04-25T12:25:02.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.066+0000 7f39bfdaf640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f39b80c6050 con 0x7f39b8074100 2024-04-25T12:25:02.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.066+0000 7f39bfdaf640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f39b80c6330 con 0x7f39b814ffa0 2024-04-25T12:25:02.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.066+0000 7f39be34c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f39b8074100 0x7f39b80c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.066+0000 7f39bdb4b640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f39b814fbc0 0x7f39b80c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:44898/0 (socket says 172.21.15.94:44898) 2024-04-25T12:25:02.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.066+0000 7f39bdb4b640 1 -- 172.21.15.94:0/1277069504 learned_addr learned my addr 172.21.15.94:0/1277069504 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:25:02.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.066+0000 7f39bd34a640 1 --2- 172.21.15.94:0/1277069504 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f39b814ffa0 0x7f39b806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.066+0000 7f39be34c640 1 -- 172.21.15.94:0/1277069504 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f39b814ffa0 msgr2=0x7f39b806f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:02.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.066+0000 7f39be34c640 1 --2- 172.21.15.94:0/1277069504 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f39b814ffa0 0x7f39b806f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.066+0000 7f39be34c640 1 -- 172.21.15.94:0/1277069504 >> v1:172.21.15.94:6789/0 conn(0x7f39b814fbc0 legacy=0x7f39b80c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.066+0000 7f39be34c640 1 -- 172.21.15.94:0/1277069504 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b80c6610 con 0x7f39b8074100 2024-04-25T12:25:02.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.066+0000 7f39bcb49640 1 -- 172.21.15.94:0/1277069504 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1092360543 0 0) 0x7f39b80c5d70 con 0x7f39b814fbc0 2024-04-25T12:25:02.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.070+0000 7f39be34c640 1 --2- 172.21.15.94:0/1277069504 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39b8074100 0x7f39b80c7250 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f39b0009d90 tx=0x7f39b001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e933917f4c5fcd0d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:02.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.070+0000 7f39bcb49640 1 -- 172.21.15.94:0/1277069504 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b00b2070 con 0x7f39b8074100 2024-04-25T12:25:02.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.070+0000 7f39bcb49640 1 -- 172.21.15.94:0/1277069504 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b00a5a50 con 0x7f39b8074100 2024-04-25T12:25:02.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.070+0000 7f39bcb49640 1 -- 172.21.15.94:0/1277069504 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b00a5e20 con 0x7f39b8074100 2024-04-25T12:25:02.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.070+0000 7f39bfdaf640 1 -- 172.21.15.94:0/1277069504 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39b8074100 msgr2=0x7f39b80c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.070+0000 7f39bfdaf640 1 --2- 172.21.15.94:0/1277069504 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39b8074100 0x7f39b80c7250 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f39b0009d90 tx=0x7f39b001c970 comp rx=0 tx=0).stop 2024-04-25T12:25:02.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.070+0000 7f39bfdaf640 1 -- 172.21.15.94:0/1277069504 shutdown_connections 2024-04-25T12:25:02.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.070+0000 7f39bfdaf640 1 --2- 172.21.15.94:0/1277069504 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39b8074100 0x7f39b80c7250 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.070+0000 7f39bfdaf640 1 --2- 172.21.15.94:0/1277069504 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f39b814ffa0 0x7f39b806f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.070+0000 7f39bfdaf640 1 -- 172.21.15.94:0/1277069504 >> 172.21.15.94:0/1277069504 conn(0x7f39b806b9d0 msgr2=0x7f39b806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:02.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.070+0000 7f39bfdaf640 1 -- 172.21.15.94:0/1277069504 shutdown_connections 2024-04-25T12:25:02.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.070+0000 7f39bfdaf640 1 -- 172.21.15.94:0/1277069504 wait complete. 2024-04-25T12:25:02.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.070+0000 7f39bfdaf640 1 Processor -- start 2024-04-25T12:25:02.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.070+0000 7f39bfdaf640 1 -- start start 2024-04-25T12:25:02.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.070+0000 7f39bfdaf640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39b8074100 0x7f39b81f1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.070+0000 7f39bfdaf640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39b814fbc0 0x7f39b81eaf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.070+0000 7f39bfdaf640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f39b814ffa0 0x7f39b80cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.070+0000 7f39bfdaf640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f39b80c8ab0 con 0x7f39b8074100 2024-04-25T12:25:02.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.070+0000 7f39bfdaf640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f39b80c8930 con 0x7f39b814fbc0 2024-04-25T12:25:02.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.070+0000 7f39bfdaf640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f39b8166090 con 0x7f39b814ffa0 2024-04-25T12:25:02.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.070+0000 7f39bdb4b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39b8074100 0x7f39b81f1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.070+0000 7f39bdb4b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39b8074100 0x7f39b81f1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52620/0 (socket says 172.21.15.94:52620) 2024-04-25T12:25:02.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.070+0000 7f39bdb4b640 1 -- 172.21.15.94:0/1125626392 learned_addr learned my addr 172.21.15.94:0/1125626392 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:02.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.070+0000 7f39bd34a640 1 --2- 172.21.15.94:0/1125626392 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39b814fbc0 0x7f39b81eaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.070+0000 7f39be34c640 1 --2- 172.21.15.94:0/1125626392 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f39b814ffa0 0x7f39b80cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.074+0000 7f39bdb4b640 1 -- 172.21.15.94:0/1125626392 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f39b814ffa0 msgr2=0x7f39b80cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.074+0000 7f39bdb4b640 1 --2- 172.21.15.94:0/1125626392 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f39b814ffa0 0x7f39b80cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.074+0000 7f39bdb4b640 1 -- 172.21.15.94:0/1125626392 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39b814fbc0 msgr2=0x7f39b81eaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.074+0000 7f39bdb4b640 1 --2- 172.21.15.94:0/1125626392 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39b814fbc0 0x7f39b81eaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.074+0000 7f39bdb4b640 1 -- 172.21.15.94:0/1125626392 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b81eb460 con 0x7f39b8074100 2024-04-25T12:25:02.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.074+0000 7f39be34c640 1 --2- 172.21.15.94:0/1125626392 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f39b814ffa0 0x7f39b80cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:25:02.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.074+0000 7f39bdb4b640 1 --2- 172.21.15.94:0/1125626392 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39b8074100 0x7f39b81f1840 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f39b40011f0 tx=0x7f39b400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:02.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.074+0000 7f39ae7fc640 1 -- 172.21.15.94:0/1125626392 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b4018070 con 0x7f39b8074100 2024-04-25T12:25:02.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.074+0000 7f39ae7fc640 1 -- 172.21.15.94:0/1125626392 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b40074e0 con 0x7f39b8074100 2024-04-25T12:25:02.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.074+0000 7f39bfdaf640 1 -- 172.21.15.94:0/1125626392 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39b81ebf90 con 0x7f39b8074100 2024-04-25T12:25:02.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.074+0000 7f39ae7fc640 1 -- 172.21.15.94:0/1125626392 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b4004a10 con 0x7f39b8074100 2024-04-25T12:25:02.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.074+0000 7f39bfdaf640 1 -- 172.21.15.94:0/1125626392 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39b81eb9d0 con 0x7f39b8074100 2024-04-25T12:25:02.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.074+0000 7f39bfdaf640 1 -- 172.21.15.94:0/1125626392 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39b8075df0 con 0x7f39b8074100 2024-04-25T12:25:02.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.074+0000 7f39ae7fc640 1 -- 172.21.15.94:0/1125626392 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f39b401b070 con 0x7f39b8074100 2024-04-25T12:25:02.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.074+0000 7f39ae7fc640 1 --2- 172.21.15.94:0/1125626392 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f399c068380 0x7f399c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.074+0000 7f39ae7fc640 1 -- 172.21.15.94:0/1125626392 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f39b40861c0 con 0x7f39b8074100 2024-04-25T12:25:02.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.074+0000 7f39bd34a640 1 --2- 172.21.15.94:0/1125626392 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f399c068380 0x7f399c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.074+0000 7f39bd34a640 1 --2- 172.21.15.94:0/1125626392 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f399c068380 0x7f399c06a840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f39b81536d0 tx=0x7f39a8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:02.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.078+0000 7f39ae7fc640 1 -- 172.21.15.94:0/1125626392 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f39b4056300 con 0x7f39b8074100 2024-04-25T12:25:02.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.230+0000 7f39bfdaf640 1 -- 172.21.15.94:0/1125626392 --> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f39b81f27e0 con 0x7f399c068380 2024-04-25T12:25:02.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.230+0000 7f39ae7fc640 1 -- 172.21.15.94:0/1125626392 <== mgr.4101 v2:172.21.15.94:6832/549402167 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f39a800f830 con 0x7f399c068380 2024-04-25T12:25:02.234 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T12:25:02.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.230+0000 7f39bfdaf640 1 -- 172.21.15.94:0/1125626392 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f399c068380 msgr2=0x7f399c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.230+0000 7f39bfdaf640 1 --2- 172.21.15.94:0/1125626392 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f399c068380 0x7f399c06a840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f39b81536d0 tx=0x7f39a8008040 comp rx=0 tx=0).stop 2024-04-25T12:25:02.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.230+0000 7f39bfdaf640 1 -- 172.21.15.94:0/1125626392 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39b8074100 msgr2=0x7f39b81f1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.230+0000 7f39bfdaf640 1 --2- 172.21.15.94:0/1125626392 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39b8074100 0x7f39b81f1840 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f39b40011f0 tx=0x7f39b400c9b0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.230+0000 7f39bfdaf640 1 -- 172.21.15.94:0/1125626392 shutdown_connections 2024-04-25T12:25:02.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.230+0000 7f39bfdaf640 1 --2- 172.21.15.94:0/1125626392 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f399c068380 0x7f399c06a840 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.230+0000 7f39bfdaf640 1 --2- 172.21.15.94:0/1125626392 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f39b814ffa0 0x7f39b80cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.230+0000 7f39bfdaf640 1 --2- 172.21.15.94:0/1125626392 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39b814fbc0 0x7f39b81eaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.230+0000 7f39bfdaf640 1 --2- 172.21.15.94:0/1125626392 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39b8074100 0x7f39b81f1840 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.230+0000 7f39bfdaf640 1 -- 172.21.15.94:0/1125626392 >> 172.21.15.94:0/1125626392 conn(0x7f39b806b9d0 msgr2=0x7f39b80cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:02.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.230+0000 7f39bfdaf640 1 -- 172.21.15.94:0/1125626392 shutdown_connections 2024-04-25T12:25:02.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.230+0000 7f39bfdaf640 1 -- 172.21.15.94:0/1125626392 wait complete. 2024-04-25T12:25:02.251 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T12:25:02.251 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T12:25:02.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.370+0000 7f658778f640 1 Processor -- start 2024-04-25T12:25:02.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.370+0000 7f658778f640 1 -- start start 2024-04-25T12:25:02.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.370+0000 7f658778f640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f65800c8ec0 0x7f6580158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.370+0000 7f658778f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f658006c940 con 0x7f6580153390 2024-04-25T12:25:02.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.370+0000 7f658778f640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f658006d2a0 con 0x7f6580152fb0 2024-04-25T12:25:02.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.370+0000 7f658778f640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f65800c7fd0 con 0x7f65800c8ec0 2024-04-25T12:25:02.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.370+0000 7f6584d2a640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f6580153390 0x7f65800c87b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:44914/0 (socket says 172.21.15.94:44914) 2024-04-25T12:25:02.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.370+0000 7f6584d2a640 1 -- 172.21.15.94:0/834571718 learned_addr learned my addr 172.21.15.94:0/834571718 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:25:02.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.370+0000 7f6577fff640 1 -- 172.21.15.94:0/834571718 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4260081428 0 0) 0x7f658006c940 con 0x7f6580153390 2024-04-25T12:25:02.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.370+0000 7f6585d2c640 1 --2- 172.21.15.94:0/834571718 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f65800c8ec0 0x7f6580158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.370+0000 7f6577fff640 1 -- 172.21.15.94:0/834571718 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f656c003530 con 0x7f6580153390 2024-04-25T12:25:02.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f6577fff640 1 -- 172.21.15.94:0/834571718 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2516486136 0 0) 0x7f656c003530 con 0x7f6580153390 2024-04-25T12:25:02.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f6577fff640 1 -- 172.21.15.94:0/834571718 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f65800c8ec0 msgr2=0x7f6580158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:02.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f6577fff640 1 --2- 172.21.15.94:0/834571718 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f65800c8ec0 0x7f6580158ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f6577fff640 1 -- 172.21.15.94:0/834571718 >> v1:172.21.15.111:6789/0 conn(0x7f6580152fb0 legacy=0x7f65800c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f6577fff640 1 -- 172.21.15.94:0/834571718 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658006d560 con 0x7f6580153390 2024-04-25T12:25:02.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f6577fff640 1 -- 172.21.15.94:0/834571718 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7f65700016a0 con 0x7f6580153390 2024-04-25T12:25:02.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f6577fff640 1 -- 172.21.15.94:0/834571718 >> v1:172.21.15.94:6789/0 conn(0x7f6580153390 legacy=0x7f65800c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f6577fff640 1 --2- 172.21.15.94:0/834571718 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f65800c8ec0 0x7f656c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f6577fff640 1 --2- 172.21.15.94:0/834571718 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f656c003f70 0x7f656c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f6577fff640 1 --2- 172.21.15.94:0/834571718 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f656c004d50 0x7f656c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f6577fff640 1 -- 172.21.15.94:0/834571718 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f65800c7fd0 con 0x7f656c004d50 2024-04-25T12:25:02.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f6577fff640 1 -- 172.21.15.94:0/834571718 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f656c00bab0 con 0x7f656c003f70 2024-04-25T12:25:02.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f6577fff640 1 -- 172.21.15.94:0/834571718 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f656c00bcb0 con 0x7f65800c8ec0 2024-04-25T12:25:02.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f6585d2c640 1 --2- 172.21.15.94:0/834571718 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f656c004d50 0x7f656c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f6584d2a640 1 --2- 172.21.15.94:0/834571718 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f656c003f70 0x7f656c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f658552b640 1 --2- 172.21.15.94:0/834571718 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f65800c8ec0 0x7f656c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f6585d2c640 1 -- 172.21.15.94:0/834571718 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f65800c8ec0 msgr2=0x7f656c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:02.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f6585d2c640 1 --2- 172.21.15.94:0/834571718 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f65800c8ec0 0x7f656c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f6585d2c640 1 -- 172.21.15.94:0/834571718 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f656c003f70 msgr2=0x7f656c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:02.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f6585d2c640 1 --2- 172.21.15.94:0/834571718 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f656c003f70 0x7f656c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f6585d2c640 1 -- 172.21.15.94:0/834571718 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f656c003530 con 0x7f656c004d50 2024-04-25T12:25:02.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f6585d2c640 1 --2- 172.21.15.94:0/834571718 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f656c004d50 0x7f656c0051d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6578009fc0 tx=0x7f657801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8284fd67c81f87d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:02.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f6577fff640 1 -- 172.21.15.94:0/834571718 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65780b2070 con 0x7f656c004d50 2024-04-25T12:25:02.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f6577fff640 1 -- 172.21.15.94:0/834571718 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65780a5c90 con 0x7f656c004d50 2024-04-25T12:25:02.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f6577fff640 1 -- 172.21.15.94:0/834571718 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6578009c10 con 0x7f656c004d50 2024-04-25T12:25:02.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f658778f640 1 -- 172.21.15.94:0/834571718 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f656c004d50 msgr2=0x7f656c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f658778f640 1 --2- 172.21.15.94:0/834571718 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f656c004d50 0x7f656c0051d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6578009fc0 tx=0x7f657801cc80 comp rx=0 tx=0).stop 2024-04-25T12:25:02.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f6585d2c640 1 -- 172.21.15.94:0/834571718 reap_dead start 2024-04-25T12:25:02.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f658778f640 1 -- 172.21.15.94:0/834571718 shutdown_connections 2024-04-25T12:25:02.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f658778f640 1 -- 172.21.15.94:0/834571718 >> 172.21.15.94:0/834571718 conn(0x7f65800ca0d0 msgr2=0x7f65800ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:02.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f658778f640 1 -- 172.21.15.94:0/834571718 shutdown_connections 2024-04-25T12:25:02.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.374+0000 7f658778f640 1 -- 172.21.15.94:0/834571718 wait complete. 2024-04-25T12:25:02.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f658778f640 1 Processor -- start 2024-04-25T12:25:02.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f658778f640 1 -- start start 2024-04-25T12:25:02.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f658778f640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f656c004d50 0x7f65801f2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f658778f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6580159630 0x7f658014dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f658778f640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6580153da0 0x7f6580154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f658778f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f65800c8290 con 0x7f6580159630 2024-04-25T12:25:02.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f658778f640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f658006db20 con 0x7f656c004d50 2024-04-25T12:25:02.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f658778f640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6580069790 con 0x7f6580153da0 2024-04-25T12:25:02.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f6584d2a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6580159630 0x7f658014dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f6584d2a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6580159630 0x7f658014dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52636/0 (socket says 172.21.15.94:52636) 2024-04-25T12:25:02.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f6584d2a640 1 -- 172.21.15.94:0/2563683301 learned_addr learned my addr 172.21.15.94:0/2563683301 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:02.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f658552b640 1 --2- 172.21.15.94:0/2563683301 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f656c004d50 0x7f65801f2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f6585d2c640 1 --2- 172.21.15.94:0/2563683301 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6580153da0 0x7f6580154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f6584d2a640 1 -- 172.21.15.94:0/2563683301 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6580153da0 msgr2=0x7f6580154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f6584d2a640 1 --2- 172.21.15.94:0/2563683301 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6580153da0 0x7f6580154220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f6584d2a640 1 -- 172.21.15.94:0/2563683301 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f656c004d50 msgr2=0x7f65801f2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f6584d2a640 1 --2- 172.21.15.94:0/2563683301 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f656c004d50 0x7f65801f2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f6584d2a640 1 -- 172.21.15.94:0/2563683301 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65800cac30 con 0x7f6580159630 2024-04-25T12:25:02.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f658552b640 1 --2- 172.21.15.94:0/2563683301 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f656c004d50 0x7f65801f2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:25:02.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f6584d2a640 1 --2- 172.21.15.94:0/2563683301 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6580159630 0x7f658014dd30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f657000e830 tx=0x7f657000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:02.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f6575ffb640 1 -- 172.21.15.94:0/2563683301 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657000c8d0 con 0x7f6580159630 2024-04-25T12:25:02.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f6575ffb640 1 -- 172.21.15.94:0/2563683301 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6570018070 con 0x7f6580159630 2024-04-25T12:25:02.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f658778f640 1 -- 172.21.15.94:0/2563683301 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6580154760 con 0x7f6580159630 2024-04-25T12:25:02.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f6575ffb640 1 -- 172.21.15.94:0/2563683301 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657000ccd0 con 0x7f6580159630 2024-04-25T12:25:02.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f658778f640 1 -- 172.21.15.94:0/2563683301 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65801ef170 con 0x7f6580159630 2024-04-25T12:25:02.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f658778f640 1 -- 172.21.15.94:0/2563683301 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6580075e60 con 0x7f6580159630 2024-04-25T12:25:02.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.378+0000 7f6575ffb640 1 -- 172.21.15.94:0/2563683301 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f657001d460 con 0x7f6580159630 2024-04-25T12:25:02.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.382+0000 7f6575ffb640 1 --2- 172.21.15.94:0/2563683301 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6564068380 0x7f656406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.382+0000 7f6575ffb640 1 -- 172.21.15.94:0/2563683301 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f65700877f0 con 0x7f6580159630 2024-04-25T12:25:02.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.382+0000 7f658552b640 1 --2- 172.21.15.94:0/2563683301 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6564068380 0x7f656406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.382+0000 7f6575ffb640 1 --2- 172.21.15.94:0/2563683301 >> [v2:172.21.15.111:6802/1054925605,v1:172.21.15.111:6803/1054925605] conn(0x7f6564071d10 0x7f65640741b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.382+0000 7f6575ffb640 1 -- 172.21.15.94:0/2563683301 --> [v2:172.21.15.111:6802/1054925605,v1:172.21.15.111:6803/1054925605] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6570025e80 con 0x7f6564071d10 2024-04-25T12:25:02.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.382+0000 7f6575ffb640 1 -- 172.21.15.94:0/2563683301 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6570087c80 con 0x7f6580159630 2024-04-25T12:25:02.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.382+0000 7f658552b640 1 --2- 172.21.15.94:0/2563683301 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6564068380 0x7f656406a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f657c0016e0 tx=0x7f657c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:02.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.382+0000 7f6585d2c640 1 --2- 172.21.15.94:0/2563683301 >> [v2:172.21.15.111:6802/1054925605,v1:172.21.15.111:6803/1054925605] conn(0x7f6564071d10 0x7f65640741b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.382+0000 7f6585d2c640 1 --2- 172.21.15.94:0/2563683301 >> [v2:172.21.15.111:6802/1054925605,v1:172.21.15.111:6803/1054925605] conn(0x7f6564071d10 0x7f65640741b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:02.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.382+0000 7f6575ffb640 1 -- 172.21.15.94:0/2563683301 <== osd.5 v2:172.21.15.111:6802/1054925605 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6570025e80 con 0x7f6564071d10 2024-04-25T12:25:02.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.394+0000 7f658778f640 1 -- 172.21.15.94:0/2563683301 --> [v2:172.21.15.111:6802/1054925605,v1:172.21.15.111:6803/1054925605] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f658006c580 con 0x7f6564071d10 2024-04-25T12:25:02.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.398+0000 7f6575ffb640 1 -- 172.21.15.94:0/2563683301 <== osd.5 v2:172.21.15.111:6802/1054925605 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f658006c580 con 0x7f6564071d10 2024-04-25T12:25:02.402 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-25T12:25:02.402 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T12:25:02.402 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-25T12:25:02.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.398+0000 7f658778f640 1 -- 172.21.15.94:0/2563683301 >> [v2:172.21.15.111:6802/1054925605,v1:172.21.15.111:6803/1054925605] conn(0x7f6564071d10 msgr2=0x7f65640741b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.398+0000 7f658778f640 1 --2- 172.21.15.94:0/2563683301 >> [v2:172.21.15.111:6802/1054925605,v1:172.21.15.111:6803/1054925605] conn(0x7f6564071d10 0x7f65640741b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.398+0000 7f658778f640 1 -- 172.21.15.94:0/2563683301 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6564068380 msgr2=0x7f656406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.398+0000 7f658778f640 1 --2- 172.21.15.94:0/2563683301 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6564068380 0x7f656406a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f657c0016e0 tx=0x7f657c009040 comp rx=0 tx=0).stop 2024-04-25T12:25:02.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.398+0000 7f658778f640 1 -- 172.21.15.94:0/2563683301 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6580159630 msgr2=0x7f658014dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.398+0000 7f658778f640 1 --2- 172.21.15.94:0/2563683301 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6580159630 0x7f658014dd30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f657000e830 tx=0x7f657000ecf0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.398+0000 7f6585d2c640 1 -- 172.21.15.94:0/2563683301 reap_dead start 2024-04-25T12:25:02.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.398+0000 7f658778f640 1 -- 172.21.15.94:0/2563683301 shutdown_connections 2024-04-25T12:25:02.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.398+0000 7f658778f640 1 -- 172.21.15.94:0/2563683301 >> 172.21.15.94:0/2563683301 conn(0x7f65800ca0d0 msgr2=0x7f6580149300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:02.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.398+0000 7f658778f640 1 -- 172.21.15.94:0/2563683301 shutdown_connections 2024-04-25T12:25:02.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.398+0000 7f658778f640 1 -- 172.21.15.94:0/2563683301 wait complete. 2024-04-25T12:25:02.417 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T12:25:02.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0c493640 1 Processor -- start 2024-04-25T12:25:02.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0c493640 1 -- start start 2024-04-25T12:25:02.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0c493640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6f040c8250 0x7f6f040c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0c493640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f0415b740 con 0x7f6f040c8a70 2024-04-25T12:25:02.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0c493640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f040c58c0 con 0x7f6f040c8630 2024-04-25T12:25:02.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0c493640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f6f040c6490 con 0x7f6f040c8250 2024-04-25T12:25:02.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0aa30640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f6f040c8a70 0x7f6f04162790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:44930/0 (socket says 172.21.15.94:44930) 2024-04-25T12:25:02.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0aa30640 1 -- 172.21.15.94:0/952696738 learned_addr learned my addr 172.21.15.94:0/952696738 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:25:02.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0a22f640 1 --2- 172.21.15.94:0/952696738 >> v2:172.21.15.111:3300/0 conn(0x7f6f040c8250 0x7f6f040c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0922d640 1 -- 172.21.15.94:0/952696738 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1301374771 0 0) 0x7f6f0415b740 con 0x7f6f040c8a70 2024-04-25T12:25:02.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0922d640 1 -- 172.21.15.94:0/952696738 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6eec003530 con 0x7f6f040c8a70 2024-04-25T12:25:02.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0922d640 1 -- 172.21.15.94:0/952696738 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1316429480 0 0) 0x7f6eec003530 con 0x7f6f040c8a70 2024-04-25T12:25:02.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0922d640 1 -- 172.21.15.94:0/952696738 >> v2:172.21.15.111:3300/0 conn(0x7f6f040c8250 msgr2=0x7f6f040c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:02.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0922d640 1 --2- 172.21.15.94:0/952696738 >> v2:172.21.15.111:3300/0 conn(0x7f6f040c8250 0x7f6f040c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0922d640 1 -- 172.21.15.94:0/952696738 >> v1:172.21.15.111:6789/0 conn(0x7f6f040c8630 legacy=0x7f6f04151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0922d640 1 -- 172.21.15.94:0/952696738 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f040c5b60 con 0x7f6f040c8a70 2024-04-25T12:25:02.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0922d640 1 -- 172.21.15.94:0/952696738 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7f6efc001680 con 0x7f6f040c8a70 2024-04-25T12:25:02.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0922d640 1 -- 172.21.15.94:0/952696738 >> v1:172.21.15.94:6789/0 conn(0x7f6f040c8a70 legacy=0x7f6f04162790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0922d640 1 --2- 172.21.15.94:0/952696738 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6eec0039c0 0x7f6eec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0922d640 1 --2- 172.21.15.94:0/952696738 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6eec004810 0x7f6eec004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0922d640 1 --2- 172.21.15.94:0/952696738 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6eec0051d0 0x7f6eec00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0922d640 1 -- 172.21.15.94:0/952696738 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6f040c6490 con 0x7f6eec0039c0 2024-04-25T12:25:02.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0922d640 1 -- 172.21.15.94:0/952696738 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6eec00c170 con 0x7f6eec0051d0 2024-04-25T12:25:02.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0922d640 1 -- 172.21.15.94:0/952696738 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6eec00c370 con 0x7f6eec004810 2024-04-25T12:25:02.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0a22f640 1 --2- 172.21.15.94:0/952696738 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6eec0039c0 0x7f6eec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0aa30640 1 --2- 172.21.15.94:0/952696738 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6eec0051d0 0x7f6eec00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f09a2e640 1 --2- 172.21.15.94:0/952696738 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6eec004810 0x7f6eec004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0a22f640 1 -- 172.21.15.94:0/952696738 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6eec004810 msgr2=0x7f6eec004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:02.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0a22f640 1 --2- 172.21.15.94:0/952696738 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6eec004810 0x7f6eec004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0a22f640 1 -- 172.21.15.94:0/952696738 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6eec0051d0 msgr2=0x7f6eec00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:02.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0a22f640 1 --2- 172.21.15.94:0/952696738 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6eec0051d0 0x7f6eec00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0aa30640 1 -- 172.21.15.94:0/952696738 reap_dead start 2024-04-25T12:25:02.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f0a22f640 1 -- 172.21.15.94:0/952696738 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eec003530 con 0x7f6eec0039c0 2024-04-25T12:25:02.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.526+0000 7f6f09a2e640 1 --2- 172.21.15.94:0/952696738 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6eec004810 0x7f6eec004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:25:02.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.530+0000 7f6f0a22f640 1 --2- 172.21.15.94:0/952696738 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6eec0039c0 0x7f6eec003de0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4009fc0 tx=0x7f6ef401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea1f3db3a9d44ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:02.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.530+0000 7f6f0922d640 1 -- 172.21.15.94:0/952696738 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef40b2070 con 0x7f6eec0039c0 2024-04-25T12:25:02.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.530+0000 7f6f0922d640 1 -- 172.21.15.94:0/952696738 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ef40a5a80 con 0x7f6eec0039c0 2024-04-25T12:25:02.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.530+0000 7f6f0922d640 1 -- 172.21.15.94:0/952696738 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4009c10 con 0x7f6eec0039c0 2024-04-25T12:25:02.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.530+0000 7f6f0c493640 1 -- 172.21.15.94:0/952696738 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6eec0039c0 msgr2=0x7f6eec003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.530+0000 7f6f0c493640 1 --2- 172.21.15.94:0/952696738 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6eec0039c0 0x7f6eec003de0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4009fc0 tx=0x7f6ef401cc80 comp rx=0 tx=0).stop 2024-04-25T12:25:02.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.530+0000 7f6f0c493640 1 -- 172.21.15.94:0/952696738 shutdown_connections 2024-04-25T12:25:02.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.530+0000 7f6f0c493640 1 --2- 172.21.15.94:0/952696738 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6eec0039c0 0x7f6eec003de0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.530+0000 7f6f0c493640 1 -- 172.21.15.94:0/952696738 >> 172.21.15.94:0/952696738 conn(0x7f6f0406b9d0 msgr2=0x7f6f0406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:02.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.530+0000 7f6f0c493640 1 -- 172.21.15.94:0/952696738 shutdown_connections 2024-04-25T12:25:02.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.530+0000 7f6f0c493640 1 -- 172.21.15.94:0/952696738 wait complete. 2024-04-25T12:25:02.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.530+0000 7f6f0c493640 1 Processor -- start 2024-04-25T12:25:02.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.530+0000 7f6f0c493640 1 -- start start 2024-04-25T12:25:02.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.530+0000 7f6f0c493640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6eec0039c0 0x7f6f041599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.530+0000 7f6f0c493640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6f0415acb0 0x7f6f04145d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.530+0000 7f6f0c493640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f04072580 0x7f6f041f3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.530+0000 7f6f0c493640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6f040c6900 con 0x7f6f0415acb0 2024-04-25T12:25:02.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.530+0000 7f6f0c493640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0415b400 con 0x7f6f04072580 2024-04-25T12:25:02.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.530+0000 7f6f0c493640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6f040681d0 con 0x7f6eec0039c0 2024-04-25T12:25:02.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.530+0000 7f6f09a2e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6f0415acb0 0x7f6f04145d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.530+0000 7f6f09a2e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6f0415acb0 0x7f6f04145d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52652/0 (socket says 172.21.15.94:52652) 2024-04-25T12:25:02.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.530+0000 7f6f09a2e640 1 -- 172.21.15.94:0/294237963 learned_addr learned my addr 172.21.15.94:0/294237963 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:02.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.534+0000 7f6f0aa30640 1 --2- 172.21.15.94:0/294237963 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f04072580 0x7f6f041f3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.534+0000 7f6f0a22f640 1 --2- 172.21.15.94:0/294237963 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6eec0039c0 0x7f6f041599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.534+0000 7f6f09a2e640 1 -- 172.21.15.94:0/294237963 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6eec0039c0 msgr2=0x7f6f041599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.534+0000 7f6f09a2e640 1 --2- 172.21.15.94:0/294237963 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6eec0039c0 0x7f6f041599e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.534+0000 7f6f09a2e640 1 -- 172.21.15.94:0/294237963 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f04072580 msgr2=0x7f6f041f3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.534+0000 7f6f09a2e640 1 --2- 172.21.15.94:0/294237963 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f04072580 0x7f6f041f3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.534+0000 7f6f09a2e640 1 -- 172.21.15.94:0/294237963 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f040730f0 con 0x7f6f0415acb0 2024-04-25T12:25:02.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.534+0000 7f6f09a2e640 1 --2- 172.21.15.94:0/294237963 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6f0415acb0 0x7f6f04145d90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800d430 tx=0x7f6ef800d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:02.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.534+0000 7f6f02ffd640 1 -- 172.21.15.94:0/294237963 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8016020 con 0x7f6f0415acb0 2024-04-25T12:25:02.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.534+0000 7f6f02ffd640 1 -- 172.21.15.94:0/294237963 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ef8012800 con 0x7f6f0415acb0 2024-04-25T12:25:02.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.534+0000 7f6f0c493640 1 -- 172.21.15.94:0/294237963 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f040cbc90 con 0x7f6f0415acb0 2024-04-25T12:25:02.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.534+0000 7f6f02ffd640 1 -- 172.21.15.94:0/294237963 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8012bf0 con 0x7f6f0415acb0 2024-04-25T12:25:02.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.534+0000 7f6f0c493640 1 -- 172.21.15.94:0/294237963 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f041466f0 con 0x7f6f0415acb0 2024-04-25T12:25:02.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.534+0000 7f6f0c493640 1 -- 172.21.15.94:0/294237963 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f04075df0 con 0x7f6f0415acb0 2024-04-25T12:25:02.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.534+0000 7f6f02ffd640 1 -- 172.21.15.94:0/294237963 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6ef8019020 con 0x7f6f0415acb0 2024-04-25T12:25:02.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.534+0000 7f6f02ffd640 1 --2- 172.21.15.94:0/294237963 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6ef00683b0 0x7f6ef006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.534+0000 7f6f02ffd640 1 -- 172.21.15.94:0/294237963 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f6ef8086d60 con 0x7f6f0415acb0 2024-04-25T12:25:02.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.534+0000 7f6f0a22f640 1 --2- 172.21.15.94:0/294237963 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6ef00683b0 0x7f6ef006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.534+0000 7f6f0a22f640 1 --2- 172.21.15.94:0/294237963 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6ef00683b0 0x7f6ef006a870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6ef40af000 tx=0x7f6ef40a7040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:02.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.538+0000 7f6f02ffd640 1 -- 172.21.15.94:0/294237963 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6ef8020020 con 0x7f6f0415acb0 2024-04-25T12:25:02.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.686+0000 7f6f0c493640 1 -- 172.21.15.94:0/294237963 --> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f6f04071e50 con 0x7f6ef00683b0 2024-04-25T12:25:02.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.686+0000 7f6f02ffd640 1 -- 172.21.15.94:0/294237963 <== mgr.4101 v2:172.21.15.94:6832/549402167 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6f04071e50 con 0x7f6ef00683b0 2024-04-25T12:25:02.693 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T12:25:02.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.690+0000 7f6f0c493640 1 -- 172.21.15.94:0/294237963 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6ef00683b0 msgr2=0x7f6ef006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.690+0000 7f6f0c493640 1 --2- 172.21.15.94:0/294237963 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6ef00683b0 0x7f6ef006a870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6ef40af000 tx=0x7f6ef40a7040 comp rx=0 tx=0).stop 2024-04-25T12:25:02.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.690+0000 7f6f0c493640 1 -- 172.21.15.94:0/294237963 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6f0415acb0 msgr2=0x7f6f04145d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.690+0000 7f6f0c493640 1 --2- 172.21.15.94:0/294237963 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6f0415acb0 0x7f6f04145d90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800d430 tx=0x7f6ef800d8f0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.690+0000 7f6f0c493640 1 -- 172.21.15.94:0/294237963 shutdown_connections 2024-04-25T12:25:02.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.690+0000 7f6f0c493640 1 --2- 172.21.15.94:0/294237963 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6ef00683b0 0x7f6ef006a870 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.690+0000 7f6f0c493640 1 --2- 172.21.15.94:0/294237963 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f04072580 0x7f6f041f3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.690+0000 7f6f0c493640 1 --2- 172.21.15.94:0/294237963 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6f0415acb0 0x7f6f04145d90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.690+0000 7f6f0c493640 1 --2- 172.21.15.94:0/294237963 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6eec0039c0 0x7f6f041599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.690+0000 7f6f0c493640 1 -- 172.21.15.94:0/294237963 >> 172.21.15.94:0/294237963 conn(0x7f6f0406b9d0 msgr2=0x7f6f0406ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:02.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.690+0000 7f6f0c493640 1 -- 172.21.15.94:0/294237963 shutdown_connections 2024-04-25T12:25:02.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.690+0000 7f6f0c493640 1 -- 172.21.15.94:0/294237963 wait complete. 2024-04-25T12:25:02.710 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T12:25:02.711 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T12:25:02.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.830+0000 7f2a3a9ac640 1 Processor -- start 2024-04-25T12:25:02.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.830+0000 7f2a3a9ac640 1 -- start start 2024-04-25T12:25:02.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.830+0000 7f2a3a9ac640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2a340c73a0 0x7f2a341649a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.830+0000 7f2a3a9ac640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a3406ce60 con 0x7f2a340c6380 2024-04-25T12:25:02.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.830+0000 7f2a3a9ac640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a340c8ae0 con 0x7f2a340c5fa0 2024-04-25T12:25:02.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.830+0000 7f2a3a9ac640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2a340c8890 con 0x7f2a340c73a0 2024-04-25T12:25:02.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.830+0000 7f2a337fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f2a340c6380 0x7f2a34152cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:44944/0 (socket says 172.21.15.94:44944) 2024-04-25T12:25:02.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.830+0000 7f2a337fe640 1 -- 172.21.15.94:0/503845570 learned_addr learned my addr 172.21.15.94:0/503845570 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:25:02.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.830+0000 7f2a38f49640 1 --2- 172.21.15.94:0/503845570 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2a340c73a0 0x7f2a341649a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.830+0000 7f2a32ffd640 1 -- 172.21.15.94:0/503845570 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3823273934 0 0) 0x7f2a3406ce60 con 0x7f2a340c6380 2024-04-25T12:25:02.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.830+0000 7f2a32ffd640 1 -- 172.21.15.94:0/503845570 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a1c003530 con 0x7f2a340c6380 2024-04-25T12:25:02.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.830+0000 7f2a32ffd640 1 -- 172.21.15.94:0/503845570 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4294111087 0 0) 0x7f2a1c003530 con 0x7f2a340c6380 2024-04-25T12:25:02.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.830+0000 7f2a32ffd640 1 -- 172.21.15.94:0/503845570 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2a340c73a0 msgr2=0x7f2a341649a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:02.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.830+0000 7f2a32ffd640 1 --2- 172.21.15.94:0/503845570 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2a340c73a0 0x7f2a341649a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.830+0000 7f2a32ffd640 1 -- 172.21.15.94:0/503845570 >> v1:172.21.15.111:6789/0 conn(0x7f2a340c5fa0 legacy=0x7f2a3415ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.830+0000 7f2a32ffd640 1 -- 172.21.15.94:0/503845570 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a340c8dc0 con 0x7f2a340c6380 2024-04-25T12:25:02.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.830+0000 7f2a32ffd640 1 -- 172.21.15.94:0/503845570 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7f2a28001680 con 0x7f2a340c6380 2024-04-25T12:25:02.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.830+0000 7f2a32ffd640 1 -- 172.21.15.94:0/503845570 >> v1:172.21.15.94:6789/0 conn(0x7f2a340c6380 legacy=0x7f2a34152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.830+0000 7f2a32ffd640 1 --2- 172.21.15.94:0/503845570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2a1c0039f0 0x7f2a1c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.830+0000 7f2a32ffd640 1 --2- 172.21.15.94:0/503845570 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a1c004810 0x7f2a1c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.830+0000 7f2a32ffd640 1 --2- 172.21.15.94:0/503845570 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2a340c73a0 0x7f2a1c0052a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.830+0000 7f2a32ffd640 1 -- 172.21.15.94:0/503845570 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2a340c8890 con 0x7f2a1c0039f0 2024-04-25T12:25:02.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.830+0000 7f2a32ffd640 1 -- 172.21.15.94:0/503845570 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1c00bb90 con 0x7f2a1c004810 2024-04-25T12:25:02.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.830+0000 7f2a32ffd640 1 -- 172.21.15.94:0/503845570 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2a1c00bd90 con 0x7f2a340c73a0 2024-04-25T12:25:02.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.830+0000 7f2a33fff640 1 --2- 172.21.15.94:0/503845570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2a1c0039f0 0x7f2a1c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.834+0000 7f2a337fe640 1 --2- 172.21.15.94:0/503845570 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a1c004810 0x7f2a1c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.834+0000 7f2a38f49640 1 --2- 172.21.15.94:0/503845570 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2a340c73a0 0x7f2a1c0052a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.834+0000 7f2a33fff640 1 -- 172.21.15.94:0/503845570 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2a340c73a0 msgr2=0x7f2a1c0052a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:02.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.834+0000 7f2a33fff640 1 --2- 172.21.15.94:0/503845570 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2a340c73a0 0x7f2a1c0052a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.834+0000 7f2a33fff640 1 -- 172.21.15.94:0/503845570 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a1c004810 msgr2=0x7f2a1c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:02.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.834+0000 7f2a33fff640 1 --2- 172.21.15.94:0/503845570 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a1c004810 0x7f2a1c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.834+0000 7f2a33fff640 1 -- 172.21.15.94:0/503845570 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1c003530 con 0x7f2a1c0039f0 2024-04-25T12:25:02.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.834+0000 7f2a38f49640 1 --2- 172.21.15.94:0/503845570 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2a340c73a0 0x7f2a1c0052a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:25:02.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.834+0000 7f2a33fff640 1 --2- 172.21.15.94:0/503845570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2a1c0039f0 0x7f2a1c003e10 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2a24001e70 tx=0x7f2a2401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331b43a4b97fb46b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:02.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.834+0000 7f2a32ffd640 1 -- 172.21.15.94:0/503845570 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a24001a90 con 0x7f2a1c0039f0 2024-04-25T12:25:02.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.834+0000 7f2a32ffd640 1 -- 172.21.15.94:0/503845570 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a24003b80 con 0x7f2a1c0039f0 2024-04-25T12:25:02.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.834+0000 7f2a32ffd640 1 -- 172.21.15.94:0/503845570 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a24005080 con 0x7f2a1c0039f0 2024-04-25T12:25:02.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.834+0000 7f2a3a9ac640 1 -- 172.21.15.94:0/503845570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2a1c0039f0 msgr2=0x7f2a1c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.834+0000 7f2a3a9ac640 1 --2- 172.21.15.94:0/503845570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2a1c0039f0 0x7f2a1c003e10 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2a24001e70 tx=0x7f2a2401c780 comp rx=0 tx=0).stop 2024-04-25T12:25:02.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.834+0000 7f2a38f49640 1 -- 172.21.15.94:0/503845570 reap_dead start 2024-04-25T12:25:02.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.834+0000 7f2a3a9ac640 1 -- 172.21.15.94:0/503845570 shutdown_connections 2024-04-25T12:25:02.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.834+0000 7f2a3a9ac640 1 -- 172.21.15.94:0/503845570 >> 172.21.15.94:0/503845570 conn(0x7f2a340c9130 msgr2=0x7f2a340c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:02.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.834+0000 7f2a3a9ac640 1 -- 172.21.15.94:0/503845570 shutdown_connections 2024-04-25T12:25:02.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.834+0000 7f2a3a9ac640 1 -- 172.21.15.94:0/503845570 wait complete. 2024-04-25T12:25:02.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.834+0000 7f2a3a9ac640 1 Processor -- start 2024-04-25T12:25:02.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.834+0000 7f2a3a9ac640 1 -- start start 2024-04-25T12:25:02.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a3a9ac640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a1c0039f0 0x7f2a3415bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a3a9ac640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2a340cc0f0 0x7f2a341493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a3a9ac640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2a340ca8d0 0x7f2a34149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a3a9ac640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3406cc10 con 0x7f2a340ca8d0 2024-04-25T12:25:02.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a3a9ac640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3406ca90 con 0x7f2a1c0039f0 2024-04-25T12:25:02.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a3a9ac640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2a340c6fa0 con 0x7f2a340cc0f0 2024-04-25T12:25:02.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a38f49640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2a340ca8d0 0x7f2a34149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a38f49640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2a340ca8d0 0x7f2a34149900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52658/0 (socket says 172.21.15.94:52658) 2024-04-25T12:25:02.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a38f49640 1 -- 172.21.15.94:0/1600260843 learned_addr learned my addr 172.21.15.94:0/1600260843 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:02.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a33fff640 1 --2- 172.21.15.94:0/1600260843 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a1c0039f0 0x7f2a3415bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a337fe640 1 --2- 172.21.15.94:0/1600260843 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2a340cc0f0 0x7f2a341493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a38f49640 1 -- 172.21.15.94:0/1600260843 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2a340cc0f0 msgr2=0x7f2a341493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a38f49640 1 --2- 172.21.15.94:0/1600260843 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2a340cc0f0 0x7f2a341493c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a38f49640 1 -- 172.21.15.94:0/1600260843 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a1c0039f0 msgr2=0x7f2a3415bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a38f49640 1 --2- 172.21.15.94:0/1600260843 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a1c0039f0 0x7f2a3415bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a38f49640 1 -- 172.21.15.94:0/1600260843 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a34156150 con 0x7f2a340ca8d0 2024-04-25T12:25:02.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a33fff640 1 --2- 172.21.15.94:0/1600260843 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a1c0039f0 0x7f2a3415bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:25:02.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a38f49640 1 --2- 172.21.15.94:0/1600260843 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2a340ca8d0 0x7f2a34149900 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2a34068920 tx=0x7f2a2c010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:02.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a30ff9640 1 -- 172.21.15.94:0/1600260843 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c00f040 con 0x7f2a340ca8d0 2024-04-25T12:25:02.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a30ff9640 1 -- 172.21.15.94:0/1600260843 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a2c01c070 con 0x7f2a340ca8d0 2024-04-25T12:25:02.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a3a9ac640 1 -- 172.21.15.94:0/1600260843 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a34154420 con 0x7f2a340ca8d0 2024-04-25T12:25:02.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a30ff9640 1 -- 172.21.15.94:0/1600260843 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c00ea60 con 0x7f2a340ca8d0 2024-04-25T12:25:02.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a3a9ac640 1 -- 172.21.15.94:0/1600260843 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a341563c0 con 0x7f2a340ca8d0 2024-04-25T12:25:02.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a3a9ac640 1 -- 172.21.15.94:0/1600260843 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2a34075e60 con 0x7f2a340ca8d0 2024-04-25T12:25:02.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a30ff9640 1 -- 172.21.15.94:0/1600260843 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2a2c00ec00 con 0x7f2a340ca8d0 2024-04-25T12:25:02.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a30ff9640 1 --2- 172.21.15.94:0/1600260843 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2a200683b0 0x7f2a2006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a33fff640 1 --2- 172.21.15.94:0/1600260843 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2a200683b0 0x7f2a2006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a30ff9640 1 -- 172.21.15.94:0/1600260843 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f2a2c087710 con 0x7f2a340ca8d0 2024-04-25T12:25:02.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a30ff9640 1 --2- 172.21.15.94:0/1600260843 >> [v2:172.21.15.111:6824/3619235078,v1:172.21.15.111:6825/3619235078] conn(0x7f2a20071d40 0x7f2a200741e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a30ff9640 1 -- 172.21.15.94:0/1600260843 --> [v2:172.21.15.111:6824/3619235078,v1:172.21.15.111:6825/3619235078] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2a2c019e70 con 0x7f2a20071d40 2024-04-25T12:25:02.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a30ff9640 1 -- 172.21.15.94:0/1600260843 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2a2c087ba0 con 0x7f2a340ca8d0 2024-04-25T12:25:02.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a33fff640 1 --2- 172.21.15.94:0/1600260843 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2a200683b0 0x7f2a2006a870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2a24005000 tx=0x7f2a24001520 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:02.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.838+0000 7f2a337fe640 1 --2- 172.21.15.94:0/1600260843 >> [v2:172.21.15.111:6824/3619235078,v1:172.21.15.111:6825/3619235078] conn(0x7f2a20071d40 0x7f2a200741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.842+0000 7f2a337fe640 1 --2- 172.21.15.94:0/1600260843 >> [v2:172.21.15.111:6824/3619235078,v1:172.21.15.111:6825/3619235078] conn(0x7f2a20071d40 0x7f2a200741e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:02.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.842+0000 7f2a30ff9640 1 -- 172.21.15.94:0/1600260843 <== osd.6 v2:172.21.15.111:6824/3619235078 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2a2c019e70 con 0x7f2a20071d40 2024-04-25T12:25:02.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.854+0000 7f2a3a9ac640 1 -- 172.21.15.94:0/1600260843 --> [v2:172.21.15.111:6824/3619235078,v1:172.21.15.111:6825/3619235078] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2a3415d2d0 con 0x7f2a20071d40 2024-04-25T12:25:02.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.854+0000 7f2a30ff9640 1 -- 172.21.15.94:0/1600260843 <== osd.6 v2:172.21.15.111:6824/3619235078 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2a3415d2d0 con 0x7f2a20071d40 2024-04-25T12:25:02.861 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-25T12:25:02.861 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T12:25:02.861 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-25T12:25:02.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.854+0000 7f2a3a9ac640 1 -- 172.21.15.94:0/1600260843 >> [v2:172.21.15.111:6824/3619235078,v1:172.21.15.111:6825/3619235078] conn(0x7f2a20071d40 msgr2=0x7f2a200741e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.854+0000 7f2a3a9ac640 1 --2- 172.21.15.94:0/1600260843 >> [v2:172.21.15.111:6824/3619235078,v1:172.21.15.111:6825/3619235078] conn(0x7f2a20071d40 0x7f2a200741e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.854+0000 7f2a3a9ac640 1 -- 172.21.15.94:0/1600260843 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2a200683b0 msgr2=0x7f2a2006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.854+0000 7f2a3a9ac640 1 --2- 172.21.15.94:0/1600260843 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f2a200683b0 0x7f2a2006a870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2a24005000 tx=0x7f2a24001520 comp rx=0 tx=0).stop 2024-04-25T12:25:02.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.854+0000 7f2a3a9ac640 1 -- 172.21.15.94:0/1600260843 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2a340ca8d0 msgr2=0x7f2a34149900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:02.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.854+0000 7f2a3a9ac640 1 --2- 172.21.15.94:0/1600260843 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2a340ca8d0 0x7f2a34149900 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2a34068920 tx=0x7f2a2c010c20 comp rx=0 tx=0).stop 2024-04-25T12:25:02.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.854+0000 7f2a38f49640 1 -- 172.21.15.94:0/1600260843 reap_dead start 2024-04-25T12:25:02.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.854+0000 7f2a3a9ac640 1 -- 172.21.15.94:0/1600260843 shutdown_connections 2024-04-25T12:25:02.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.854+0000 7f2a3a9ac640 1 -- 172.21.15.94:0/1600260843 >> 172.21.15.94:0/1600260843 conn(0x7f2a340c9130 msgr2=0x7f2a340cb930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:02.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.854+0000 7f2a3a9ac640 1 -- 172.21.15.94:0/1600260843 shutdown_connections 2024-04-25T12:25:02.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.854+0000 7f2a3a9ac640 1 -- 172.21.15.94:0/1600260843 wait complete. 2024-04-25T12:25:02.877 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T12:25:02.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.986+0000 7f17e1a54640 1 Processor -- start 2024-04-25T12:25:02.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.986+0000 7f17e1a54640 1 -- start start 2024-04-25T12:25:02.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.986+0000 7f17e1a54640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f17dc14fbc0 0x7f17dc06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.986+0000 7f17e1a54640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f17dc14ffa0 0x7f17dc0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.986+0000 7f17e1a54640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f17dc074100 0x7f17dc0c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:02.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.986+0000 7f17e1a54640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f17dc0c5d70 con 0x7f17dc14fbc0 2024-04-25T12:25:02.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.986+0000 7f17e1a54640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f17dc0c6050 con 0x7f17dc074100 2024-04-25T12:25:02.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.986+0000 7f17e1a54640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f17dc0c6330 con 0x7f17dc14ffa0 2024-04-25T12:25:02.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.986+0000 7f17daffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f17dc14fbc0 0x7f17dc06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.986+0000 7f17daffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f17dc14fbc0 0x7f17dc06f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52668/0 (socket says 172.21.15.94:52668) 2024-04-25T12:25:02.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.986+0000 7f17daffd640 1 -- 172.21.15.94:0/848296610 learned_addr learned my addr 172.21.15.94:0/848296610 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:02.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.986+0000 7f17db7fe640 1 --2- 172.21.15.94:0/848296610 >> v2:172.21.15.111:3300/0 conn(0x7f17dc074100 0x7f17dc0c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.986+0000 7f17da7fc640 1 --2- 172.21.15.94:0/848296610 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f17dc14ffa0 0x7f17dc0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:02.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.986+0000 7f17daffd640 1 -- 172.21.15.94:0/848296610 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f17dc14ffa0 msgr2=0x7f17dc0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:02.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.986+0000 7f17daffd640 1 --2- 172.21.15.94:0/848296610 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f17dc14ffa0 0x7f17dc0c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.986+0000 7f17daffd640 1 -- 172.21.15.94:0/848296610 >> v2:172.21.15.111:3300/0 conn(0x7f17dc074100 msgr2=0x7f17dc0c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:02.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.986+0000 7f17daffd640 1 --2- 172.21.15.94:0/848296610 >> v2:172.21.15.111:3300/0 conn(0x7f17dc074100 0x7f17dc0c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:02.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.986+0000 7f17daffd640 1 -- 172.21.15.94:0/848296610 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17dc0c6610 con 0x7f17dc14fbc0 2024-04-25T12:25:02.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.986+0000 7f17db7fe640 1 --2- 172.21.15.94:0/848296610 >> v2:172.21.15.111:3300/0 conn(0x7f17dc074100 0x7f17dc0c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:25:02.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.986+0000 7f17da7fc640 1 --2- 172.21.15.94:0/848296610 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f17dc14ffa0 0x7f17dc0c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:25:02.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17daffd640 1 --2- 172.21.15.94:0/848296610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17dc14fbc0 0x7f17dc06f700 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0744e0 tx=0x7f17cc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3d541a17c75fec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:02.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17d9ffb640 1 -- 172.21.15.94:0/848296610 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17cc0aa660 con 0x7f17dc14fbc0 2024-04-25T12:25:02.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17d9ffb640 1 -- 172.21.15.94:0/848296610 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17cc0af070 con 0x7f17dc14fbc0 2024-04-25T12:25:03.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17d9ffb640 1 -- 172.21.15.94:0/848296610 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17cc0aaa20 con 0x7f17dc14fbc0 2024-04-25T12:25:03.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17e1a54640 1 -- 172.21.15.94:0/848296610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17dc14fbc0 msgr2=0x7f17dc06f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:03.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17e1a54640 1 --2- 172.21.15.94:0/848296610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17dc14fbc0 0x7f17dc06f700 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0744e0 tx=0x7f17cc01c520 comp rx=0 tx=0).stop 2024-04-25T12:25:03.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17e1a54640 1 -- 172.21.15.94:0/848296610 shutdown_connections 2024-04-25T12:25:03.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17e1a54640 1 --2- 172.21.15.94:0/848296610 >> v2:172.21.15.111:3300/0 conn(0x7f17dc074100 0x7f17dc0c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17e1a54640 1 --2- 172.21.15.94:0/848296610 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f17dc14ffa0 0x7f17dc0c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17e1a54640 1 --2- 172.21.15.94:0/848296610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17dc14fbc0 0x7f17dc06f700 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17e1a54640 1 -- 172.21.15.94:0/848296610 >> 172.21.15.94:0/848296610 conn(0x7f17dc06b9d0 msgr2=0x7f17dc06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:03.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17e1a54640 1 -- 172.21.15.94:0/848296610 shutdown_connections 2024-04-25T12:25:03.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17e1a54640 1 -- 172.21.15.94:0/848296610 wait complete. 2024-04-25T12:25:03.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17e1a54640 1 Processor -- start 2024-04-25T12:25:03.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17e1a54640 1 -- start start 2024-04-25T12:25:03.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17e1a54640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17dc074100 0x7f17dc15e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:03.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17e1a54640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f17dc14fbc0 0x7f17dc1f2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:03.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17e1a54640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17dc14ffa0 0x7f17dc15c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:03.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17e1a54640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f17dc1592e0 con 0x7f17dc074100 2024-04-25T12:25:03.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17e1a54640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f17dc159160 con 0x7f17dc14ffa0 2024-04-25T12:25:03.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17e1a54640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f17dc159460 con 0x7f17dc14fbc0 2024-04-25T12:25:03.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17daffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17dc074100 0x7f17dc15e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:03.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17daffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17dc074100 0x7f17dc15e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52672/0 (socket says 172.21.15.94:52672) 2024-04-25T12:25:03.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17daffd640 1 -- 172.21.15.94:0/1583833483 learned_addr learned my addr 172.21.15.94:0/1583833483 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:03.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17da7fc640 1 --2- 172.21.15.94:0/1583833483 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f17dc14fbc0 0x7f17dc1f2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:03.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17db7fe640 1 --2- 172.21.15.94:0/1583833483 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17dc14ffa0 0x7f17dc15c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:03.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17daffd640 1 -- 172.21.15.94:0/1583833483 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f17dc14fbc0 msgr2=0x7f17dc1f2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:03.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17daffd640 1 --2- 172.21.15.94:0/1583833483 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f17dc14fbc0 0x7f17dc1f2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17daffd640 1 -- 172.21.15.94:0/1583833483 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17dc14ffa0 msgr2=0x7f17dc15c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:03.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17daffd640 1 --2- 172.21.15.94:0/1583833483 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17dc14ffa0 0x7f17dc15c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17daffd640 1 -- 172.21.15.94:0/1583833483 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17dc15ee60 con 0x7f17dc074100 2024-04-25T12:25:03.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17db7fe640 1 --2- 172.21.15.94:0/1583833483 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17dc14ffa0 0x7f17dc15c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:25:03.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17daffd640 1 --2- 172.21.15.94:0/1583833483 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17dc074100 0x7f17dc15e080 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f17cc01cdc0 tx=0x7f17cc01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:03.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17c3fff640 1 -- 172.21.15.94:0/1583833483 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17cc0b3800 con 0x7f17dc074100 2024-04-25T12:25:03.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17c3fff640 1 -- 172.21.15.94:0/1583833483 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17cc0b39c0 con 0x7f17dc074100 2024-04-25T12:25:03.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17e1a54640 1 -- 172.21.15.94:0/1583833483 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17dc15f140 con 0x7f17dc074100 2024-04-25T12:25:03.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17c3fff640 1 -- 172.21.15.94:0/1583833483 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17cc0b3db0 con 0x7f17dc074100 2024-04-25T12:25:03.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.990+0000 7f17e1a54640 1 -- 172.21.15.94:0/1583833483 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17dc15d880 con 0x7f17dc074100 2024-04-25T12:25:03.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.994+0000 7f17e1a54640 1 -- 172.21.15.94:0/1583833483 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17dc075df0 con 0x7f17dc074100 2024-04-25T12:25:03.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.994+0000 7f17c3fff640 1 -- 172.21.15.94:0/1583833483 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f17cc0b2380 con 0x7f17dc074100 2024-04-25T12:25:03.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.994+0000 7f17c3fff640 1 --2- 172.21.15.94:0/1583833483 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f17c8068380 0x7f17c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:03.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.994+0000 7f17c3fff640 1 -- 172.21.15.94:0/1583833483 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f17cc121420 con 0x7f17dc074100 2024-04-25T12:25:03.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.994+0000 7f17da7fc640 1 --2- 172.21.15.94:0/1583833483 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f17c8068380 0x7f17c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:03.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.994+0000 7f17da7fc640 1 --2- 172.21.15.94:0/1583833483 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f17c8068380 0x7f17c806a840 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f17d0006fd0 tx=0x7f17d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:03.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:02.998+0000 7f17c3fff640 1 -- 172.21.15.94:0/1583833483 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f17cc0c3060 con 0x7f17dc074100 2024-04-25T12:25:03.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.146+0000 7f17e1a54640 1 -- 172.21.15.94:0/1583833483 --> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f17dc0c7df0 con 0x7f17c8068380 2024-04-25T12:25:03.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.150+0000 7f17c3fff640 1 -- 172.21.15.94:0/1583833483 <== mgr.4101 v2:172.21.15.94:6832/549402167 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f17dc0c7df0 con 0x7f17c8068380 2024-04-25T12:25:03.154 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T12:25:03.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.150+0000 7f17e1a54640 1 -- 172.21.15.94:0/1583833483 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f17c8068380 msgr2=0x7f17c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:03.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.150+0000 7f17e1a54640 1 --2- 172.21.15.94:0/1583833483 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f17c8068380 0x7f17c806a840 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f17d0006fd0 tx=0x7f17d0008040 comp rx=0 tx=0).stop 2024-04-25T12:25:03.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.150+0000 7f17e1a54640 1 -- 172.21.15.94:0/1583833483 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17dc074100 msgr2=0x7f17dc15e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:03.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.150+0000 7f17e1a54640 1 --2- 172.21.15.94:0/1583833483 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17dc074100 0x7f17dc15e080 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f17cc01cdc0 tx=0x7f17cc01ad60 comp rx=0 tx=0).stop 2024-04-25T12:25:03.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.150+0000 7f17e1a54640 1 -- 172.21.15.94:0/1583833483 shutdown_connections 2024-04-25T12:25:03.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.150+0000 7f17e1a54640 1 --2- 172.21.15.94:0/1583833483 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f17c8068380 0x7f17c806a840 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.150+0000 7f17e1a54640 1 --2- 172.21.15.94:0/1583833483 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f17dc14fbc0 0x7f17dc1f2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.150+0000 7f17e1a54640 1 --2- 172.21.15.94:0/1583833483 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17dc14ffa0 0x7f17dc15c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.150+0000 7f17e1a54640 1 --2- 172.21.15.94:0/1583833483 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17dc074100 0x7f17dc15e080 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.150+0000 7f17e1a54640 1 -- 172.21.15.94:0/1583833483 >> 172.21.15.94:0/1583833483 conn(0x7f17dc06b9d0 msgr2=0x7f17dc06e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:03.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.150+0000 7f17e1a54640 1 -- 172.21.15.94:0/1583833483 shutdown_connections 2024-04-25T12:25:03.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.150+0000 7f17e1a54640 1 -- 172.21.15.94:0/1583833483 wait complete. 2024-04-25T12:25:03.171 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T12:25:03.171 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T12:25:03.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.290+0000 7f37c0649640 1 Processor -- start 2024-04-25T12:25:03.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.290+0000 7f37c0649640 1 -- start start 2024-04-25T12:25:03.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.290+0000 7f37c0649640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f37b80c6380 0x7f37b8152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:03.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.290+0000 7f37c0649640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f37b80c73a0 0x7f37b8153230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:03.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.290+0000 7f37c0649640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37b806ce60 con 0x7f37b80c5fa0 2024-04-25T12:25:03.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.290+0000 7f37c0649640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f37b8153770 con 0x7f37b80c73a0 2024-04-25T12:25:03.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.290+0000 7f37c0649640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f37b80c8890 con 0x7f37b80c6380 2024-04-25T12:25:03.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.290+0000 7f37bebe6640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f37b80c73a0 0x7f37b8153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:03.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.290+0000 7f37bdbe4640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f37b80c6380 0x7f37b8152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:03.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.290+0000 7f37be3e5640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f37b80c5fa0 0x7f37b815ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.94:59088/0 (socket says 172.21.15.94:59088) 2024-04-25T12:25:03.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.290+0000 7f37be3e5640 1 -- 172.21.15.94:0/920374429 learned_addr learned my addr 172.21.15.94:0/920374429 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:25:03.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.290+0000 7f37bebe6640 1 --2- 172.21.15.94:0/920374429 >> v2:172.21.15.111:3300/0 conn(0x7f37b80c73a0 0x7f37b8153230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.94:35088/0 (socket says 172.21.15.94:35088) 2024-04-25T12:25:03.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.290+0000 7f37bebe6640 1 -- 172.21.15.94:0/920374429 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f37b80c6380 msgr2=0x7f37b8152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:03.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.290+0000 7f37bebe6640 1 --2- 172.21.15.94:0/920374429 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f37b80c6380 0x7f37b8152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.290+0000 7f37bebe6640 1 -- 172.21.15.94:0/920374429 >> v1:172.21.15.111:6789/0 conn(0x7f37b80c5fa0 legacy=0x7f37b815ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:03.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.290+0000 7f37bebe6640 1 -- 172.21.15.94:0/920374429 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b80c8ae0 con 0x7f37b80c73a0 2024-04-25T12:25:03.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.294+0000 7f37bebe6640 1 --2- 172.21.15.94:0/920374429 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37b80c73a0 0x7f37b8153230 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f37b0009dc0 tx=0x7f37b001c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df3a2d674c108be2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:03.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.294+0000 7f37bd3e3640 1 -- 172.21.15.94:0/920374429 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b00b2070 con 0x7f37b80c73a0 2024-04-25T12:25:03.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.294+0000 7f37bd3e3640 1 -- 172.21.15.94:0/920374429 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b00a57e0 con 0x7f37b80c73a0 2024-04-25T12:25:03.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.294+0000 7f37bd3e3640 1 -- 172.21.15.94:0/920374429 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b00a5bb0 con 0x7f37b80c73a0 2024-04-25T12:25:03.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.294+0000 7f37c0649640 1 -- 172.21.15.94:0/920374429 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37b80c73a0 msgr2=0x7f37b8153230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:03.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.294+0000 7f37c0649640 1 --2- 172.21.15.94:0/920374429 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37b80c73a0 0x7f37b8153230 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f37b0009dc0 tx=0x7f37b001c830 comp rx=0 tx=0).stop 2024-04-25T12:25:03.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.294+0000 7f37c0649640 1 -- 172.21.15.94:0/920374429 shutdown_connections 2024-04-25T12:25:03.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.294+0000 7f37c0649640 1 --2- 172.21.15.94:0/920374429 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37b80c73a0 0x7f37b8153230 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.294+0000 7f37c0649640 1 --2- 172.21.15.94:0/920374429 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f37b80c6380 0x7f37b8152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.294+0000 7f37c0649640 1 -- 172.21.15.94:0/920374429 >> 172.21.15.94:0/920374429 conn(0x7f37b80c9130 msgr2=0x7f37b80c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:03.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.294+0000 7f37c0649640 1 -- 172.21.15.94:0/920374429 shutdown_connections 2024-04-25T12:25:03.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.294+0000 7f37c0649640 1 -- 172.21.15.94:0/920374429 wait complete. 2024-04-25T12:25:03.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.298+0000 7f37c0649640 1 Processor -- start 2024-04-25T12:25:03.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.298+0000 7f37c0649640 1 -- start start 2024-04-25T12:25:03.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.298+0000 7f37c0649640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f37b80c5fa0 0x7f37b8162fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:03.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.298+0000 7f37c0649640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37b80c6380 0x7f37b814b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:03.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.298+0000 7f37c0649640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37b80c73a0 0x7f37b814ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:03.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.298+0000 7f37c0649640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f37b806ca90 con 0x7f37b80c6380 2024-04-25T12:25:03.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.298+0000 7f37c0649640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f37b8159010 con 0x7f37b80c73a0 2024-04-25T12:25:03.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.298+0000 7f37c0649640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f37b806cc10 con 0x7f37b80c5fa0 2024-04-25T12:25:03.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.298+0000 7f37bdbe4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37b80c6380 0x7f37b814b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:03.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.298+0000 7f37bdbe4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37b80c6380 0x7f37b814b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52688/0 (socket says 172.21.15.94:52688) 2024-04-25T12:25:03.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.298+0000 7f37bdbe4640 1 -- 172.21.15.94:0/1560209706 learned_addr learned my addr 172.21.15.94:0/1560209706 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:03.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.298+0000 7f37bebe6640 1 --2- 172.21.15.94:0/1560209706 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37b80c73a0 0x7f37b814ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:03.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.298+0000 7f37be3e5640 1 --2- 172.21.15.94:0/1560209706 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f37b80c5fa0 0x7f37b8162fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:03.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.298+0000 7f37bdbe4640 1 -- 172.21.15.94:0/1560209706 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f37b80c5fa0 msgr2=0x7f37b8162fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:03.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.298+0000 7f37bdbe4640 1 --2- 172.21.15.94:0/1560209706 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f37b80c5fa0 0x7f37b8162fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.298+0000 7f37bdbe4640 1 -- 172.21.15.94:0/1560209706 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37b80c73a0 msgr2=0x7f37b814ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:03.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.298+0000 7f37bdbe4640 1 --2- 172.21.15.94:0/1560209706 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37b80c73a0 0x7f37b814ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.298+0000 7f37bdbe4640 1 -- 172.21.15.94:0/1560209706 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b8163620 con 0x7f37b80c6380 2024-04-25T12:25:03.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.298+0000 7f37bdbe4640 1 --2- 172.21.15.94:0/1560209706 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37b80c6380 0x7f37b814b4f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f37a800e870 tx=0x7f37a800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:03.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.298+0000 7f37aeffd640 1 -- 172.21.15.94:0/1560209706 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a8017070 con 0x7f37b80c6380 2024-04-25T12:25:03.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.298+0000 7f37aeffd640 1 -- 172.21.15.94:0/1560209706 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37a800c940 con 0x7f37b80c6380 2024-04-25T12:25:03.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.298+0000 7f37c0649640 1 -- 172.21.15.94:0/1560209706 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37b81f4000 con 0x7f37b80c6380 2024-04-25T12:25:03.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.298+0000 7f37aeffd640 1 -- 172.21.15.94:0/1560209706 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a800cd10 con 0x7f37b80c6380 2024-04-25T12:25:03.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.298+0000 7f37c0649640 1 -- 172.21.15.94:0/1560209706 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37b81f45c0 con 0x7f37b80c6380 2024-04-25T12:25:03.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.298+0000 7f37c0649640 1 -- 172.21.15.94:0/1560209706 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f37b8075e60 con 0x7f37b80c6380 2024-04-25T12:25:03.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.298+0000 7f37aeffd640 1 -- 172.21.15.94:0/1560209706 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f37a801a070 con 0x7f37b80c6380 2024-04-25T12:25:03.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.302+0000 7f37aeffd640 1 --2- 172.21.15.94:0/1560209706 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f379c068380 0x7f379c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:03.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.302+0000 7f37be3e5640 1 --2- 172.21.15.94:0/1560209706 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f379c068380 0x7f379c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:03.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.302+0000 7f37aeffd640 1 -- 172.21.15.94:0/1560209706 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f37a8087050 con 0x7f37b80c6380 2024-04-25T12:25:03.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.302+0000 7f37aeffd640 1 --2- 172.21.15.94:0/1560209706 >> [v2:172.21.15.111:6800/558758517,v1:172.21.15.111:6801/558758517] conn(0x7f379c071d10 0x7f379c0741b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:03.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.302+0000 7f37aeffd640 1 -- 172.21.15.94:0/1560209706 --> [v2:172.21.15.111:6800/558758517,v1:172.21.15.111:6801/558758517] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f379c074880 con 0x7f379c071d10 2024-04-25T12:25:03.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.302+0000 7f37aeffd640 1 -- 172.21.15.94:0/1560209706 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f37a808e050 con 0x7f37b80c6380 2024-04-25T12:25:03.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.302+0000 7f37be3e5640 1 --2- 172.21.15.94:0/1560209706 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f379c068380 0x7f379c06a840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f37b4000f70 tx=0x7f37b4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:03.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.302+0000 7f37bebe6640 1 --2- 172.21.15.94:0/1560209706 >> [v2:172.21.15.111:6800/558758517,v1:172.21.15.111:6801/558758517] conn(0x7f379c071d10 0x7f379c0741b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:03.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.302+0000 7f37bebe6640 1 --2- 172.21.15.94:0/1560209706 >> [v2:172.21.15.111:6800/558758517,v1:172.21.15.111:6801/558758517] conn(0x7f379c071d10 0x7f379c0741b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:03.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.302+0000 7f37aeffd640 1 -- 172.21.15.94:0/1560209706 <== osd.7 v2:172.21.15.111:6800/558758517 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f379c074880 con 0x7f379c071d10 2024-04-25T12:25:03.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.318+0000 7f37c0649640 1 -- 172.21.15.94:0/1560209706 --> [v2:172.21.15.111:6800/558758517,v1:172.21.15.111:6801/558758517] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f37b8074140 con 0x7f379c071d10 2024-04-25T12:25:03.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.318+0000 7f37aeffd640 1 -- 172.21.15.94:0/1560209706 <== osd.7 v2:172.21.15.111:6800/558758517 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f37b8074140 con 0x7f379c071d10 2024-04-25T12:25:03.323 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-25T12:25:03.323 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T12:25:03.323 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-25T12:25:03.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.318+0000 7f37c0649640 1 -- 172.21.15.94:0/1560209706 >> [v2:172.21.15.111:6800/558758517,v1:172.21.15.111:6801/558758517] conn(0x7f379c071d10 msgr2=0x7f379c0741b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:03.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.318+0000 7f37c0649640 1 --2- 172.21.15.94:0/1560209706 >> [v2:172.21.15.111:6800/558758517,v1:172.21.15.111:6801/558758517] conn(0x7f379c071d10 0x7f379c0741b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.318+0000 7f37c0649640 1 -- 172.21.15.94:0/1560209706 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f379c068380 msgr2=0x7f379c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:03.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.318+0000 7f37c0649640 1 --2- 172.21.15.94:0/1560209706 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f379c068380 0x7f379c06a840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f37b4000f70 tx=0x7f37b4009040 comp rx=0 tx=0).stop 2024-04-25T12:25:03.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.318+0000 7f37c0649640 1 -- 172.21.15.94:0/1560209706 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37b80c6380 msgr2=0x7f37b814b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:03.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.318+0000 7f37c0649640 1 --2- 172.21.15.94:0/1560209706 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37b80c6380 0x7f37b814b4f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f37a800e870 tx=0x7f37a800ed30 comp rx=0 tx=0).stop 2024-04-25T12:25:03.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.318+0000 7f37bebe6640 1 -- 172.21.15.94:0/1560209706 reap_dead start 2024-04-25T12:25:03.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.318+0000 7f37c0649640 1 -- 172.21.15.94:0/1560209706 shutdown_connections 2024-04-25T12:25:03.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.318+0000 7f37c0649640 1 -- 172.21.15.94:0/1560209706 >> 172.21.15.94:0/1560209706 conn(0x7f37b80c9130 msgr2=0x7f37b8152fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:03.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.318+0000 7f37c0649640 1 -- 172.21.15.94:0/1560209706 shutdown_connections 2024-04-25T12:25:03.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.318+0000 7f37c0649640 1 -- 172.21.15.94:0/1560209706 wait complete. 2024-04-25T12:25:03.338 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T12:25:03.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.446+0000 7f5c5a241640 1 Processor -- start 2024-04-25T12:25:03.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.446+0000 7f5c5a241640 1 -- start start 2024-04-25T12:25:03.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.446+0000 7f5c5a241640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f5c54155300 0x7f5c540c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:03.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.446+0000 7f5c5a241640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c540c4e80 con 0x7f5c5415ee20 2024-04-25T12:25:03.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.446+0000 7f5c5a241640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c5415f320 con 0x7f5c5406f700 2024-04-25T12:25:03.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.446+0000 7f5c5a241640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f5c540c4230 con 0x7f5c54155300 2024-04-25T12:25:03.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.446+0000 7f5c53fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f5c5415ee20 0x7f5c540c6f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:44952/0 (socket says 172.21.15.94:44952) 2024-04-25T12:25:03.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.446+0000 7f5c53fff640 1 -- 172.21.15.94:0/3274700786 learned_addr learned my addr 172.21.15.94:0/3274700786 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:25:03.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.446+0000 7f5c537fe640 1 --2- 172.21.15.94:0/3274700786 >> v2:172.21.15.111:3300/0 conn(0x7f5c54155300 0x7f5c540c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:03.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.446+0000 7f5c527fc640 1 -- 172.21.15.94:0/3274700786 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3786873649 0 0) 0x7f5c540c4e80 con 0x7f5c5415ee20 2024-04-25T12:25:03.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.446+0000 7f5c527fc640 1 -- 172.21.15.94:0/3274700786 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c3c003530 con 0x7f5c5415ee20 2024-04-25T12:25:03.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.446+0000 7f5c527fc640 1 -- 172.21.15.94:0/3274700786 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3244881532 0 0) 0x7f5c3c003530 con 0x7f5c5415ee20 2024-04-25T12:25:03.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.446+0000 7f5c527fc640 1 -- 172.21.15.94:0/3274700786 >> v2:172.21.15.111:3300/0 conn(0x7f5c54155300 msgr2=0x7f5c540c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:03.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.446+0000 7f5c527fc640 1 --2- 172.21.15.94:0/3274700786 >> v2:172.21.15.111:3300/0 conn(0x7f5c54155300 0x7f5c540c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.446+0000 7f5c527fc640 1 -- 172.21.15.94:0/3274700786 >> v1:172.21.15.111:6789/0 conn(0x7f5c5406f700 legacy=0x7f5c5415e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:03.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.446+0000 7f5c527fc640 1 -- 172.21.15.94:0/3274700786 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c540c5120 con 0x7f5c5415ee20 2024-04-25T12:25:03.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.446+0000 7f5c527fc640 1 -- 172.21.15.94:0/3274700786 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4050934276 0 0) 0x7f5c44001a00 con 0x7f5c5415ee20 2024-04-25T12:25:03.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.446+0000 7f5c527fc640 1 -- 172.21.15.94:0/3274700786 >> v1:172.21.15.94:6789/0 conn(0x7f5c5415ee20 legacy=0x7f5c540c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:03.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.446+0000 7f5c527fc640 1 --2- 172.21.15.94:0/3274700786 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c3c0039c0 0x7f5c3c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:03.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.446+0000 7f5c527fc640 1 --2- 172.21.15.94:0/3274700786 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c3c004810 0x7f5c3c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:03.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.446+0000 7f5c527fc640 1 --2- 172.21.15.94:0/3274700786 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5c3c0051d0 0x7f5c3c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:03.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.446+0000 7f5c527fc640 1 -- 172.21.15.94:0/3274700786 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5c540c4230 con 0x7f5c3c004810 2024-04-25T12:25:03.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.446+0000 7f5c527fc640 1 -- 172.21.15.94:0/3274700786 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c00c070 con 0x7f5c3c0039c0 2024-04-25T12:25:03.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.446+0000 7f5c527fc640 1 -- 172.21.15.94:0/3274700786 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f5c3c00c270 con 0x7f5c3c0051d0 2024-04-25T12:25:03.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.446+0000 7f5c52ffd640 1 --2- 172.21.15.94:0/3274700786 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c3c004810 0x7f5c3c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:03.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.450+0000 7f5c537fe640 1 --2- 172.21.15.94:0/3274700786 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c3c0039c0 0x7f5c3c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:03.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.450+0000 7f5c53fff640 1 --2- 172.21.15.94:0/3274700786 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5c3c0051d0 0x7f5c3c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:03.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.450+0000 7f5c52ffd640 1 -- 172.21.15.94:0/3274700786 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5c3c0051d0 msgr2=0x7f5c3c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:03.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.450+0000 7f5c52ffd640 1 --2- 172.21.15.94:0/3274700786 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5c3c0051d0 0x7f5c3c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.450+0000 7f5c52ffd640 1 -- 172.21.15.94:0/3274700786 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c3c0039c0 msgr2=0x7f5c3c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:03.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.450+0000 7f5c52ffd640 1 --2- 172.21.15.94:0/3274700786 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c3c0039c0 0x7f5c3c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.450+0000 7f5c53fff640 1 -- 172.21.15.94:0/3274700786 reap_dead start 2024-04-25T12:25:03.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.450+0000 7f5c52ffd640 1 -- 172.21.15.94:0/3274700786 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3c003530 con 0x7f5c3c004810 2024-04-25T12:25:03.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.450+0000 7f5c537fe640 1 --2- 172.21.15.94:0/3274700786 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c3c0039c0 0x7f5c3c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:25:03.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.450+0000 7f5c52ffd640 1 --2- 172.21.15.94:0/3274700786 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c3c004810 0x7f5c3c004c90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5c48001780 tx=0x7f5c4801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56fd6b7cd343ec5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:03.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.450+0000 7f5c527fc640 1 -- 172.21.15.94:0/3274700786 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c480013a0 con 0x7f5c3c004810 2024-04-25T12:25:03.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.450+0000 7f5c527fc640 1 -- 172.21.15.94:0/3274700786 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c480052f0 con 0x7f5c3c004810 2024-04-25T12:25:03.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.450+0000 7f5c527fc640 1 -- 172.21.15.94:0/3274700786 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c48003840 con 0x7f5c3c004810 2024-04-25T12:25:03.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.450+0000 7f5c5a241640 1 -- 172.21.15.94:0/3274700786 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c3c004810 msgr2=0x7f5c3c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:03.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.450+0000 7f5c5a241640 1 --2- 172.21.15.94:0/3274700786 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c3c004810 0x7f5c3c004c90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5c48001780 tx=0x7f5c4801c400 comp rx=0 tx=0).stop 2024-04-25T12:25:03.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.450+0000 7f5c5a241640 1 -- 172.21.15.94:0/3274700786 shutdown_connections 2024-04-25T12:25:03.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.450+0000 7f5c5a241640 1 --2- 172.21.15.94:0/3274700786 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c3c004810 0x7f5c3c004c90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.450+0000 7f5c5a241640 1 -- 172.21.15.94:0/3274700786 >> 172.21.15.94:0/3274700786 conn(0x7f5c5406b9d0 msgr2=0x7f5c5406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:03.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.450+0000 7f5c5a241640 1 -- 172.21.15.94:0/3274700786 shutdown_connections 2024-04-25T12:25:03.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.450+0000 7f5c5a241640 1 -- 172.21.15.94:0/3274700786 wait complete. 2024-04-25T12:25:03.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c5a241640 1 Processor -- start 2024-04-25T12:25:03.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c5a241640 1 -- start start 2024-04-25T12:25:03.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c5a241640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5c3c004810 0x7f5c5414ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:03.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c5a241640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c5415e130 0x7f5c541591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:03.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c5a241640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c541f1060 0x7f5c541f14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:03.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c5a241640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5415f600 con 0x7f5c5415e130 2024-04-25T12:25:03.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c5a241640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5c540c5770 con 0x7f5c541f1060 2024-04-25T12:25:03.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c5a241640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f5c540681d0 con 0x7f5c3c004810 2024-04-25T12:25:03.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c52ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c5415e130 0x7f5c541591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:03.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c52ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c5415e130 0x7f5c541591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52706/0 (socket says 172.21.15.94:52706) 2024-04-25T12:25:03.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c52ffd640 1 -- 172.21.15.94:0/351712140 learned_addr learned my addr 172.21.15.94:0/351712140 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:03.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c537fe640 1 --2- 172.21.15.94:0/351712140 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5c3c004810 0x7f5c5414ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:03.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c53fff640 1 --2- 172.21.15.94:0/351712140 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c541f1060 0x7f5c541f14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:03.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c52ffd640 1 -- 172.21.15.94:0/351712140 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5c3c004810 msgr2=0x7f5c5414ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:03.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c52ffd640 1 --2- 172.21.15.94:0/351712140 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5c3c004810 0x7f5c5414ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c52ffd640 1 -- 172.21.15.94:0/351712140 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c541f1060 msgr2=0x7f5c541f14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:03.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c52ffd640 1 --2- 172.21.15.94:0/351712140 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c541f1060 0x7f5c541f14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c52ffd640 1 -- 172.21.15.94:0/351712140 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c5415e970 con 0x7f5c5415e130 2024-04-25T12:25:03.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c53fff640 1 --2- 172.21.15.94:0/351712140 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c541f1060 0x7f5c541f14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:25:03.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c52ffd640 1 --2- 172.21.15.94:0/351712140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c5415e130 0x7f5c541591d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5c48005040 tx=0x7f5c3c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:03.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c3bfff640 1 -- 172.21.15.94:0/351712140 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c480013a0 con 0x7f5c5415e130 2024-04-25T12:25:03.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c3bfff640 1 -- 172.21.15.94:0/351712140 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c480ba070 con 0x7f5c5415e130 2024-04-25T12:25:03.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c5a241640 1 -- 172.21.15.94:0/351712140 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c540cb3d0 con 0x7f5c5415e130 2024-04-25T12:25:03.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c3bfff640 1 -- 172.21.15.94:0/351712140 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c48007a40 con 0x7f5c5415e130 2024-04-25T12:25:03.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c5a241640 1 -- 172.21.15.94:0/351712140 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c540cb990 con 0x7f5c5415e130 2024-04-25T12:25:03.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c5a241640 1 -- 172.21.15.94:0/351712140 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c54075df0 con 0x7f5c5415e130 2024-04-25T12:25:03.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c3bfff640 1 -- 172.21.15.94:0/351712140 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5c48007470 con 0x7f5c5415e130 2024-04-25T12:25:03.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c3bfff640 1 --2- 172.21.15.94:0/351712140 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5c40068380 0x7f5c4006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:03.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c3bfff640 1 -- 172.21.15.94:0/351712140 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f5c48121080 con 0x7f5c5415e130 2024-04-25T12:25:03.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.454+0000 7f5c537fe640 1 --2- 172.21.15.94:0/351712140 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5c40068380 0x7f5c4006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:03.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.458+0000 7f5c537fe640 1 --2- 172.21.15.94:0/351712140 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5c40068380 0x7f5c4006a840 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5c54069360 tx=0x7f5c4c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:03.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.458+0000 7f5c3bfff640 1 -- 172.21.15.94:0/351712140 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5c48016110 con 0x7f5c5415e130 2024-04-25T12:25:03.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.610+0000 7f5c5a241640 1 -- 172.21.15.94:0/351712140 --> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f5c5406c4f0 con 0x7f5c40068380 2024-04-25T12:25:03.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.610+0000 7f5c3bfff640 1 -- 172.21.15.94:0/351712140 <== mgr.4101 v2:172.21.15.94:6832/549402167 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5c5406c4f0 con 0x7f5c40068380 2024-04-25T12:25:03.617 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T12:25:03.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.614+0000 7f5c5a241640 1 -- 172.21.15.94:0/351712140 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5c40068380 msgr2=0x7f5c4006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:03.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.614+0000 7f5c5a241640 1 --2- 172.21.15.94:0/351712140 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5c40068380 0x7f5c4006a840 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5c54069360 tx=0x7f5c4c008040 comp rx=0 tx=0).stop 2024-04-25T12:25:03.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.614+0000 7f5c5a241640 1 -- 172.21.15.94:0/351712140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c5415e130 msgr2=0x7f5c541591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:03.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.614+0000 7f5c5a241640 1 --2- 172.21.15.94:0/351712140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c5415e130 0x7f5c541591d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5c48005040 tx=0x7f5c3c005840 comp rx=0 tx=0).stop 2024-04-25T12:25:03.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.614+0000 7f5c5a241640 1 -- 172.21.15.94:0/351712140 shutdown_connections 2024-04-25T12:25:03.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.614+0000 7f5c5a241640 1 --2- 172.21.15.94:0/351712140 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5c40068380 0x7f5c4006a840 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.614+0000 7f5c5a241640 1 --2- 172.21.15.94:0/351712140 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c541f1060 0x7f5c541f14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.614+0000 7f5c5a241640 1 --2- 172.21.15.94:0/351712140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c5415e130 0x7f5c541591d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.614+0000 7f5c5a241640 1 --2- 172.21.15.94:0/351712140 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5c3c004810 0x7f5c5414ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.614+0000 7f5c5a241640 1 -- 172.21.15.94:0/351712140 >> 172.21.15.94:0/351712140 conn(0x7f5c5406b9d0 msgr2=0x7f5c5406bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:03.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.614+0000 7f5c5a241640 1 -- 172.21.15.94:0/351712140 shutdown_connections 2024-04-25T12:25:03.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.614+0000 7f5c5a241640 1 -- 172.21.15.94:0/351712140 wait complete. 2024-04-25T12:25:03.635 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:25:03.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.746+0000 7f254045f640 1 Processor -- start 2024-04-25T12:25:03.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.750+0000 7f254045f640 1 -- start start 2024-04-25T12:25:03.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.750+0000 7f254045f640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f253814fbc0 0x7f253806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:03.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.750+0000 7f254045f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2538074100 0x7f25380c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:03.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.750+0000 7f254045f640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25380c5d70 con 0x7f253814ffa0 2024-04-25T12:25:03.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.750+0000 7f254045f640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f25380c6050 con 0x7f2538074100 2024-04-25T12:25:03.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.750+0000 7f254045f640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f25380c6330 con 0x7f253814fbc0 2024-04-25T12:25:03.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.750+0000 7f253e9fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2538074100 0x7f25380c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:03.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.750+0000 7f253e9fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2538074100 0x7f25380c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52716/0 (socket says 172.21.15.94:52716) 2024-04-25T12:25:03.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.750+0000 7f253e9fc640 1 -- 172.21.15.94:0/22710548 learned_addr learned my addr 172.21.15.94:0/22710548 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:03.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.750+0000 7f253e1fb640 1 --2- 172.21.15.94:0/22710548 >> v2:172.21.15.111:3300/0 conn(0x7f253814fbc0 0x7f253806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:03.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.750+0000 7f253e9fc640 1 -- 172.21.15.94:0/22710548 >> v2:172.21.15.111:3300/0 conn(0x7f253814fbc0 msgr2=0x7f253806f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:03.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.750+0000 7f253e9fc640 1 --2- 172.21.15.94:0/22710548 >> v2:172.21.15.111:3300/0 conn(0x7f253814fbc0 0x7f253806f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.750+0000 7f253e9fc640 1 -- 172.21.15.94:0/22710548 >> v1:172.21.15.111:6789/0 conn(0x7f253814ffa0 legacy=0x7f25380c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:03.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.750+0000 7f253e9fc640 1 -- 172.21.15.94:0/22710548 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25380c6610 con 0x7f2538074100 2024-04-25T12:25:03.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.750+0000 7f253e1fb640 1 --2- 172.21.15.94:0/22710548 >> v2:172.21.15.111:3300/0 conn(0x7f253814fbc0 0x7f253806f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:25:03.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f253e9fc640 1 --2- 172.21.15.94:0/22710548 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2538074100 0x7f25380c7250 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2530009870 tx=0x7f253001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d5e9659a462b01 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:03.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f253d1f9640 1 -- 172.21.15.94:0/22710548 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25300a9400 con 0x7f2538074100 2024-04-25T12:25:03.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f253d1f9640 1 -- 172.21.15.94:0/22710548 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25300a95a0 con 0x7f2538074100 2024-04-25T12:25:03.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f253d1f9640 1 -- 172.21.15.94:0/22710548 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25300a9970 con 0x7f2538074100 2024-04-25T12:25:03.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f254045f640 1 -- 172.21.15.94:0/22710548 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2538074100 msgr2=0x7f25380c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:03.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f254045f640 1 --2- 172.21.15.94:0/22710548 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2538074100 0x7f25380c7250 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2530009870 tx=0x7f253001c520 comp rx=0 tx=0).stop 2024-04-25T12:25:03.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f254045f640 1 -- 172.21.15.94:0/22710548 shutdown_connections 2024-04-25T12:25:03.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f254045f640 1 --2- 172.21.15.94:0/22710548 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2538074100 0x7f25380c7250 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f254045f640 1 --2- 172.21.15.94:0/22710548 >> v2:172.21.15.111:3300/0 conn(0x7f253814fbc0 0x7f253806f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f254045f640 1 -- 172.21.15.94:0/22710548 >> 172.21.15.94:0/22710548 conn(0x7f253806b9d0 msgr2=0x7f253806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:03.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f254045f640 1 -- 172.21.15.94:0/22710548 shutdown_connections 2024-04-25T12:25:03.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f254045f640 1 -- 172.21.15.94:0/22710548 wait complete. 2024-04-25T12:25:03.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f254045f640 1 Processor -- start 2024-04-25T12:25:03.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f254045f640 1 -- start start 2024-04-25T12:25:03.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f254045f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2538074100 0x7f25381f2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:03.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f254045f640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f253814fbc0 0x7f253814c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:03.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f254045f640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f253814ffa0 0x7f253814cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:03.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f254045f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f25380c8ab0 con 0x7f2538074100 2024-04-25T12:25:03.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f254045f640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f25380c8930 con 0x7f253814fbc0 2024-04-25T12:25:03.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f254045f640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2538166090 con 0x7f253814ffa0 2024-04-25T12:25:03.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f253e1fb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2538074100 0x7f25381f2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:03.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f253e1fb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2538074100 0x7f25381f2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52718/0 (socket says 172.21.15.94:52718) 2024-04-25T12:25:03.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f253e1fb640 1 -- 172.21.15.94:0/3065651292 learned_addr learned my addr 172.21.15.94:0/3065651292 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:03.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f253d9fa640 1 --2- 172.21.15.94:0/3065651292 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f253814fbc0 0x7f253814c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:03.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f253e1fb640 1 -- 172.21.15.94:0/3065651292 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f253814ffa0 msgr2=0x7f253814cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:03.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f253e9fc640 1 --2- 172.21.15.94:0/3065651292 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f253814ffa0 0x7f253814cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:03.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f253e1fb640 1 --2- 172.21.15.94:0/3065651292 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f253814ffa0 0x7f253814cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f253e1fb640 1 -- 172.21.15.94:0/3065651292 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f253814fbc0 msgr2=0x7f253814c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:03.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f253e1fb640 1 --2- 172.21.15.94:0/3065651292 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f253814fbc0 0x7f253814c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.754+0000 7f253e1fb640 1 -- 172.21.15.94:0/3065651292 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253814a3b0 con 0x7f2538074100 2024-04-25T12:25:03.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.758+0000 7f253e1fb640 1 --2- 172.21.15.94:0/3065651292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2538074100 0x7f25381f2c40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2534007fa0 tx=0x7f253400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:03.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.758+0000 7f252effd640 1 -- 172.21.15.94:0/3065651292 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253401a070 con 0x7f2538074100 2024-04-25T12:25:03.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.758+0000 7f252effd640 1 -- 172.21.15.94:0/3065651292 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2534003ba0 con 0x7f2538074100 2024-04-25T12:25:03.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.758+0000 7f254045f640 1 -- 172.21.15.94:0/3065651292 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f253814a690 con 0x7f2538074100 2024-04-25T12:25:03.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.758+0000 7f252effd640 1 -- 172.21.15.94:0/3065651292 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2534004030 con 0x7f2538074100 2024-04-25T12:25:03.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.758+0000 7f254045f640 1 -- 172.21.15.94:0/3065651292 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2538140f40 con 0x7f2538074100 2024-04-25T12:25:03.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.758+0000 7f254045f640 1 -- 172.21.15.94:0/3065651292 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2538075df0 con 0x7f2538074100 2024-04-25T12:25:03.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.758+0000 7f252effd640 1 -- 172.21.15.94:0/3065651292 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f253401d070 con 0x7f2538074100 2024-04-25T12:25:03.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.758+0000 7f252effd640 1 --2- 172.21.15.94:0/3065651292 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f251c068380 0x7f251c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:03.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.758+0000 7f252effd640 1 -- 172.21.15.94:0/3065651292 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f2534087100 con 0x7f2538074100 2024-04-25T12:25:03.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.758+0000 7f253d9fa640 1 --2- 172.21.15.94:0/3065651292 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f251c068380 0x7f251c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:03.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.758+0000 7f253d9fa640 1 --2- 172.21.15.94:0/3065651292 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f251c068380 0x7f251c06a840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2538163840 tx=0x7f2528009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:03.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.762+0000 7f252effd640 1 -- 172.21.15.94:0/3065651292 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2534010070 con 0x7f2538074100 2024-04-25T12:25:03.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.922+0000 7f254045f640 1 -- 172.21.15.94:0/3065651292 --> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2538149c50 con 0x7f251c068380 2024-04-25T12:25:03.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.934+0000 7f252effd640 1 -- 172.21.15.94:0/3065651292 <== mgr.4101 v2:172.21.15.94:6832/549402167 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332692 (secure 0 0 0) 0x7f2538149c50 con 0x7f251c068380 2024-04-25T12:25:03.941 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:25:03.943 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-04-25T12:25:03.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.938+0000 7f254045f640 1 -- 172.21.15.94:0/3065651292 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f251c068380 msgr2=0x7f251c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:03.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.938+0000 7f254045f640 1 --2- 172.21.15.94:0/3065651292 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f251c068380 0x7f251c06a840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2538163840 tx=0x7f2528009040 comp rx=0 tx=0).stop 2024-04-25T12:25:03.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.938+0000 7f254045f640 1 -- 172.21.15.94:0/3065651292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2538074100 msgr2=0x7f25381f2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:03.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.938+0000 7f254045f640 1 --2- 172.21.15.94:0/3065651292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2538074100 0x7f25381f2c40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2534007fa0 tx=0x7f253400d560 comp rx=0 tx=0).stop 2024-04-25T12:25:03.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.938+0000 7f254045f640 1 -- 172.21.15.94:0/3065651292 shutdown_connections 2024-04-25T12:25:03.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.938+0000 7f254045f640 1 --2- 172.21.15.94:0/3065651292 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f251c068380 0x7f251c06a840 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.938+0000 7f254045f640 1 --2- 172.21.15.94:0/3065651292 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f253814ffa0 0x7f253814cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.938+0000 7f254045f640 1 --2- 172.21.15.94:0/3065651292 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f253814fbc0 0x7f253814c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.938+0000 7f254045f640 1 --2- 172.21.15.94:0/3065651292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2538074100 0x7f25381f2c40 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:03.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.938+0000 7f254045f640 1 -- 172.21.15.94:0/3065651292 >> 172.21.15.94:0/3065651292 conn(0x7f253806b9d0 msgr2=0x7f253806e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:03.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.938+0000 7f254045f640 1 -- 172.21.15.94:0/3065651292 shutdown_connections 2024-04-25T12:25:03.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:03.938+0000 7f254045f640 1 -- 172.21.15.94:0/3065651292 wait complete. 2024-04-25T12:25:03.958 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2024-04-25T12:25:03.818795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602960,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":380,"num_write_kb":2495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":312,"ondisk_log_size":312,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236456,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738264,"statfs":{"total":773094113280,"available":772851982336,"internally_reserved":0,"allocated":3776512,"data_stored":2164480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2328,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003948"},"pg_stats":[{"pgid":"2.1f","version":"28'13","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.915197+0000","last_change":"2024-04-25T12:21:53.194776+0000","last_active":"2024-04-25T12:24:43.915197+0000","last_peered":"2024-04-25T12:24:43.915197+0000","last_clean":"2024-04-25T12:24:43.915197+0000","last_became_active":"2024-04-25T12:21:53.194480+0000","last_became_peered":"2024-04-25T12:21:53.194480+0000","last_unstale":"2024-04-25T12:24:43.915197+0000","last_undegraded":"2024-04-25T12:24:43.915197+0000","last_fullsized":"2024-04-25T12:24:43.915197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:52.906255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979743+0000","last_change":"2024-04-25T12:21:54.200481+0000","last_active":"2024-04-25T12:22:34.979743+0000","last_peered":"2024-04-25T12:22:34.979743+0000","last_clean":"2024-04-25T12:22:34.979743+0000","last_became_active":"2024-04-25T12:21:54.199679+0000","last_became_peered":"2024-04-25T12:21:54.199679+0000","last_unstale":"2024-04-25T12:22:34.979743+0000","last_undegraded":"2024-04-25T12:22:34.979743+0000","last_fullsized":"2024-04-25T12:22:34.979743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:59.395265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978348+0000","last_change":"2024-04-25T12:21:58.346732+0000","last_active":"2024-04-25T12:22:34.978348+0000","last_peered":"2024-04-25T12:22:34.978348+0000","last_clean":"2024-04-25T12:22:34.978348+0000","last_became_active":"2024-04-25T12:21:58.346337+0000","last_became_peered":"2024-04-25T12:21:58.346337+0000","last_unstale":"2024-04-25T12:22:34.978348+0000","last_undegraded":"2024-04-25T12:22:34.978348+0000","last_fullsized":"2024-04-25T12:22:34.978348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:20.028661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:23:54.774933+0000","last_change":"2024-04-25T12:21:53.166281+0000","last_active":"2024-04-25T12:23:54.774933+0000","last_peered":"2024-04-25T12:23:54.774933+0000","last_clean":"2024-04-25T12:23:54.774933+0000","last_became_active":"2024-04-25T12:21:53.165990+0000","last_became_peered":"2024-04-25T12:21:53.165990+0000","last_unstale":"2024-04-25T12:23:54.774933+0000","last_undegraded":"2024-04-25T12:23:54.774933+0000","last_fullsized":"2024-04-25T12:23:54.774933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:07.228743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916094+0000","last_change":"2024-04-25T12:21:54.189754+0000","last_active":"2024-04-25T12:22:34.916094+0000","last_peered":"2024-04-25T12:22:34.916094+0000","last_clean":"2024-04-25T12:22:34.916094+0000","last_became_active":"2024-04-25T12:21:54.188987+0000","last_became_peered":"2024-04-25T12:21:54.188987+0000","last_unstale":"2024-04-25T12:22:34.916094+0000","last_undegraded":"2024-04-25T12:22:34.916094+0000","last_fullsized":"2024-04-25T12:22:34.916094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:29.603368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.892805+0000","last_change":"2024-04-25T12:21:58.251628+0000","last_active":"2024-04-25T12:22:34.892805+0000","last_peered":"2024-04-25T12:22:34.892805+0000","last_clean":"2024-04-25T12:22:34.892805+0000","last_became_active":"2024-04-25T12:21:58.250542+0000","last_became_peered":"2024-04-25T12:21:58.250542+0000","last_unstale":"2024-04-25T12:22:34.892805+0000","last_undegraded":"2024-04-25T12:22:34.892805+0000","last_fullsized":"2024-04-25T12:22:34.892805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:33.434685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'12","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.918854+0000","last_change":"2024-04-25T12:21:53.203427+0000","last_active":"2024-04-25T12:24:43.918854+0000","last_peered":"2024-04-25T12:24:43.918854+0000","last_clean":"2024-04-25T12:24:43.918854+0000","last_became_active":"2024-04-25T12:21:53.202760+0000","last_became_peered":"2024-04-25T12:21:53.202760+0000","last_unstale":"2024-04-25T12:24:43.918854+0000","last_undegraded":"2024-04-25T12:24:43.918854+0000","last_fullsized":"2024-04-25T12:24:43.918854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:44.397450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887718+0000","last_change":"2024-04-25T12:21:54.208420+0000","last_active":"2024-04-25T12:22:34.887718+0000","last_peered":"2024-04-25T12:22:34.887718+0000","last_clean":"2024-04-25T12:22:34.887718+0000","last_became_active":"2024-04-25T12:21:54.208093+0000","last_became_peered":"2024-04-25T12:21:54.208093+0000","last_unstale":"2024-04-25T12:22:34.887718+0000","last_undegraded":"2024-04-25T12:22:34.887718+0000","last_fullsized":"2024-04-25T12:22:34.887718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:08.762268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893123+0000","last_change":"2024-04-25T12:21:58.255963+0000","last_active":"2024-04-25T12:22:34.893123+0000","last_peered":"2024-04-25T12:22:34.893123+0000","last_clean":"2024-04-25T12:22:34.893123+0000","last_became_active":"2024-04-25T12:21:58.254021+0000","last_became_peered":"2024-04-25T12:21:58.254021+0000","last_unstale":"2024-04-25T12:22:34.893123+0000","last_undegraded":"2024-04-25T12:22:34.893123+0000","last_fullsized":"2024-04-25T12:22:34.893123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:20.528034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.916352+0000","last_change":"2024-04-25T12:21:53.208470+0000","last_active":"2024-04-25T12:24:43.916352+0000","last_peered":"2024-04-25T12:24:43.916352+0000","last_clean":"2024-04-25T12:24:43.916352+0000","last_became_active":"2024-04-25T12:21:53.207929+0000","last_became_peered":"2024-04-25T12:21:53.207929+0000","last_unstale":"2024-04-25T12:24:43.916352+0000","last_undegraded":"2024-04-25T12:24:43.916352+0000","last_fullsized":"2024-04-25T12:24:43.916352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:14.904832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887684+0000","last_change":"2024-04-25T12:21:54.206567+0000","last_active":"2024-04-25T12:22:34.887684+0000","last_peered":"2024-04-25T12:22:34.887684+0000","last_clean":"2024-04-25T12:22:34.887684+0000","last_became_active":"2024-04-25T12:21:54.206138+0000","last_became_peered":"2024-04-25T12:21:54.206138+0000","last_unstale":"2024-04-25T12:22:34.887684+0000","last_undegraded":"2024-04-25T12:22:34.887684+0000","last_fullsized":"2024-04-25T12:22:34.887684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:31.698845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893399+0000","last_change":"2024-04-25T12:21:58.245331+0000","last_active":"2024-04-25T12:22:34.893399+0000","last_peered":"2024-04-25T12:22:34.893399+0000","last_clean":"2024-04-25T12:22:34.893399+0000","last_became_active":"2024-04-25T12:21:58.244313+0000","last_became_peered":"2024-04-25T12:21:58.244313+0000","last_unstale":"2024-04-25T12:22:34.893399+0000","last_undegraded":"2024-04-25T12:22:34.893399+0000","last_fullsized":"2024-04-25T12:22:34.893399+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:21.595492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029274+0000","last_change":"2024-04-25T12:21:54.208935+0000","last_active":"2024-04-25T12:22:35.029274+0000","last_peered":"2024-04-25T12:22:35.029274+0000","last_clean":"2024-04-25T12:22:35.029274+0000","last_became_active":"2024-04-25T12:21:54.208338+0000","last_became_peered":"2024-04-25T12:21:54.208338+0000","last_unstale":"2024-04-25T12:22:35.029274+0000","last_undegraded":"2024-04-25T12:22:35.029274+0000","last_fullsized":"2024-04-25T12:22:35.029274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:08.485037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:25.185372+0000","last_change":"2024-04-25T12:21:53.203519+0000","last_active":"2024-04-25T12:24:25.185372+0000","last_peered":"2024-04-25T12:24:25.185372+0000","last_clean":"2024-04-25T12:24:25.185372+0000","last_became_active":"2024-04-25T12:21:53.197141+0000","last_became_peered":"2024-04-25T12:21:53.197141+0000","last_unstale":"2024-04-25T12:24:25.185372+0000","last_undegraded":"2024-04-25T12:24:25.185372+0000","last_fullsized":"2024-04-25T12:24:25.185372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:03.010472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894179+0000","last_change":"2024-04-25T12:21:58.250871+0000","last_active":"2024-04-25T12:22:34.894179+0000","last_peered":"2024-04-25T12:22:34.894179+0000","last_clean":"2024-04-25T12:22:34.894179+0000","last_became_active":"2024-04-25T12:21:58.249079+0000","last_became_peered":"2024-04-25T12:21:58.249079+0000","last_unstale":"2024-04-25T12:22:34.894179+0000","last_undegraded":"2024-04-25T12:22:34.894179+0000","last_fullsized":"2024-04-25T12:22:34.894179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:54.201824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978908+0000","last_change":"2024-04-25T12:21:54.209195+0000","last_active":"2024-04-25T12:22:34.978908+0000","last_peered":"2024-04-25T12:22:34.978908+0000","last_clean":"2024-04-25T12:22:34.978908+0000","last_became_active":"2024-04-25T12:21:54.208802+0000","last_became_peered":"2024-04-25T12:21:54.208802+0000","last_unstale":"2024-04-25T12:22:34.978908+0000","last_undegraded":"2024-04-25T12:22:34.978908+0000","last_fullsized":"2024-04-25T12:22:34.978908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:10.846624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.892354+0000","last_change":"2024-04-25T12:21:53.165498+0000","last_active":"2024-04-25T12:24:37.892354+0000","last_peered":"2024-04-25T12:24:37.892354+0000","last_clean":"2024-04-25T12:24:37.892354+0000","last_became_active":"2024-04-25T12:21:53.164867+0000","last_became_peered":"2024-04-25T12:21:53.164867+0000","last_unstale":"2024-04-25T12:24:37.892354+0000","last_undegraded":"2024-04-25T12:24:37.892354+0000","last_fullsized":"2024-04-25T12:24:37.892354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:07.312761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893517+0000","last_change":"2024-04-25T12:21:58.260620+0000","last_active":"2024-04-25T12:22:34.893517+0000","last_peered":"2024-04-25T12:22:34.893517+0000","last_clean":"2024-04-25T12:22:34.893517+0000","last_became_active":"2024-04-25T12:21:58.259595+0000","last_became_peered":"2024-04-25T12:21:58.259595+0000","last_unstale":"2024-04-25T12:22:34.893517+0000","last_undegraded":"2024-04-25T12:22:34.893517+0000","last_fullsized":"2024-04-25T12:22:34.893517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:43.230479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979100+0000","last_change":"2024-04-25T12:21:54.206960+0000","last_active":"2024-04-25T12:22:34.979100+0000","last_peered":"2024-04-25T12:22:34.979100+0000","last_clean":"2024-04-25T12:22:34.979100+0000","last_became_active":"2024-04-25T12:21:54.204650+0000","last_became_peered":"2024-04-25T12:21:54.204650+0000","last_unstale":"2024-04-25T12:22:34.979100+0000","last_undegraded":"2024-04-25T12:22:34.979100+0000","last_fullsized":"2024-04-25T12:22:34.979100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:15.888865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'7","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.916785+0000","last_change":"2024-04-25T12:21:53.193797+0000","last_active":"2024-04-25T12:24:43.916785+0000","last_peered":"2024-04-25T12:24:43.916785+0000","last_clean":"2024-04-25T12:24:43.916785+0000","last_became_active":"2024-04-25T12:21:53.193466+0000","last_became_peered":"2024-04-25T12:21:53.193466+0000","last_unstale":"2024-04-25T12:24:43.916785+0000","last_undegraded":"2024-04-25T12:24:43.916785+0000","last_fullsized":"2024-04-25T12:24:43.916785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:23.341451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292912+0000","last_change":"2024-04-25T12:21:58.348047+0000","last_active":"2024-04-25T12:22:35.292912+0000","last_peered":"2024-04-25T12:22:35.292912+0000","last_clean":"2024-04-25T12:22:35.292912+0000","last_became_active":"2024-04-25T12:21:58.347583+0000","last_became_peered":"2024-04-25T12:21:58.347583+0000","last_unstale":"2024-04-25T12:22:35.292912+0000","last_undegraded":"2024-04-25T12:22:35.292912+0000","last_fullsized":"2024-04-25T12:22:35.292912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:21:48.878907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894218+0000","last_change":"2024-04-25T12:21:54.196479+0000","last_active":"2024-04-25T12:22:34.894218+0000","last_peered":"2024-04-25T12:22:34.894218+0000","last_clean":"2024-04-25T12:22:34.894218+0000","last_became_active":"2024-04-25T12:21:54.195939+0000","last_became_peered":"2024-04-25T12:21:54.195939+0000","last_unstale":"2024-04-25T12:22:34.894218+0000","last_undegraded":"2024-04-25T12:22:34.894218+0000","last_fullsized":"2024-04-25T12:22:34.894218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:17.787145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:25.185667+0000","last_change":"2024-04-25T12:21:53.198034+0000","last_active":"2024-04-25T12:24:25.185667+0000","last_peered":"2024-04-25T12:24:25.185667+0000","last_clean":"2024-04-25T12:24:25.185667+0000","last_became_active":"2024-04-25T12:21:53.196252+0000","last_became_peered":"2024-04-25T12:21:53.196252+0000","last_unstale":"2024-04-25T12:24:25.185667+0000","last_undegraded":"2024-04-25T12:24:25.185667+0000","last_fullsized":"2024-04-25T12:24:25.185667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:08.329111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.033926+0000","last_change":"2024-04-25T12:22:35.032802+0000","last_active":"2024-04-25T12:22:35.033926+0000","last_peered":"2024-04-25T12:22:35.033926+0000","last_clean":"2024-04-25T12:22:35.033926+0000","last_became_active":"2024-04-25T12:22:35.031906+0000","last_became_peered":"2024-04-25T12:22:35.031906+0000","last_unstale":"2024-04-25T12:22:35.033926+0000","last_undegraded":"2024-04-25T12:22:35.033926+0000","last_fullsized":"2024-04-25T12:22:35.033926+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:40.346041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916736+0000","last_change":"2024-04-25T12:21:54.192601+0000","last_active":"2024-04-25T12:22:34.916736+0000","last_peered":"2024-04-25T12:22:34.916736+0000","last_clean":"2024-04-25T12:22:34.916736+0000","last_became_active":"2024-04-25T12:21:54.191864+0000","last_became_peered":"2024-04-25T12:21:54.191864+0000","last_unstale":"2024-04-25T12:22:34.916736+0000","last_undegraded":"2024-04-25T12:22:34.916736+0000","last_fullsized":"2024-04-25T12:22:34.916736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:50.392769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.916643+0000","last_change":"2024-04-25T12:21:53.197793+0000","last_active":"2024-04-25T12:24:43.916643+0000","last_peered":"2024-04-25T12:24:43.916643+0000","last_clean":"2024-04-25T12:24:43.916643+0000","last_became_active":"2024-04-25T12:21:53.197059+0000","last_became_peered":"2024-04-25T12:21:53.197059+0000","last_unstale":"2024-04-25T12:24:43.916643+0000","last_undegraded":"2024-04-25T12:24:43.916643+0000","last_fullsized":"2024-04-25T12:24:43.916643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:58.471408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893581+0000","last_change":"2024-04-25T12:21:58.355166+0000","last_active":"2024-04-25T12:22:34.893581+0000","last_peered":"2024-04-25T12:22:34.893581+0000","last_clean":"2024-04-25T12:22:34.893581+0000","last_became_active":"2024-04-25T12:21:58.353996+0000","last_became_peered":"2024-04-25T12:21:58.353996+0000","last_unstale":"2024-04-25T12:22:34.893581+0000","last_undegraded":"2024-04-25T12:22:34.893581+0000","last_fullsized":"2024-04-25T12:22:34.893581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:22.681720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980643+0000","last_change":"2024-04-25T12:21:54.219182+0000","last_active":"2024-04-25T12:22:34.980643+0000","last_peered":"2024-04-25T12:22:34.980643+0000","last_clean":"2024-04-25T12:22:34.980643+0000","last_became_active":"2024-04-25T12:21:54.218854+0000","last_became_peered":"2024-04-25T12:21:54.218854+0000","last_unstale":"2024-04-25T12:22:34.980643+0000","last_undegraded":"2024-04-25T12:22:34.980643+0000","last_fullsized":"2024-04-25T12:22:34.980643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:08.985962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'7","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.900945+0000","last_change":"2024-04-25T12:21:53.190102+0000","last_active":"2024-04-25T12:24:37.900945+0000","last_peered":"2024-04-25T12:24:37.900945+0000","last_clean":"2024-04-25T12:24:37.900945+0000","last_became_active":"2024-04-25T12:21:53.189781+0000","last_became_peered":"2024-04-25T12:21:53.189781+0000","last_unstale":"2024-04-25T12:24:37.900945+0000","last_undegraded":"2024-04-25T12:24:37.900945+0000","last_fullsized":"2024-04-25T12:24:37.900945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:52.533217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978106+0000","last_change":"2024-04-25T12:21:58.341932+0000","last_active":"2024-04-25T12:22:34.978106+0000","last_peered":"2024-04-25T12:22:34.978106+0000","last_clean":"2024-04-25T12:22:34.978106+0000","last_became_active":"2024-04-25T12:21:58.341492+0000","last_became_peered":"2024-04-25T12:21:58.341492+0000","last_unstale":"2024-04-25T12:22:34.978106+0000","last_undegraded":"2024-04-25T12:22:34.978106+0000","last_fullsized":"2024-04-25T12:22:34.978106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:51.576036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293382+0000","last_change":"2024-04-25T12:21:54.182541+0000","last_active":"2024-04-25T12:22:35.293382+0000","last_peered":"2024-04-25T12:22:35.293382+0000","last_clean":"2024-04-25T12:22:35.293382+0000","last_became_active":"2024-04-25T12:21:54.181720+0000","last_became_peered":"2024-04-25T12:21:54.181720+0000","last_unstale":"2024-04-25T12:22:35.293382+0000","last_undegraded":"2024-04-25T12:22:35.293382+0000","last_fullsized":"2024-04-25T12:22:35.293382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:00.544076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.893209+0000","last_change":"2024-04-25T12:21:53.200521+0000","last_active":"2024-04-25T12:24:37.893209+0000","last_peered":"2024-04-25T12:24:37.893209+0000","last_clean":"2024-04-25T12:24:37.893209+0000","last_became_active":"2024-04-25T12:21:53.196102+0000","last_became_peered":"2024-04-25T12:21:53.196102+0000","last_unstale":"2024-04-25T12:24:37.893209+0000","last_undegraded":"2024-04-25T12:24:37.893209+0000","last_fullsized":"2024-04-25T12:24:37.893209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:54.350452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916195+0000","last_change":"2024-04-25T12:21:58.342064+0000","last_active":"2024-04-25T12:22:34.916195+0000","last_peered":"2024-04-25T12:22:34.916195+0000","last_clean":"2024-04-25T12:22:34.916195+0000","last_became_active":"2024-04-25T12:21:58.341558+0000","last_became_peered":"2024-04-25T12:21:58.341558+0000","last_unstale":"2024-04-25T12:22:34.916195+0000","last_undegraded":"2024-04-25T12:22:34.916195+0000","last_fullsized":"2024-04-25T12:22:34.916195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:11.378767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887849+0000","last_change":"2024-04-25T12:21:54.206427+0000","last_active":"2024-04-25T12:22:34.887849+0000","last_peered":"2024-04-25T12:22:34.887849+0000","last_clean":"2024-04-25T12:22:34.887849+0000","last_became_active":"2024-04-25T12:21:54.205519+0000","last_became_peered":"2024-04-25T12:21:54.205519+0000","last_unstale":"2024-04-25T12:22:34.887849+0000","last_undegraded":"2024-04-25T12:22:34.887849+0000","last_fullsized":"2024-04-25T12:22:34.887849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:59.659460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:23:59.776320+0000","last_change":"2024-04-25T12:21:53.162914+0000","last_active":"2024-04-25T12:23:59.776320+0000","last_peered":"2024-04-25T12:23:59.776320+0000","last_clean":"2024-04-25T12:23:59.776320+0000","last_became_active":"2024-04-25T12:21:53.162599+0000","last_became_peered":"2024-04-25T12:21:53.162599+0000","last_unstale":"2024-04-25T12:23:59.776320+0000","last_undegraded":"2024-04-25T12:23:59.776320+0000","last_fullsized":"2024-04-25T12:23:59.776320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:23.448280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.920456+0000","last_change":"2024-04-25T12:22:34.919463+0000","last_active":"2024-04-25T12:22:34.920456+0000","last_peered":"2024-04-25T12:22:34.920456+0000","last_clean":"2024-04-25T12:22:34.920456+0000","last_became_active":"2024-04-25T12:22:34.917798+0000","last_became_peered":"2024-04-25T12:22:34.917798+0000","last_unstale":"2024-04-25T12:22:34.920456+0000","last_undegraded":"2024-04-25T12:22:34.920456+0000","last_fullsized":"2024-04-25T12:22:34.920456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:35.620229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894822+0000","last_change":"2024-04-25T12:21:54.202462+0000","last_active":"2024-04-25T12:22:34.894822+0000","last_peered":"2024-04-25T12:22:34.894822+0000","last_clean":"2024-04-25T12:22:34.894822+0000","last_became_active":"2024-04-25T12:21:54.202112+0000","last_became_peered":"2024-04-25T12:21:54.202112+0000","last_unstale":"2024-04-25T12:22:34.894822+0000","last_undegraded":"2024-04-25T12:22:34.894822+0000","last_fullsized":"2024-04-25T12:22:34.894822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:20.813264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.916490+0000","last_change":"2024-04-25T12:21:53.188606+0000","last_active":"2024-04-25T12:24:43.916490+0000","last_peered":"2024-04-25T12:24:43.916490+0000","last_clean":"2024-04-25T12:24:43.916490+0000","last_became_active":"2024-04-25T12:21:53.187855+0000","last_became_peered":"2024-04-25T12:21:53.187855+0000","last_unstale":"2024-04-25T12:24:43.916490+0000","last_undegraded":"2024-04-25T12:24:43.916490+0000","last_fullsized":"2024-04-25T12:24:43.916490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:52.874270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293184+0000","last_change":"2024-04-25T12:21:58.264074+0000","last_active":"2024-04-25T12:22:35.293184+0000","last_peered":"2024-04-25T12:22:35.293184+0000","last_clean":"2024-04-25T12:22:35.293184+0000","last_became_active":"2024-04-25T12:21:58.263425+0000","last_became_peered":"2024-04-25T12:21:58.263425+0000","last_unstale":"2024-04-25T12:22:35.293184+0000","last_undegraded":"2024-04-25T12:22:35.293184+0000","last_fullsized":"2024-04-25T12:22:35.293184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:02.083494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292583+0000","last_change":"2024-04-25T12:21:54.189512+0000","last_active":"2024-04-25T12:22:35.292583+0000","last_peered":"2024-04-25T12:22:35.292583+0000","last_clean":"2024-04-25T12:22:35.292583+0000","last_became_active":"2024-04-25T12:21:54.188587+0000","last_became_peered":"2024-04-25T12:21:54.188587+0000","last_unstale":"2024-04-25T12:22:35.292583+0000","last_undegraded":"2024-04-25T12:22:35.292583+0000","last_fullsized":"2024-04-25T12:22:35.292583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:00.810648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.913498+0000","last_change":"2024-04-25T12:21:53.159998+0000","last_active":"2024-04-25T12:24:43.913498+0000","last_peered":"2024-04-25T12:24:43.913498+0000","last_clean":"2024-04-25T12:24:43.913498+0000","last_became_active":"2024-04-25T12:21:53.159714+0000","last_became_peered":"2024-04-25T12:21:53.159714+0000","last_unstale":"2024-04-25T12:24:43.913498+0000","last_undegraded":"2024-04-25T12:24:43.913498+0000","last_fullsized":"2024-04-25T12:24:43.913498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:38.665874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.983753+0000","last_change":"2024-04-25T12:22:34.982542+0000","last_active":"2024-04-25T12:22:34.983753+0000","last_peered":"2024-04-25T12:22:34.983753+0000","last_clean":"2024-04-25T12:22:34.983753+0000","last_became_active":"2024-04-25T12:22:34.981347+0000","last_became_peered":"2024-04-25T12:22:34.981347+0000","last_unstale":"2024-04-25T12:22:34.983753+0000","last_undegraded":"2024-04-25T12:22:34.983753+0000","last_fullsized":"2024-04-25T12:22:34.983753+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:55.180698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915214+0000","last_change":"2024-04-25T12:21:54.205348+0000","last_active":"2024-04-25T12:22:34.915214+0000","last_peered":"2024-04-25T12:22:34.915214+0000","last_clean":"2024-04-25T12:22:34.915214+0000","last_became_active":"2024-04-25T12:21:54.205023+0000","last_became_peered":"2024-04-25T12:21:54.205023+0000","last_unstale":"2024-04-25T12:22:34.915214+0000","last_undegraded":"2024-04-25T12:22:34.915214+0000","last_fullsized":"2024-04-25T12:22:34.915214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:46.381368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:31.226144+0000","last_change":"2024-04-25T12:21:53.201066+0000","last_active":"2024-04-25T12:24:31.226144+0000","last_peered":"2024-04-25T12:24:31.226144+0000","last_clean":"2024-04-25T12:24:31.226144+0000","last_became_active":"2024-04-25T12:21:53.197081+0000","last_became_peered":"2024-04-25T12:21:53.197081+0000","last_unstale":"2024-04-25T12:24:31.226144+0000","last_undegraded":"2024-04-25T12:24:31.226144+0000","last_fullsized":"2024-04-25T12:24:31.226144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:19.865455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916511+0000","last_change":"2024-04-25T12:21:58.343823+0000","last_active":"2024-04-25T12:22:34.916511+0000","last_peered":"2024-04-25T12:22:34.916511+0000","last_clean":"2024-04-25T12:22:34.916511+0000","last_became_active":"2024-04-25T12:21:58.342796+0000","last_became_peered":"2024-04-25T12:21:58.342796+0000","last_unstale":"2024-04-25T12:22:34.916511+0000","last_undegraded":"2024-04-25T12:22:34.916511+0000","last_fullsized":"2024-04-25T12:22:34.916511+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:14.849636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979107+0000","last_change":"2024-04-25T12:21:54.204569+0000","last_active":"2024-04-25T12:22:34.979107+0000","last_peered":"2024-04-25T12:22:34.979107+0000","last_clean":"2024-04-25T12:22:34.979107+0000","last_became_active":"2024-04-25T12:21:54.204212+0000","last_became_peered":"2024-04-25T12:21:54.204212+0000","last_unstale":"2024-04-25T12:22:34.979107+0000","last_undegraded":"2024-04-25T12:22:34.979107+0000","last_fullsized":"2024-04-25T12:22:34.979107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:44.245327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.897489+0000","last_change":"2024-04-25T12:21:53.169844+0000","last_active":"2024-04-25T12:24:37.897489+0000","last_peered":"2024-04-25T12:24:37.897489+0000","last_clean":"2024-04-25T12:24:37.897489+0000","last_became_active":"2024-04-25T12:21:53.168939+0000","last_became_peered":"2024-04-25T12:21:53.168939+0000","last_unstale":"2024-04-25T12:24:37.897489+0000","last_undegraded":"2024-04-25T12:24:37.897489+0000","last_fullsized":"2024-04-25T12:24:37.897489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:57.836476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.888439+0000","last_change":"2024-04-25T12:21:42.610528+0000","last_active":"2024-04-25T12:22:34.888439+0000","last_peered":"2024-04-25T12:22:34.888439+0000","last_clean":"2024-04-25T12:22:34.888439+0000","last_became_active":"2024-04-25T12:21:42.608579+0000","last_became_peered":"2024-04-25T12:21:42.608579+0000","last_unstale":"2024-04-25T12:22:34.888439+0000","last_undegraded":"2024-04-25T12:22:34.888439+0000","last_fullsized":"2024-04-25T12:22:34.888439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:39.904333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:39.904333+0000","last_clean_scrub_stamp":"2024-04-25T12:21:39.904333+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:16.122851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029891+0000","last_change":"2024-04-25T12:21:58.351105+0000","last_active":"2024-04-25T12:22:35.029891+0000","last_peered":"2024-04-25T12:22:35.029891+0000","last_clean":"2024-04-25T12:22:35.029891+0000","last_became_active":"2024-04-25T12:21:58.350087+0000","last_became_peered":"2024-04-25T12:21:58.350087+0000","last_unstale":"2024-04-25T12:22:35.029891+0000","last_undegraded":"2024-04-25T12:22:35.029891+0000","last_fullsized":"2024-04-25T12:22:35.029891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:22.686410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891042+0000","last_change":"2024-04-25T12:21:54.215530+0000","last_active":"2024-04-25T12:22:34.891042+0000","last_peered":"2024-04-25T12:22:34.891042+0000","last_clean":"2024-04-25T12:22:34.891042+0000","last_became_active":"2024-04-25T12:21:54.211077+0000","last_became_peered":"2024-04-25T12:21:54.211077+0000","last_unstale":"2024-04-25T12:22:34.891042+0000","last_undegraded":"2024-04-25T12:22:34.891042+0000","last_fullsized":"2024-04-25T12:22:34.891042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:03.079964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:51.460416+0000","last_change":"2024-04-25T12:21:53.175259+0000","last_active":"2024-04-25T12:24:51.460416+0000","last_peered":"2024-04-25T12:24:51.460416+0000","last_clean":"2024-04-25T12:24:51.460416+0000","last_became_active":"2024-04-25T12:21:53.174980+0000","last_became_peered":"2024-04-25T12:21:53.174980+0000","last_unstale":"2024-04-25T12:24:51.460416+0000","last_undegraded":"2024-04-25T12:24:51.460416+0000","last_fullsized":"2024-04-25T12:24:51.460416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:51.852590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029315+0000","last_change":"2024-04-25T12:21:58.344660+0000","last_active":"2024-04-25T12:22:35.029315+0000","last_peered":"2024-04-25T12:22:35.029315+0000","last_clean":"2024-04-25T12:22:35.029315+0000","last_became_active":"2024-04-25T12:21:58.343502+0000","last_became_peered":"2024-04-25T12:21:58.343502+0000","last_unstale":"2024-04-25T12:22:35.029315+0000","last_undegraded":"2024-04-25T12:22:35.029315+0000","last_fullsized":"2024-04-25T12:22:35.029315+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:46.127740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887959+0000","last_change":"2024-04-25T12:21:54.207666+0000","last_active":"2024-04-25T12:22:34.887959+0000","last_peered":"2024-04-25T12:22:34.887959+0000","last_clean":"2024-04-25T12:22:34.887959+0000","last_became_active":"2024-04-25T12:21:54.206749+0000","last_became_peered":"2024-04-25T12:21:54.206749+0000","last_unstale":"2024-04-25T12:22:34.887959+0000","last_undegraded":"2024-04-25T12:22:34.887959+0000","last_fullsized":"2024-04-25T12:22:34.887959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:36.113364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.900925+0000","last_change":"2024-04-25T12:21:53.179412+0000","last_active":"2024-04-25T12:24:37.900925+0000","last_peered":"2024-04-25T12:24:37.900925+0000","last_clean":"2024-04-25T12:24:37.900925+0000","last_became_active":"2024-04-25T12:21:53.179142+0000","last_became_peered":"2024-04-25T12:21:53.179142+0000","last_unstale":"2024-04-25T12:24:37.900925+0000","last_undegraded":"2024-04-25T12:24:37.900925+0000","last_fullsized":"2024-04-25T12:24:37.900925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:08.771439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915942+0000","last_change":"2024-04-25T12:21:58.254119+0000","last_active":"2024-04-25T12:22:34.915942+0000","last_peered":"2024-04-25T12:22:34.915942+0000","last_clean":"2024-04-25T12:22:34.915942+0000","last_became_active":"2024-04-25T12:21:58.253624+0000","last_became_peered":"2024-04-25T12:21:58.253624+0000","last_unstale":"2024-04-25T12:22:34.915942+0000","last_undegraded":"2024-04-25T12:22:34.915942+0000","last_fullsized":"2024-04-25T12:22:34.915942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:54.719908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891979+0000","last_change":"2024-04-25T12:21:54.219803+0000","last_active":"2024-04-25T12:22:34.891979+0000","last_peered":"2024-04-25T12:22:34.891979+0000","last_clean":"2024-04-25T12:22:34.891979+0000","last_became_active":"2024-04-25T12:21:54.219513+0000","last_became_peered":"2024-04-25T12:21:54.219513+0000","last_unstale":"2024-04-25T12:22:34.891979+0000","last_undegraded":"2024-04-25T12:22:34.891979+0000","last_fullsized":"2024-04-25T12:22:34.891979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:03.617773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.912860+0000","last_change":"2024-04-25T12:21:53.159382+0000","last_active":"2024-04-25T12:24:43.912860+0000","last_peered":"2024-04-25T12:24:43.912860+0000","last_clean":"2024-04-25T12:24:43.912860+0000","last_became_active":"2024-04-25T12:21:53.159018+0000","last_became_peered":"2024-04-25T12:21:53.159018+0000","last_unstale":"2024-04-25T12:24:43.912860+0000","last_undegraded":"2024-04-25T12:24:43.912860+0000","last_fullsized":"2024-04-25T12:24:43.912860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:13:39.868721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.885990+0000","last_change":"2024-04-25T12:21:58.344915+0000","last_active":"2024-04-25T12:22:34.885990+0000","last_peered":"2024-04-25T12:22:34.885990+0000","last_clean":"2024-04-25T12:22:34.885990+0000","last_became_active":"2024-04-25T12:21:58.343839+0000","last_became_peered":"2024-04-25T12:21:58.343839+0000","last_unstale":"2024-04-25T12:22:34.885990+0000","last_undegraded":"2024-04-25T12:22:34.885990+0000","last_fullsized":"2024-04-25T12:22:34.885990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:20.784047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891353+0000","last_change":"2024-04-25T12:21:54.215509+0000","last_active":"2024-04-25T12:22:34.891353+0000","last_peered":"2024-04-25T12:22:34.891353+0000","last_clean":"2024-04-25T12:22:34.891353+0000","last_became_active":"2024-04-25T12:21:54.211719+0000","last_became_peered":"2024-04-25T12:21:54.211719+0000","last_unstale":"2024-04-25T12:22:34.891353+0000","last_undegraded":"2024-04-25T12:22:34.891353+0000","last_fullsized":"2024-04-25T12:22:34.891353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:21.047044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'2","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:10.988142+0000","last_change":"2024-04-25T12:21:53.170513+0000","last_active":"2024-04-25T12:24:10.988142+0000","last_peered":"2024-04-25T12:24:10.988142+0000","last_clean":"2024-04-25T12:24:10.988142+0000","last_became_active":"2024-04-25T12:21:53.169743+0000","last_became_peered":"2024-04-25T12:21:53.169743+0000","last_unstale":"2024-04-25T12:24:10.988142+0000","last_undegraded":"2024-04-25T12:24:10.988142+0000","last_fullsized":"2024-04-25T12:24:10.988142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:03.566639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.893058+0000","last_change":"2024-04-25T12:21:58.254432+0000","last_active":"2024-04-25T12:22:34.893058+0000","last_peered":"2024-04-25T12:22:34.893058+0000","last_clean":"2024-04-25T12:22:34.893058+0000","last_became_active":"2024-04-25T12:21:58.253256+0000","last_became_peered":"2024-04-25T12:21:58.253256+0000","last_unstale":"2024-04-25T12:22:34.893058+0000","last_undegraded":"2024-04-25T12:22:34.893058+0000","last_fullsized":"2024-04-25T12:22:34.893058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:13.469118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.897492+0000","last_change":"2024-04-25T12:22:34.896289+0000","last_active":"2024-04-25T12:22:34.897492+0000","last_peered":"2024-04-25T12:22:34.897492+0000","last_clean":"2024-04-25T12:22:34.897492+0000","last_became_active":"2024-04-25T12:22:34.895584+0000","last_became_peered":"2024-04-25T12:22:34.895584+0000","last_unstale":"2024-04-25T12:22:34.897492+0000","last_undegraded":"2024-04-25T12:22:34.897492+0000","last_fullsized":"2024-04-25T12:22:34.897492+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:54.648002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"28'17","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.895231+0000","last_change":"2024-04-25T12:21:53.163846+0000","last_active":"2024-04-25T12:24:37.895231+0000","last_peered":"2024-04-25T12:24:37.895231+0000","last_clean":"2024-04-25T12:24:37.895231+0000","last_became_active":"2024-04-25T12:21:53.163565+0000","last_became_peered":"2024-04-25T12:21:53.163565+0000","last_unstale":"2024-04-25T12:24:37.895231+0000","last_undegraded":"2024-04-25T12:24:37.895231+0000","last_fullsized":"2024-04-25T12:24:37.895231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:22.297830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916263+0000","last_change":"2024-04-25T12:21:58.250582+0000","last_active":"2024-04-25T12:22:34.916263+0000","last_peered":"2024-04-25T12:22:34.916263+0000","last_clean":"2024-04-25T12:22:34.916263+0000","last_became_active":"2024-04-25T12:21:58.250136+0000","last_became_peered":"2024-04-25T12:21:58.250136+0000","last_unstale":"2024-04-25T12:22:34.916263+0000","last_undegraded":"2024-04-25T12:22:34.916263+0000","last_fullsized":"2024-04-25T12:22:34.916263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:23.786586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030261+0000","last_change":"2024-04-25T12:21:54.200492+0000","last_active":"2024-04-25T12:22:35.030261+0000","last_peered":"2024-04-25T12:22:35.030261+0000","last_clean":"2024-04-25T12:22:35.030261+0000","last_became_active":"2024-04-25T12:21:54.200187+0000","last_became_peered":"2024-04-25T12:21:54.200187+0000","last_unstale":"2024-04-25T12:22:35.030261+0000","last_undegraded":"2024-04-25T12:22:35.030261+0000","last_fullsized":"2024-04-25T12:22:35.030261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:17.428348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:51.468514+0000","last_change":"2024-04-25T12:21:53.186752+0000","last_active":"2024-04-25T12:24:51.468514+0000","last_peered":"2024-04-25T12:24:51.468514+0000","last_clean":"2024-04-25T12:24:51.468514+0000","last_became_active":"2024-04-25T12:21:53.184866+0000","last_became_peered":"2024-04-25T12:21:53.184866+0000","last_unstale":"2024-04-25T12:24:51.468514+0000","last_undegraded":"2024-04-25T12:24:51.468514+0000","last_fullsized":"2024-04-25T12:24:51.468514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:07.228743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980381+0000","last_change":"2024-04-25T12:21:58.344241+0000","last_active":"2024-04-25T12:22:34.980381+0000","last_peered":"2024-04-25T12:22:34.980381+0000","last_clean":"2024-04-25T12:22:34.980381+0000","last_became_active":"2024-04-25T12:21:58.343764+0000","last_became_peered":"2024-04-25T12:21:58.343764+0000","last_unstale":"2024-04-25T12:22:34.980381+0000","last_undegraded":"2024-04-25T12:22:34.980381+0000","last_fullsized":"2024-04-25T12:22:34.980381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:25.931918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890533+0000","last_change":"2024-04-25T12:21:54.216405+0000","last_active":"2024-04-25T12:22:34.890533+0000","last_peered":"2024-04-25T12:22:34.890533+0000","last_clean":"2024-04-25T12:22:34.890533+0000","last_became_active":"2024-04-25T12:21:54.215575+0000","last_became_peered":"2024-04-25T12:21:54.215575+0000","last_unstale":"2024-04-25T12:22:34.890533+0000","last_undegraded":"2024-04-25T12:22:34.890533+0000","last_fullsized":"2024-04-25T12:22:34.890533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:57.935295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.896331+0000","last_change":"2024-04-25T12:21:53.198384+0000","last_active":"2024-04-25T12:24:37.896331+0000","last_peered":"2024-04-25T12:24:37.896331+0000","last_clean":"2024-04-25T12:24:37.896331+0000","last_became_active":"2024-04-25T12:21:53.197618+0000","last_became_peered":"2024-04-25T12:21:53.197618+0000","last_unstale":"2024-04-25T12:24:37.896331+0000","last_undegraded":"2024-04-25T12:24:37.896331+0000","last_fullsized":"2024-04-25T12:24:37.896331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:23.368197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979881+0000","last_change":"2024-04-25T12:21:58.342445+0000","last_active":"2024-04-25T12:22:34.979881+0000","last_peered":"2024-04-25T12:22:34.979881+0000","last_clean":"2024-04-25T12:22:34.979881+0000","last_became_active":"2024-04-25T12:21:58.341575+0000","last_became_peered":"2024-04-25T12:21:58.341575+0000","last_unstale":"2024-04-25T12:22:34.979881+0000","last_undegraded":"2024-04-25T12:22:34.979881+0000","last_fullsized":"2024-04-25T12:22:34.979881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:34.553686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915983+0000","last_change":"2024-04-25T12:21:54.200799+0000","last_active":"2024-04-25T12:22:34.915983+0000","last_peered":"2024-04-25T12:22:34.915983+0000","last_clean":"2024-04-25T12:22:34.915983+0000","last_became_active":"2024-04-25T12:21:54.200209+0000","last_became_peered":"2024-04-25T12:21:54.200209+0000","last_unstale":"2024-04-25T12:22:34.915983+0000","last_undegraded":"2024-04-25T12:22:34.915983+0000","last_fullsized":"2024-04-25T12:22:34.915983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:57.958942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.912380+0000","last_change":"2024-04-25T12:21:53.168731+0000","last_active":"2024-04-25T12:24:43.912380+0000","last_peered":"2024-04-25T12:24:43.912380+0000","last_clean":"2024-04-25T12:24:43.912380+0000","last_became_active":"2024-04-25T12:21:53.168461+0000","last_became_peered":"2024-04-25T12:21:53.168461+0000","last_unstale":"2024-04-25T12:24:43.912380+0000","last_undegraded":"2024-04-25T12:24:43.912380+0000","last_fullsized":"2024-04-25T12:24:43.912380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:34.935857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887582+0000","last_change":"2024-04-25T12:21:58.344622+0000","last_active":"2024-04-25T12:22:34.887582+0000","last_peered":"2024-04-25T12:22:34.887582+0000","last_clean":"2024-04-25T12:22:34.887582+0000","last_became_active":"2024-04-25T12:21:58.343533+0000","last_became_peered":"2024-04-25T12:21:58.343533+0000","last_unstale":"2024-04-25T12:22:34.887582+0000","last_undegraded":"2024-04-25T12:22:34.887582+0000","last_fullsized":"2024-04-25T12:22:34.887582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:35.536857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891003+0000","last_change":"2024-04-25T12:21:54.216903+0000","last_active":"2024-04-25T12:22:34.891003+0000","last_peered":"2024-04-25T12:22:34.891003+0000","last_clean":"2024-04-25T12:22:34.891003+0000","last_became_active":"2024-04-25T12:21:54.216312+0000","last_became_peered":"2024-04-25T12:21:54.216312+0000","last_unstale":"2024-04-25T12:22:34.891003+0000","last_undegraded":"2024-04-25T12:22:34.891003+0000","last_fullsized":"2024-04-25T12:22:34.891003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:12.963783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'17","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:51.473368+0000","last_change":"2024-04-25T12:21:53.179160+0000","last_active":"2024-04-25T12:24:51.473368+0000","last_peered":"2024-04-25T12:24:51.473368+0000","last_clean":"2024-04-25T12:24:51.473368+0000","last_became_active":"2024-04-25T12:21:53.177229+0000","last_became_peered":"2024-04-25T12:21:53.177229+0000","last_unstale":"2024-04-25T12:24:51.473368+0000","last_undegraded":"2024-04-25T12:24:51.473368+0000","last_fullsized":"2024-04-25T12:24:51.473368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:09.082459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.293725+0000","last_change":"2024-04-25T12:21:58.245003+0000","last_active":"2024-04-25T12:22:35.293725+0000","last_peered":"2024-04-25T12:22:35.293725+0000","last_clean":"2024-04-25T12:22:35.293725+0000","last_became_active":"2024-04-25T12:21:58.244500+0000","last_became_peered":"2024-04-25T12:21:58.244500+0000","last_unstale":"2024-04-25T12:22:35.293725+0000","last_undegraded":"2024-04-25T12:22:35.293725+0000","last_fullsized":"2024-04-25T12:22:35.293725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:35.010344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.895285+0000","last_change":"2024-04-25T12:21:54.213845+0000","last_active":"2024-04-25T12:22:34.895285+0000","last_peered":"2024-04-25T12:22:34.895285+0000","last_clean":"2024-04-25T12:22:34.895285+0000","last_became_active":"2024-04-25T12:21:54.213413+0000","last_became_peered":"2024-04-25T12:21:54.213413+0000","last_unstale":"2024-04-25T12:22:34.895285+0000","last_undegraded":"2024-04-25T12:22:34.895285+0000","last_fullsized":"2024-04-25T12:22:34.895285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:59.864079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:25.191571+0000","last_change":"2024-04-25T12:21:53.186487+0000","last_active":"2024-04-25T12:24:25.191571+0000","last_peered":"2024-04-25T12:24:25.191571+0000","last_clean":"2024-04-25T12:24:25.191571+0000","last_became_active":"2024-04-25T12:21:53.186227+0000","last_became_peered":"2024-04-25T12:21:53.186227+0000","last_unstale":"2024-04-25T12:24:25.191571+0000","last_undegraded":"2024-04-25T12:24:25.191571+0000","last_fullsized":"2024-04-25T12:24:25.191571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:20.317103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894312+0000","last_change":"2024-04-25T12:21:58.249806+0000","last_active":"2024-04-25T12:22:34.894312+0000","last_peered":"2024-04-25T12:22:34.894312+0000","last_clean":"2024-04-25T12:22:34.894312+0000","last_became_active":"2024-04-25T12:21:58.248841+0000","last_became_peered":"2024-04-25T12:21:58.248841+0000","last_unstale":"2024-04-25T12:22:34.894312+0000","last_undegraded":"2024-04-25T12:22:34.894312+0000","last_fullsized":"2024-04-25T12:22:34.894312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:18.448118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916576+0000","last_change":"2024-04-25T12:21:54.189948+0000","last_active":"2024-04-25T12:22:34.916576+0000","last_peered":"2024-04-25T12:22:34.916576+0000","last_clean":"2024-04-25T12:22:34.916576+0000","last_became_active":"2024-04-25T12:21:54.189097+0000","last_became_peered":"2024-04-25T12:21:54.189097+0000","last_unstale":"2024-04-25T12:22:34.916576+0000","last_undegraded":"2024-04-25T12:22:34.916576+0000","last_fullsized":"2024-04-25T12:22:34.916576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:09.029536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'4","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:43.916749+0000","last_change":"2024-04-25T12:21:53.206472+0000","last_active":"2024-04-25T12:24:43.916749+0000","last_peered":"2024-04-25T12:24:43.916749+0000","last_clean":"2024-04-25T12:24:43.916749+0000","last_became_active":"2024-04-25T12:21:53.205742+0000","last_became_peered":"2024-04-25T12:21:53.205742+0000","last_unstale":"2024-04-25T12:24:43.916749+0000","last_undegraded":"2024-04-25T12:24:43.916749+0000","last_fullsized":"2024-04-25T12:24:43.916749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:37.444336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978676+0000","last_change":"2024-04-25T12:21:58.261490+0000","last_active":"2024-04-25T12:22:34.978676+0000","last_peered":"2024-04-25T12:22:34.978676+0000","last_clean":"2024-04-25T12:22:34.978676+0000","last_became_active":"2024-04-25T12:21:58.260979+0000","last_became_peered":"2024-04-25T12:21:58.260979+0000","last_unstale":"2024-04-25T12:22:34.978676+0000","last_undegraded":"2024-04-25T12:22:34.978676+0000","last_fullsized":"2024-04-25T12:22:34.978676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:51.396618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891181+0000","last_change":"2024-04-25T12:22:34.890271+0000","last_active":"2024-04-25T12:22:34.891181+0000","last_peered":"2024-04-25T12:22:34.891181+0000","last_clean":"2024-04-25T12:22:34.891181+0000","last_became_active":"2024-04-25T12:22:34.889562+0000","last_became_peered":"2024-04-25T12:22:34.889562+0000","last_unstale":"2024-04-25T12:22:34.891181+0000","last_undegraded":"2024-04-25T12:22:34.891181+0000","last_fullsized":"2024-04-25T12:22:34.891181+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:17.476913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:51.464392+0000","last_change":"2024-04-25T12:21:53.206850+0000","last_active":"2024-04-25T12:24:51.464392+0000","last_peered":"2024-04-25T12:24:51.464392+0000","last_clean":"2024-04-25T12:24:51.464392+0000","last_became_active":"2024-04-25T12:21:53.206274+0000","last_became_peered":"2024-04-25T12:21:53.206274+0000","last_unstale":"2024-04-25T12:24:51.464392+0000","last_undegraded":"2024-04-25T12:24:51.464392+0000","last_fullsized":"2024-04-25T12:24:51.464392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:25.867387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979375+0000","last_change":"2024-04-25T12:21:58.346593+0000","last_active":"2024-04-25T12:22:34.979375+0000","last_peered":"2024-04-25T12:22:34.979375+0000","last_clean":"2024-04-25T12:22:34.979375+0000","last_became_active":"2024-04-25T12:21:58.346195+0000","last_became_peered":"2024-04-25T12:21:58.346195+0000","last_unstale":"2024-04-25T12:22:34.979375+0000","last_undegraded":"2024-04-25T12:22:34.979375+0000","last_fullsized":"2024-04-25T12:22:34.979375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:47.745861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915960+0000","last_change":"2024-04-25T12:21:58.347908+0000","last_active":"2024-04-25T12:22:34.915960+0000","last_peered":"2024-04-25T12:22:34.915960+0000","last_clean":"2024-04-25T12:22:34.915960+0000","last_became_active":"2024-04-25T12:21:58.346887+0000","last_became_peered":"2024-04-25T12:21:58.346887+0000","last_unstale":"2024-04-25T12:22:34.915960+0000","last_undegraded":"2024-04-25T12:22:34.915960+0000","last_fullsized":"2024-04-25T12:22:34.915960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:06.228605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.291914+0000","last_change":"2024-04-25T12:21:54.203140+0000","last_active":"2024-04-25T12:22:35.291914+0000","last_peered":"2024-04-25T12:22:35.291914+0000","last_clean":"2024-04-25T12:22:35.291914+0000","last_became_active":"2024-04-25T12:21:54.202399+0000","last_became_peered":"2024-04-25T12:21:54.202399+0000","last_unstale":"2024-04-25T12:22:35.291914+0000","last_undegraded":"2024-04-25T12:22:35.291914+0000","last_fullsized":"2024-04-25T12:22:35.291914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:19.691760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'3","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.900829+0000","last_change":"2024-04-25T12:21:53.202038+0000","last_active":"2024-04-25T12:24:37.900829+0000","last_peered":"2024-04-25T12:24:37.900829+0000","last_clean":"2024-04-25T12:24:37.900829+0000","last_became_active":"2024-04-25T12:21:53.189592+0000","last_became_peered":"2024-04-25T12:21:53.189592+0000","last_unstale":"2024-04-25T12:24:37.900829+0000","last_undegraded":"2024-04-25T12:24:37.900829+0000","last_fullsized":"2024-04-25T12:24:37.900829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:38.052120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030482+0000","last_change":"2024-04-25T12:21:58.246247+0000","last_active":"2024-04-25T12:22:35.030482+0000","last_peered":"2024-04-25T12:22:35.030482+0000","last_clean":"2024-04-25T12:22:35.030482+0000","last_became_active":"2024-04-25T12:21:58.245085+0000","last_became_peered":"2024-04-25T12:21:58.245085+0000","last_unstale":"2024-04-25T12:22:35.030482+0000","last_undegraded":"2024-04-25T12:22:35.030482+0000","last_fullsized":"2024-04-25T12:22:35.030482+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:24.660921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978856+0000","last_change":"2024-04-25T12:21:54.207534+0000","last_active":"2024-04-25T12:22:34.978856+0000","last_peered":"2024-04-25T12:22:34.978856+0000","last_clean":"2024-04-25T12:22:34.978856+0000","last_became_active":"2024-04-25T12:21:54.206786+0000","last_became_peered":"2024-04-25T12:21:54.206786+0000","last_unstale":"2024-04-25T12:22:34.978856+0000","last_undegraded":"2024-04-25T12:22:34.978856+0000","last_fullsized":"2024-04-25T12:22:34.978856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:48.775827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:31.226688+0000","last_change":"2024-04-25T12:21:53.190402+0000","last_active":"2024-04-25T12:24:31.226688+0000","last_peered":"2024-04-25T12:24:31.226688+0000","last_clean":"2024-04-25T12:24:31.226688+0000","last_became_active":"2024-04-25T12:21:53.189936+0000","last_became_peered":"2024-04-25T12:21:53.189936+0000","last_unstale":"2024-04-25T12:24:31.226688+0000","last_undegraded":"2024-04-25T12:24:31.226688+0000","last_fullsized":"2024-04-25T12:24:31.226688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:30.984588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:37.895874+0000","last_change":"2024-04-25T12:21:53.186071+0000","last_active":"2024-04-25T12:24:37.895874+0000","last_peered":"2024-04-25T12:24:37.895874+0000","last_clean":"2024-04-25T12:24:37.895874+0000","last_became_active":"2024-04-25T12:21:53.185357+0000","last_became_peered":"2024-04-25T12:21:53.185357+0000","last_unstale":"2024-04-25T12:24:37.895874+0000","last_undegraded":"2024-04-25T12:24:37.895874+0000","last_fullsized":"2024-04-25T12:24:37.895874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:10.148702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916445+0000","last_change":"2024-04-25T12:21:54.205678+0000","last_active":"2024-04-25T12:22:34.916445+0000","last_peered":"2024-04-25T12:22:34.916445+0000","last_clean":"2024-04-25T12:22:34.916445+0000","last_became_active":"2024-04-25T12:21:54.205219+0000","last_became_peered":"2024-04-25T12:21:54.205219+0000","last_unstale":"2024-04-25T12:22:34.916445+0000","last_undegraded":"2024-04-25T12:22:34.916445+0000","last_fullsized":"2024-04-25T12:22:34.916445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:55.152284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884465+0000","last_change":"2024-04-25T12:21:58.257395+0000","last_active":"2024-04-25T12:22:34.884465+0000","last_peered":"2024-04-25T12:22:34.884465+0000","last_clean":"2024-04-25T12:22:34.884465+0000","last_became_active":"2024-04-25T12:21:58.256219+0000","last_became_peered":"2024-04-25T12:21:58.256219+0000","last_unstale":"2024-04-25T12:22:34.884465+0000","last_undegraded":"2024-04-25T12:22:34.884465+0000","last_fullsized":"2024-04-25T12:22:34.884465+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:15.119967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'7","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:51.464832+0000","last_change":"2024-04-25T12:21:53.194633+0000","last_active":"2024-04-25T12:24:51.464832+0000","last_peered":"2024-04-25T12:24:51.464832+0000","last_clean":"2024-04-25T12:24:51.464832+0000","last_became_active":"2024-04-25T12:21:53.194306+0000","last_became_peered":"2024-04-25T12:21:53.194306+0000","last_unstale":"2024-04-25T12:24:51.464832+0000","last_undegraded":"2024-04-25T12:24:51.464832+0000","last_fullsized":"2024-04-25T12:24:51.464832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:52.128260+0000","last_clean_scrub_stamp":"2024-04-25T12:21:52.128260+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:03.566639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894127+0000","last_change":"2024-04-25T12:21:54.201494+0000","last_active":"2024-04-25T12:22:34.894127+0000","last_peered":"2024-04-25T12:22:34.894127+0000","last_clean":"2024-04-25T12:22:34.894127+0000","last_became_active":"2024-04-25T12:21:54.196085+0000","last_became_peered":"2024-04-25T12:21:54.196085+0000","last_unstale":"2024-04-25T12:22:34.894127+0000","last_undegraded":"2024-04-25T12:22:34.894127+0000","last_fullsized":"2024-04-25T12:22:34.894127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:21.183608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979718+0000","last_change":"2024-04-25T12:21:58.261744+0000","last_active":"2024-04-25T12:22:34.979718+0000","last_peered":"2024-04-25T12:22:34.979718+0000","last_clean":"2024-04-25T12:22:34.979718+0000","last_became_active":"2024-04-25T12:21:58.260821+0000","last_became_peered":"2024-04-25T12:21:58.260821+0000","last_unstale":"2024-04-25T12:22:34.979718+0000","last_undegraded":"2024-04-25T12:22:34.979718+0000","last_fullsized":"2024-04-25T12:22:34.979718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:14.169485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029125+0000","last_change":"2024-04-25T12:21:54.201042+0000","last_active":"2024-04-25T12:22:35.029125+0000","last_peered":"2024-04-25T12:22:35.029125+0000","last_clean":"2024-04-25T12:22:35.029125+0000","last_became_active":"2024-04-25T12:21:54.200446+0000","last_became_peered":"2024-04-25T12:21:54.200446+0000","last_unstale":"2024-04-25T12:22:35.029125+0000","last_undegraded":"2024-04-25T12:22:35.029125+0000","last_fullsized":"2024-04-25T12:22:35.029125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:37.866196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.884359+0000","last_change":"2024-04-25T12:21:54.188004+0000","last_active":"2024-04-25T12:22:34.884359+0000","last_peered":"2024-04-25T12:22:34.884359+0000","last_clean":"2024-04-25T12:22:34.884359+0000","last_became_active":"2024-04-25T12:21:54.187254+0000","last_became_peered":"2024-04-25T12:21:54.187254+0000","last_unstale":"2024-04-25T12:22:34.884359+0000","last_undegraded":"2024-04-25T12:22:34.884359+0000","last_fullsized":"2024-04-25T12:22:34.884359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:32.252676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887407+0000","last_change":"2024-04-25T12:21:54.206788+0000","last_active":"2024-04-25T12:22:34.887407+0000","last_peered":"2024-04-25T12:22:34.887407+0000","last_clean":"2024-04-25T12:22:34.887407+0000","last_became_active":"2024-04-25T12:21:54.204904+0000","last_became_peered":"2024-04-25T12:21:54.204904+0000","last_unstale":"2024-04-25T12:22:34.887407+0000","last_undegraded":"2024-04-25T12:22:34.887407+0000","last_fullsized":"2024-04-25T12:22:34.887407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:24.928840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916233+0000","last_change":"2024-04-25T12:21:54.204288+0000","last_active":"2024-04-25T12:22:34.916233+0000","last_peered":"2024-04-25T12:22:34.916233+0000","last_clean":"2024-04-25T12:22:34.916233+0000","last_became_active":"2024-04-25T12:21:54.203922+0000","last_became_peered":"2024-04-25T12:21:54.203922+0000","last_unstale":"2024-04-25T12:22:34.916233+0000","last_undegraded":"2024-04-25T12:22:34.916233+0000","last_fullsized":"2024-04-25T12:22:34.916233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:36.299452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980303+0000","last_change":"2024-04-25T12:21:54.208621+0000","last_active":"2024-04-25T12:22:34.980303+0000","last_peered":"2024-04-25T12:22:34.980303+0000","last_clean":"2024-04-25T12:22:34.980303+0000","last_became_active":"2024-04-25T12:21:54.206993+0000","last_became_peered":"2024-04-25T12:21:54.206993+0000","last_unstale":"2024-04-25T12:22:34.980303+0000","last_undegraded":"2024-04-25T12:22:34.980303+0000","last_fullsized":"2024-04-25T12:22:34.980303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:56:08.605883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292881+0000","last_change":"2024-04-25T12:21:54.202203+0000","last_active":"2024-04-25T12:22:35.292881+0000","last_peered":"2024-04-25T12:22:35.292881+0000","last_clean":"2024-04-25T12:22:35.292881+0000","last_became_active":"2024-04-25T12:21:54.201551+0000","last_became_peered":"2024-04-25T12:21:54.201551+0000","last_unstale":"2024-04-25T12:22:35.292881+0000","last_undegraded":"2024-04-25T12:22:35.292881+0000","last_fullsized":"2024-04-25T12:22:35.292881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:12.846584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030100+0000","last_change":"2024-04-25T12:21:54.220705+0000","last_active":"2024-04-25T12:22:35.030100+0000","last_peered":"2024-04-25T12:22:35.030100+0000","last_clean":"2024-04-25T12:22:35.030100+0000","last_became_active":"2024-04-25T12:21:54.220435+0000","last_became_peered":"2024-04-25T12:21:54.220435+0000","last_unstale":"2024-04-25T12:22:35.030100+0000","last_undegraded":"2024-04-25T12:22:35.030100+0000","last_fullsized":"2024-04-25T12:22:35.030100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:27.885210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.980397+0000","last_change":"2024-04-25T12:21:54.206568+0000","last_active":"2024-04-25T12:22:34.980397+0000","last_peered":"2024-04-25T12:22:34.980397+0000","last_clean":"2024-04-25T12:22:34.980397+0000","last_became_active":"2024-04-25T12:21:54.204587+0000","last_became_peered":"2024-04-25T12:21:54.204587+0000","last_unstale":"2024-04-25T12:22:34.980397+0000","last_undegraded":"2024-04-25T12:22:34.980397+0000","last_fullsized":"2024-04-25T12:22:34.980397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:37.419230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.297659+0000","last_change":"2024-04-25T12:22:35.295869+0000","last_active":"2024-04-25T12:22:35.297659+0000","last_peered":"2024-04-25T12:22:35.297659+0000","last_clean":"2024-04-25T12:22:35.297659+0000","last_became_active":"2024-04-25T12:22:35.295116+0000","last_became_peered":"2024-04-25T12:22:35.295116+0000","last_unstale":"2024-04-25T12:22:35.297659+0000","last_undegraded":"2024-04-25T12:22:35.297659+0000","last_fullsized":"2024-04-25T12:22:35.297659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:08.665587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.979578+0000","last_change":"2024-04-25T12:21:54.203886+0000","last_active":"2024-04-25T12:22:34.979578+0000","last_peered":"2024-04-25T12:22:34.979578+0000","last_clean":"2024-04-25T12:22:34.979578+0000","last_became_active":"2024-04-25T12:21:54.203464+0000","last_became_peered":"2024-04-25T12:21:54.203464+0000","last_unstale":"2024-04-25T12:22:34.979578+0000","last_undegraded":"2024-04-25T12:22:34.979578+0000","last_fullsized":"2024-04-25T12:22:34.979578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:41.646353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887358+0000","last_change":"2024-04-25T12:21:54.213114+0000","last_active":"2024-04-25T12:22:34.887358+0000","last_peered":"2024-04-25T12:22:34.887358+0000","last_clean":"2024-04-25T12:22:34.887358+0000","last_became_active":"2024-04-25T12:21:54.212559+0000","last_became_peered":"2024-04-25T12:21:54.212559+0000","last_unstale":"2024-04-25T12:22:34.887358+0000","last_undegraded":"2024-04-25T12:22:34.887358+0000","last_fullsized":"2024-04-25T12:22:34.887358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:13.824789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915648+0000","last_change":"2024-04-25T12:21:54.215749+0000","last_active":"2024-04-25T12:22:34.915648+0000","last_peered":"2024-04-25T12:22:34.915648+0000","last_clean":"2024-04-25T12:22:34.915648+0000","last_became_active":"2024-04-25T12:21:54.215446+0000","last_became_peered":"2024-04-25T12:21:54.215446+0000","last_unstale":"2024-04-25T12:22:34.915648+0000","last_undegraded":"2024-04-25T12:22:34.915648+0000","last_fullsized":"2024-04-25T12:22:34.915648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:31.642141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029876+0000","last_change":"2024-04-25T12:21:54.210099+0000","last_active":"2024-04-25T12:22:35.029876+0000","last_peered":"2024-04-25T12:22:35.029876+0000","last_clean":"2024-04-25T12:22:35.029876+0000","last_became_active":"2024-04-25T12:21:54.209393+0000","last_became_peered":"2024-04-25T12:21:54.209393+0000","last_unstale":"2024-04-25T12:22:35.029876+0000","last_undegraded":"2024-04-25T12:22:35.029876+0000","last_fullsized":"2024-04-25T12:22:35.029876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:32.318047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891441+0000","last_change":"2024-04-25T12:21:54.216255+0000","last_active":"2024-04-25T12:22:34.891441+0000","last_peered":"2024-04-25T12:22:34.891441+0000","last_clean":"2024-04-25T12:22:34.891441+0000","last_became_active":"2024-04-25T12:21:54.211787+0000","last_became_peered":"2024-04-25T12:21:54.211787+0000","last_unstale":"2024-04-25T12:22:34.891441+0000","last_undegraded":"2024-04-25T12:22:34.891441+0000","last_fullsized":"2024-04-25T12:22:34.891441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:32.351790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.886612+0000","last_change":"2024-04-25T12:21:54.200503+0000","last_active":"2024-04-25T12:22:34.886612+0000","last_peered":"2024-04-25T12:22:34.886612+0000","last_clean":"2024-04-25T12:22:34.886612+0000","last_became_active":"2024-04-25T12:21:54.200123+0000","last_became_peered":"2024-04-25T12:21:54.200123+0000","last_unstale":"2024-04-25T12:22:34.886612+0000","last_undegraded":"2024-04-25T12:22:34.886612+0000","last_fullsized":"2024-04-25T12:22:34.886612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:04.504889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.889718+0000","last_change":"2024-04-25T12:21:54.220717+0000","last_active":"2024-04-25T12:22:34.889718+0000","last_peered":"2024-04-25T12:22:34.889718+0000","last_clean":"2024-04-25T12:22:34.889718+0000","last_became_active":"2024-04-25T12:21:54.220272+0000","last_became_peered":"2024-04-25T12:21:54.220272+0000","last_unstale":"2024-04-25T12:22:34.889718+0000","last_undegraded":"2024-04-25T12:22:34.889718+0000","last_fullsized":"2024-04-25T12:22:34.889718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:51.165297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.886279+0000","last_change":"2024-04-25T12:21:54.190288+0000","last_active":"2024-04-25T12:22:34.886279+0000","last_peered":"2024-04-25T12:22:34.886279+0000","last_clean":"2024-04-25T12:22:34.886279+0000","last_became_active":"2024-04-25T12:21:54.189535+0000","last_became_peered":"2024-04-25T12:21:54.189535+0000","last_unstale":"2024-04-25T12:22:34.886279+0000","last_undegraded":"2024-04-25T12:22:34.886279+0000","last_fullsized":"2024-04-25T12:22:34.886279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:03.757883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292136+0000","last_change":"2024-04-25T12:21:54.202898+0000","last_active":"2024-04-25T12:22:35.292136+0000","last_peered":"2024-04-25T12:22:35.292136+0000","last_clean":"2024-04-25T12:22:35.292136+0000","last_became_active":"2024-04-25T12:21:54.201641+0000","last_became_peered":"2024-04-25T12:21:54.201641+0000","last_unstale":"2024-04-25T12:22:35.292136+0000","last_undegraded":"2024-04-25T12:22:35.292136+0000","last_fullsized":"2024-04-25T12:22:35.292136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:42.865496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.916388+0000","last_change":"2024-04-25T12:21:54.192818+0000","last_active":"2024-04-25T12:22:34.916388+0000","last_peered":"2024-04-25T12:22:34.916388+0000","last_clean":"2024-04-25T12:22:34.916388+0000","last_became_active":"2024-04-25T12:21:54.192052+0000","last_became_peered":"2024-04-25T12:21:54.192052+0000","last_unstale":"2024-04-25T12:22:34.916388+0000","last_undegraded":"2024-04-25T12:22:34.916388+0000","last_fullsized":"2024-04-25T12:22:34.916388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:26.048483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978815+0000","last_change":"2024-04-25T12:21:54.203798+0000","last_active":"2024-04-25T12:22:34.978815+0000","last_peered":"2024-04-25T12:22:34.978815+0000","last_clean":"2024-04-25T12:22:34.978815+0000","last_became_active":"2024-04-25T12:21:54.203472+0000","last_became_peered":"2024-04-25T12:21:54.203472+0000","last_unstale":"2024-04-25T12:22:34.978815+0000","last_undegraded":"2024-04-25T12:22:34.978815+0000","last_fullsized":"2024-04-25T12:22:34.978815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:19.958172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.894317+0000","last_change":"2024-04-25T12:21:54.206055+0000","last_active":"2024-04-25T12:22:34.894317+0000","last_peered":"2024-04-25T12:22:34.894317+0000","last_clean":"2024-04-25T12:22:34.894317+0000","last_became_active":"2024-04-25T12:21:54.203030+0000","last_became_peered":"2024-04-25T12:21:54.203030+0000","last_unstale":"2024-04-25T12:22:34.894317+0000","last_undegraded":"2024-04-25T12:22:34.894317+0000","last_fullsized":"2024-04-25T12:22:34.894317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:58.836301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.030468+0000","last_change":"2024-04-25T12:21:54.199660+0000","last_active":"2024-04-25T12:22:35.030468+0000","last_peered":"2024-04-25T12:22:35.030468+0000","last_clean":"2024-04-25T12:22:35.030468+0000","last_became_active":"2024-04-25T12:21:54.199362+0000","last_became_peered":"2024-04-25T12:21:54.199362+0000","last_unstale":"2024-04-25T12:22:35.030468+0000","last_undegraded":"2024-04-25T12:22:35.030468+0000","last_fullsized":"2024-04-25T12:22:35.030468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:57.706566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.029976+0000","last_change":"2024-04-25T12:21:54.198710+0000","last_active":"2024-04-25T12:22:35.029976+0000","last_peered":"2024-04-25T12:22:35.029976+0000","last_clean":"2024-04-25T12:22:35.029976+0000","last_became_active":"2024-04-25T12:21:54.198432+0000","last_became_peered":"2024-04-25T12:21:54.198432+0000","last_unstale":"2024-04-25T12:22:35.029976+0000","last_undegraded":"2024-04-25T12:22:35.029976+0000","last_fullsized":"2024-04-25T12:22:35.029976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:33.124005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.892012+0000","last_change":"2024-04-25T12:21:54.218474+0000","last_active":"2024-04-25T12:22:34.892012+0000","last_peered":"2024-04-25T12:22:34.892012+0000","last_clean":"2024-04-25T12:22:34.892012+0000","last_became_active":"2024-04-25T12:21:54.216949+0000","last_became_peered":"2024-04-25T12:21:54.216949+0000","last_unstale":"2024-04-25T12:22:34.892012+0000","last_undegraded":"2024-04-25T12:22:34.892012+0000","last_fullsized":"2024-04-25T12:22:34.892012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:56.162843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.978395+0000","last_change":"2024-04-25T12:21:54.200590+0000","last_active":"2024-04-25T12:22:34.978395+0000","last_peered":"2024-04-25T12:22:34.978395+0000","last_clean":"2024-04-25T12:22:34.978395+0000","last_became_active":"2024-04-25T12:21:54.200248+0000","last_became_peered":"2024-04-25T12:21:54.200248+0000","last_unstale":"2024-04-25T12:22:34.978395+0000","last_undegraded":"2024-04-25T12:22:34.978395+0000","last_fullsized":"2024-04-25T12:22:34.978395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:12.875315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890043+0000","last_change":"2024-04-25T12:21:54.197805+0000","last_active":"2024-04-25T12:22:34.890043+0000","last_peered":"2024-04-25T12:22:34.890043+0000","last_clean":"2024-04-25T12:22:34.890043+0000","last_became_active":"2024-04-25T12:21:54.197028+0000","last_became_peered":"2024-04-25T12:21:54.197028+0000","last_unstale":"2024-04-25T12:22:34.890043+0000","last_undegraded":"2024-04-25T12:22:34.890043+0000","last_fullsized":"2024-04-25T12:22:34.890043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:03.069305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887087+0000","last_change":"2024-04-25T12:21:54.190517+0000","last_active":"2024-04-25T12:22:34.887087+0000","last_peered":"2024-04-25T12:22:34.887087+0000","last_clean":"2024-04-25T12:22:34.887087+0000","last_became_active":"2024-04-25T12:21:54.189711+0000","last_became_peered":"2024-04-25T12:21:54.189711+0000","last_unstale":"2024-04-25T12:22:34.887087+0000","last_undegraded":"2024-04-25T12:22:34.887087+0000","last_fullsized":"2024-04-25T12:22:34.887087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:17.879060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.890320+0000","last_change":"2024-04-25T12:21:54.197205+0000","last_active":"2024-04-25T12:22:34.890320+0000","last_peered":"2024-04-25T12:22:34.890320+0000","last_clean":"2024-04-25T12:22:34.890320+0000","last_became_active":"2024-04-25T12:21:54.196933+0000","last_became_peered":"2024-04-25T12:21:54.196933+0000","last_unstale":"2024-04-25T12:22:34.890320+0000","last_undegraded":"2024-04-25T12:22:34.890320+0000","last_fullsized":"2024-04-25T12:22:34.890320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:32.003058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.887450+0000","last_change":"2024-04-25T12:21:54.207709+0000","last_active":"2024-04-25T12:22:34.887450+0000","last_peered":"2024-04-25T12:22:34.887450+0000","last_clean":"2024-04-25T12:22:34.887450+0000","last_became_active":"2024-04-25T12:21:54.207027+0000","last_became_peered":"2024-04-25T12:21:54.207027+0000","last_unstale":"2024-04-25T12:22:34.887450+0000","last_undegraded":"2024-04-25T12:22:34.887450+0000","last_fullsized":"2024-04-25T12:22:34.887450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:15.116440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.915838+0000","last_change":"2024-04-25T12:21:54.185338+0000","last_active":"2024-04-25T12:22:34.915838+0000","last_peered":"2024-04-25T12:22:34.915838+0000","last_clean":"2024-04-25T12:22:34.915838+0000","last_became_active":"2024-04-25T12:21:54.184502+0000","last_became_peered":"2024-04-25T12:21:54.184502+0000","last_unstale":"2024-04-25T12:22:34.915838+0000","last_undegraded":"2024-04-25T12:22:34.915838+0000","last_fullsized":"2024-04-25T12:22:34.915838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:29.865959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:35.292679+0000","last_change":"2024-04-25T12:21:54.183773+0000","last_active":"2024-04-25T12:22:35.292679+0000","last_peered":"2024-04-25T12:22:35.292679+0000","last_clean":"2024-04-25T12:22:35.292679+0000","last_became_active":"2024-04-25T12:21:54.182924+0000","last_became_peered":"2024-04-25T12:21:54.182924+0000","last_unstale":"2024-04-25T12:22:35.292679+0000","last_undegraded":"2024-04-25T12:22:35.292679+0000","last_fullsized":"2024-04-25T12:22:35.292679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:22.046777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:22:34.891694+0000","last_change":"2024-04-25T12:21:54.210631+0000","last_active":"2024-04-25T12:22:34.891694+0000","last_peered":"2024-04-25T12:22:34.891694+0000","last_clean":"2024-04-25T12:22:34.891694+0000","last_became_active":"2024-04-25T12:21:54.210333+0000","last_became_peered":"2024-04-25T12:21:54.210333+0000","last_unstale":"2024-04-25T12:22:34.891694+0000","last_undegraded":"2024-04-25T12:22:34.891694+0000","last_fullsized":"2024-04-25T12:22:34.891694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:53.138425+0000","last_clean_scrub_stamp":"2024-04-25T12:21:53.138425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:39.783406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12592,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":25184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476779,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":921600,"data_stored":712870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476780,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":125616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476779,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":124334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476778,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":121732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542187,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":125650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542188,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":121864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542187,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":121352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542187,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":913408,"data_stored":711062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:25:03.965 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.965 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.965 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.966 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.966 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.966 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.966 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.966 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.966 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.967 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.967 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.967 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.967 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.967 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.967 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.968 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.968 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.968 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.968 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.968 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.968 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.969 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.969 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.969 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.969 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.969 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.969 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.970 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.970 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.970 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.970 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.970 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.970 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.970 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.971 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.971 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.971 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.971 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.971 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.971 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.972 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.972 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.972 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.972 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.972 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.972 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.973 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.973 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T12:21:39.904333+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=39, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.973 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.973 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.973 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.973 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.973 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.974 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.974 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.974 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.974 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.975 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.975 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.975 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.975 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.975 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.975 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.975 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.976 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.976 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.976 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.976 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.976 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.976 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.977 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.977 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.977 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.977 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.977 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.977 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.978 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.978 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.978 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.978 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.978 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.978 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.979 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.979 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.979 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.979 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.979 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.979 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.980 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.980 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.980 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.980 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.980 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.980 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.980 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-25T12:21:52.128260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.981 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.981 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.981 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.981 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.981 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.981 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.982 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.982 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.982 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.982 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.982 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.983 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.983 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.983 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.983 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.983 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.983 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.983 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.984 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.984 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.984 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.984 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.984 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.984 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.985 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.985 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.985 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.985 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.985 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.985 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.986 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.986 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.986 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.986 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-25T12:21:53.138425+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:03.986 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T12:25:20.142 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:25:20.146 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:25:23.987 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:25:24.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.114+0000 7efd68b1b640 1 Processor -- start 2024-04-25T12:25:24.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.114+0000 7efd68b1b640 1 -- start start 2024-04-25T12:25:24.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.118+0000 7efd68b1b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7efd64071530 0x7efd640c9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:24.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.118+0000 7efd68b1b640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7efd640c98b0 0x7efd640cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:24.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.118+0000 7efd68b1b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd640c8080 con 0x7efd64159cf0 2024-04-25T12:25:24.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.118+0000 7efd68b1b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7efd640c5d80 con 0x7efd64071530 2024-04-25T12:25:24.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.118+0000 7efd68b1b640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7efd640c8360 con 0x7efd640c98b0 2024-04-25T12:25:24.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.118+0000 7efd61d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7efd64071530 0x7efd640c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:24.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.118+0000 7efd6259c640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7efd64159cf0 0x7efd640c6210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:54078/0 (socket says 172.21.15.94:54078) 2024-04-25T12:25:24.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.118+0000 7efd6259c640 1 -- 172.21.15.94:0/3520114004 learned_addr learned my addr 172.21.15.94:0/3520114004 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:25:24.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.118+0000 7efd62d9d640 1 --2- 172.21.15.94:0/3520114004 >> v2:172.21.15.111:3300/0 conn(0x7efd640c98b0 0x7efd640cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:24.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.118+0000 7efd61d9b640 1 -- 172.21.15.94:0/3520114004 >> v2:172.21.15.111:3300/0 conn(0x7efd640c98b0 msgr2=0x7efd640cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:24.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.118+0000 7efd61d9b640 1 --2- 172.21.15.94:0/3520114004 >> v2:172.21.15.111:3300/0 conn(0x7efd640c98b0 0x7efd640cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:24.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.118+0000 7efd61d9b640 1 -- 172.21.15.94:0/3520114004 >> v1:172.21.15.94:6789/0 conn(0x7efd64159cf0 legacy=0x7efd640c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:24.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.118+0000 7efd61d9b640 1 -- 172.21.15.94:0/3520114004 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd640c8640 con 0x7efd64071530 2024-04-25T12:25:24.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.122+0000 7efd61d9b640 1 --2- 172.21.15.94:0/3520114004 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd64071530 0x7efd640c9370 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7efd6415c4e0 tx=0x7efd5801f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a66c9df5b0467e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:24.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.122+0000 7efd6159a640 1 -- 172.21.15.94:0/3520114004 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd580b4070 con 0x7efd64071530 2024-04-25T12:25:24.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.122+0000 7efd6159a640 1 -- 172.21.15.94:0/3520114004 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd580af600 con 0x7efd64071530 2024-04-25T12:25:24.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.122+0000 7efd6159a640 1 -- 172.21.15.94:0/3520114004 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd580af9d0 con 0x7efd64071530 2024-04-25T12:25:24.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.122+0000 7efd68b1b640 1 -- 172.21.15.94:0/3520114004 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd64071530 msgr2=0x7efd640c9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:24.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.122+0000 7efd68b1b640 1 --2- 172.21.15.94:0/3520114004 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd64071530 0x7efd640c9370 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7efd6415c4e0 tx=0x7efd5801f110 comp rx=0 tx=0).stop 2024-04-25T12:25:24.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.122+0000 7efd68b1b640 1 -- 172.21.15.94:0/3520114004 shutdown_connections 2024-04-25T12:25:24.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.122+0000 7efd68b1b640 1 --2- 172.21.15.94:0/3520114004 >> v2:172.21.15.111:3300/0 conn(0x7efd640c98b0 0x7efd640cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:24.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.122+0000 7efd68b1b640 1 --2- 172.21.15.94:0/3520114004 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd64071530 0x7efd640c9370 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:24.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.122+0000 7efd68b1b640 1 -- 172.21.15.94:0/3520114004 >> 172.21.15.94:0/3520114004 conn(0x7efd640676a0 msgr2=0x7efd64067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:24.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.122+0000 7efd68b1b640 1 -- 172.21.15.94:0/3520114004 shutdown_connections 2024-04-25T12:25:24.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.122+0000 7efd68b1b640 1 -- 172.21.15.94:0/3520114004 wait complete. 2024-04-25T12:25:24.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.122+0000 7efd68b1b640 1 Processor -- start 2024-04-25T12:25:24.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.122+0000 7efd68b1b640 1 -- start start 2024-04-25T12:25:24.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.122+0000 7efd68b1b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd64071530 0x7efd641f2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:24.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.122+0000 7efd68b1b640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efd640c98b0 0x7efd64139500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:24.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.122+0000 7efd68b1b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efd64159cf0 0x7efd640cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:24.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.122+0000 7efd68b1b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7efd640c6920 con 0x7efd64071530 2024-04-25T12:25:24.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.126+0000 7efd68b1b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7efd640c8c00 con 0x7efd64159cf0 2024-04-25T12:25:24.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.126+0000 7efd68b1b640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7efd64071950 con 0x7efd640c98b0 2024-04-25T12:25:24.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.126+0000 7efd6259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd64071530 0x7efd641f2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:24.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.126+0000 7efd6259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd64071530 0x7efd641f2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56698/0 (socket says 172.21.15.94:56698) 2024-04-25T12:25:24.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.126+0000 7efd6259c640 1 -- 172.21.15.94:0/1637872466 learned_addr learned my addr 172.21.15.94:0/1637872466 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:24.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.126+0000 7efd62d9d640 1 --2- 172.21.15.94:0/1637872466 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efd64159cf0 0x7efd640cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:24.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.126+0000 7efd61d9b640 1 --2- 172.21.15.94:0/1637872466 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efd640c98b0 0x7efd64139500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:24.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.126+0000 7efd6259c640 1 -- 172.21.15.94:0/1637872466 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efd640c98b0 msgr2=0x7efd64139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:24.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.126+0000 7efd6259c640 1 --2- 172.21.15.94:0/1637872466 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efd640c98b0 0x7efd64139500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:24.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.126+0000 7efd6259c640 1 -- 172.21.15.94:0/1637872466 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efd64159cf0 msgr2=0x7efd640cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:24.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.126+0000 7efd6259c640 1 --2- 172.21.15.94:0/1637872466 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efd64159cf0 0x7efd640cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:24.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.126+0000 7efd6259c640 1 -- 172.21.15.94:0/1637872466 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd641f25c0 con 0x7efd64071530 2024-04-25T12:25:24.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.126+0000 7efd61d9b640 1 --2- 172.21.15.94:0/1637872466 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efd640c98b0 0x7efd64139500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:25:24.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.126+0000 7efd6259c640 1 --2- 172.21.15.94:0/1637872466 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd64071530 0x7efd641f2080 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7efd5400c450 tx=0x7efd5400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:24.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.126+0000 7efd52ffd640 1 -- 172.21.15.94:0/1637872466 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd54017070 con 0x7efd64071530 2024-04-25T12:25:24.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.126+0000 7efd52ffd640 1 -- 172.21.15.94:0/1637872466 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd54005cf0 con 0x7efd64071530 2024-04-25T12:25:24.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.126+0000 7efd68b1b640 1 -- 172.21.15.94:0/1637872466 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd6413a890 con 0x7efd64071530 2024-04-25T12:25:24.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.126+0000 7efd52ffd640 1 -- 172.21.15.94:0/1637872466 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd540072f0 con 0x7efd64071530 2024-04-25T12:25:24.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.126+0000 7efd68b1b640 1 -- 172.21.15.94:0/1637872466 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd641f2b30 con 0x7efd64071530 2024-04-25T12:25:24.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.126+0000 7efd68b1b640 1 -- 172.21.15.94:0/1637872466 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd64075df0 con 0x7efd64071530 2024-04-25T12:25:24.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.126+0000 7efd52ffd640 1 -- 172.21.15.94:0/1637872466 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efd5401a070 con 0x7efd64071530 2024-04-25T12:25:24.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.126+0000 7efd52ffd640 1 --2- 172.21.15.94:0/1637872466 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7efd44068380 0x7efd4406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:24.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.126+0000 7efd52ffd640 1 -- 172.21.15.94:0/1637872466 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7efd54086210 con 0x7efd64071530 2024-04-25T12:25:24.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.126+0000 7efd61d9b640 1 --2- 172.21.15.94:0/1637872466 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7efd44068380 0x7efd4406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:24.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.126+0000 7efd61d9b640 1 --2- 172.21.15.94:0/1637872466 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7efd44068380 0x7efd4406a840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efd580b1000 tx=0x7efd580aa000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:24.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.130+0000 7efd52ffd640 1 -- 172.21.15.94:0/1637872466 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efd54056350 con 0x7efd64071530 2024-04-25T12:25:24.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.294+0000 7efd68b1b640 1 -- 172.21.15.94:0/1637872466 --> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efd640cab40 con 0x7efd44068380 2024-04-25T12:25:24.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.314+0000 7efd52ffd640 1 -- 172.21.15.94:0/1637872466 <== mgr.4101 v2:172.21.15.94:6832/549402167 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332632 (secure 0 0 0) 0x7efd640cab40 con 0x7efd44068380 2024-04-25T12:25:24.323 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:25:24.325 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-04-25T12:25:24.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.322+0000 7efd68b1b640 1 -- 172.21.15.94:0/1637872466 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7efd44068380 msgr2=0x7efd4406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:24.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.322+0000 7efd68b1b640 1 --2- 172.21.15.94:0/1637872466 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7efd44068380 0x7efd4406a840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efd580b1000 tx=0x7efd580aa000 comp rx=0 tx=0).stop 2024-04-25T12:25:24.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.322+0000 7efd68b1b640 1 -- 172.21.15.94:0/1637872466 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd64071530 msgr2=0x7efd641f2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:24.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.322+0000 7efd68b1b640 1 --2- 172.21.15.94:0/1637872466 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd64071530 0x7efd641f2080 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7efd5400c450 tx=0x7efd5400c910 comp rx=0 tx=0).stop 2024-04-25T12:25:24.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.322+0000 7efd68b1b640 1 -- 172.21.15.94:0/1637872466 shutdown_connections 2024-04-25T12:25:24.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.322+0000 7efd68b1b640 1 --2- 172.21.15.94:0/1637872466 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7efd44068380 0x7efd4406a840 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:24.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.322+0000 7efd68b1b640 1 --2- 172.21.15.94:0/1637872466 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efd640c98b0 0x7efd64139500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:24.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.322+0000 7efd68b1b640 1 --2- 172.21.15.94:0/1637872466 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efd64159cf0 0x7efd640cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:24.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.322+0000 7efd68b1b640 1 --2- 172.21.15.94:0/1637872466 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efd64071530 0x7efd641f2080 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:24.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.322+0000 7efd68b1b640 1 -- 172.21.15.94:0/1637872466 >> 172.21.15.94:0/1637872466 conn(0x7efd640676a0 msgr2=0x7efd640cb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:24.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.322+0000 7efd68b1b640 1 -- 172.21.15.94:0/1637872466 shutdown_connections 2024-04-25T12:25:24.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:24.322+0000 7efd68b1b640 1 -- 172.21.15.94:0/1637872466 wait complete. 2024-04-25T12:25:24.343 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-04-25T12:25:23.827221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602960,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":380,"num_write_kb":2495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":369,"ondisk_log_size":369,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240616,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734104,"statfs":{"total":773094113280,"available":772847722496,"internally_reserved":0,"allocated":3776512,"data_stored":2164480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005113"},"pg_stats":[{"pgid":"2.1f","version":"28'17","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:02.950410+0000","last_change":"2024-04-25T12:25:02.950440+0000","last_active":"2024-04-25T12:25:02.950410+0000","last_peered":"2024-04-25T12:25:02.950410+0000","last_clean":"2024-04-25T12:25:02.950410+0000","last_became_active":"2024-04-25T12:21:53.194480+0000","last_became_peered":"2024-04-25T12:21:53.194480+0000","last_unstale":"2024-04-25T12:25:02.950410+0000","last_undegraded":"2024-04-25T12:25:02.950410+0000","last_fullsized":"2024-04-25T12:25:02.950410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'17","last_scrub_stamp":"2024-04-25T12:25:02.950337+0000","last_deep_scrub":"28'17","last_deep_scrub_stamp":"2024-04-25T12:25:02.950337+0000","last_clean_scrub_stamp":"2024-04-25T12:25:02.950337+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:54:13.356764+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:09.799771+0000","last_change":"2024-04-25T12:25:09.799826+0000","last_active":"2024-04-25T12:25:09.799771+0000","last_peered":"2024-04-25T12:25:09.799771+0000","last_clean":"2024-04-25T12:25:09.799771+0000","last_became_active":"2024-04-25T12:21:54.199679+0000","last_became_peered":"2024-04-25T12:21:54.199679+0000","last_unstale":"2024-04-25T12:25:09.799771+0000","last_undegraded":"2024-04-25T12:25:09.799771+0000","last_fullsized":"2024-04-25T12:25:09.799771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:09.799590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:09.799590+0000","last_clean_scrub_stamp":"2024-04-25T12:25:09.799590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:33:04.145443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:24.779147+0000","last_change":"2024-04-25T12:21:58.346732+0000","last_active":"2024-04-25T12:24:24.779147+0000","last_peered":"2024-04-25T12:24:24.779147+0000","last_clean":"2024-04-25T12:24:24.779147+0000","last_became_active":"2024-04-25T12:21:58.346337+0000","last_became_peered":"2024-04-25T12:21:58.346337+0000","last_unstale":"2024-04-25T12:24:24.779147+0000","last_undegraded":"2024-04-25T12:24:24.779147+0000","last_fullsized":"2024-04-25T12:24:24.779147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:06.786075+0000","last_change":"2024-04-25T12:25:06.786139+0000","last_active":"2024-04-25T12:25:06.786075+0000","last_peered":"2024-04-25T12:25:06.786075+0000","last_clean":"2024-04-25T12:25:06.786075+0000","last_became_active":"2024-04-25T12:21:53.165990+0000","last_became_peered":"2024-04-25T12:21:53.165990+0000","last_unstale":"2024-04-25T12:25:06.786075+0000","last_undegraded":"2024-04-25T12:25:06.786075+0000","last_fullsized":"2024-04-25T12:25:06.786075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-04-25T12:25:06.785902+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-04-25T12:25:06.785902+0000","last_clean_scrub_stamp":"2024-04-25T12:25:06.785902+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:00.437912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:04.936764+0000","last_change":"2024-04-25T12:25:04.936828+0000","last_active":"2024-04-25T12:25:04.936764+0000","last_peered":"2024-04-25T12:25:04.936764+0000","last_clean":"2024-04-25T12:25:04.936764+0000","last_became_active":"2024-04-25T12:21:54.188987+0000","last_became_peered":"2024-04-25T12:21:54.188987+0000","last_unstale":"2024-04-25T12:25:04.936764+0000","last_undegraded":"2024-04-25T12:25:04.936764+0000","last_fullsized":"2024-04-25T12:25:04.936764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:04.936544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:04.936544+0000","last_clean_scrub_stamp":"2024-04-25T12:25:04.936544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:53:57.716206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:11.966886+0000","last_change":"2024-04-25T12:25:11.966955+0000","last_active":"2024-04-25T12:25:11.966886+0000","last_peered":"2024-04-25T12:25:11.966886+0000","last_clean":"2024-04-25T12:25:11.966886+0000","last_became_active":"2024-04-25T12:21:58.250542+0000","last_became_peered":"2024-04-25T12:21:58.250542+0000","last_unstale":"2024-04-25T12:25:11.966886+0000","last_undegraded":"2024-04-25T12:25:11.966886+0000","last_fullsized":"2024-04-25T12:25:11.966886+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:11.966640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:11.966640+0000","last_clean_scrub_stamp":"2024-04-25T12:25:11.966640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:18.064520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'16","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:08.678413+0000","last_change":"2024-04-25T12:25:08.678495+0000","last_active":"2024-04-25T12:25:08.678413+0000","last_peered":"2024-04-25T12:25:08.678413+0000","last_clean":"2024-04-25T12:25:08.678413+0000","last_became_active":"2024-04-25T12:21:53.202760+0000","last_became_peered":"2024-04-25T12:21:53.202760+0000","last_unstale":"2024-04-25T12:25:08.678413+0000","last_undegraded":"2024-04-25T12:25:08.678413+0000","last_fullsized":"2024-04-25T12:25:08.678413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'16","last_scrub_stamp":"2024-04-25T12:25:08.678215+0000","last_deep_scrub":"28'16","last_deep_scrub_stamp":"2024-04-25T12:25:08.678215+0000","last_clean_scrub_stamp":"2024-04-25T12:25:08.678215+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:05.859008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:15.046439+0000","last_change":"2024-04-25T12:25:15.046497+0000","last_active":"2024-04-25T12:25:15.046439+0000","last_peered":"2024-04-25T12:25:15.046439+0000","last_clean":"2024-04-25T12:25:15.046439+0000","last_became_active":"2024-04-25T12:21:54.208093+0000","last_became_peered":"2024-04-25T12:21:54.208093+0000","last_unstale":"2024-04-25T12:25:15.046439+0000","last_undegraded":"2024-04-25T12:25:15.046439+0000","last_fullsized":"2024-04-25T12:25:15.046439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:15.046249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:15.046249+0000","last_clean_scrub_stamp":"2024-04-25T12:25:15.046249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:03.282446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:13.937600+0000","last_change":"2024-04-25T12:25:13.937660+0000","last_active":"2024-04-25T12:25:13.937600+0000","last_peered":"2024-04-25T12:25:13.937600+0000","last_clean":"2024-04-25T12:25:13.937600+0000","last_became_active":"2024-04-25T12:21:58.254021+0000","last_became_peered":"2024-04-25T12:21:58.254021+0000","last_unstale":"2024-04-25T12:25:13.937600+0000","last_undegraded":"2024-04-25T12:25:13.937600+0000","last_fullsized":"2024-04-25T12:25:13.937600+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:13.937424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:13.937424+0000","last_clean_scrub_stamp":"2024-04-25T12:25:13.937424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:36.247253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'6","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:10.690238+0000","last_change":"2024-04-25T12:25:10.690308+0000","last_active":"2024-04-25T12:25:10.690238+0000","last_peered":"2024-04-25T12:25:10.690238+0000","last_clean":"2024-04-25T12:25:10.690238+0000","last_became_active":"2024-04-25T12:21:53.207929+0000","last_became_peered":"2024-04-25T12:21:53.207929+0000","last_unstale":"2024-04-25T12:25:10.690238+0000","last_undegraded":"2024-04-25T12:25:10.690238+0000","last_fullsized":"2024-04-25T12:25:10.690238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-25T12:25:10.690075+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-25T12:25:10.690075+0000","last_clean_scrub_stamp":"2024-04-25T12:25:10.690075+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:02.510735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:03.044298+0000","last_change":"2024-04-25T12:25:03.044399+0000","last_active":"2024-04-25T12:25:03.044298+0000","last_peered":"2024-04-25T12:25:03.044298+0000","last_clean":"2024-04-25T12:25:03.044298+0000","last_became_active":"2024-04-25T12:21:54.206138+0000","last_became_peered":"2024-04-25T12:21:54.206138+0000","last_unstale":"2024-04-25T12:25:03.044298+0000","last_undegraded":"2024-04-25T12:25:03.044298+0000","last_fullsized":"2024-04-25T12:25:03.044298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:03.044084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:03.044084+0000","last_clean_scrub_stamp":"2024-04-25T12:25:03.044084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:02:04.875380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:08.927359+0000","last_change":"2024-04-25T12:25:08.927418+0000","last_active":"2024-04-25T12:25:08.927359+0000","last_peered":"2024-04-25T12:25:08.927359+0000","last_clean":"2024-04-25T12:25:08.927359+0000","last_became_active":"2024-04-25T12:21:58.244313+0000","last_became_peered":"2024-04-25T12:21:58.244313+0000","last_unstale":"2024-04-25T12:25:08.927359+0000","last_undegraded":"2024-04-25T12:25:08.927359+0000","last_fullsized":"2024-04-25T12:25:08.927359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:08.927164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:08.927164+0000","last_clean_scrub_stamp":"2024-04-25T12:25:08.927164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:45.878771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:13.008017+0000","last_change":"2024-04-25T12:25:13.008072+0000","last_active":"2024-04-25T12:25:13.008017+0000","last_peered":"2024-04-25T12:25:13.008017+0000","last_clean":"2024-04-25T12:25:13.008017+0000","last_became_active":"2024-04-25T12:21:54.208338+0000","last_became_peered":"2024-04-25T12:21:54.208338+0000","last_unstale":"2024-04-25T12:25:13.008017+0000","last_undegraded":"2024-04-25T12:25:13.008017+0000","last_fullsized":"2024-04-25T12:25:13.008017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:13.007834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:13.007834+0000","last_clean_scrub_stamp":"2024-04-25T12:25:13.007834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:15.613849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'6","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:09.648498+0000","last_change":"2024-04-25T12:25:09.648565+0000","last_active":"2024-04-25T12:25:09.648498+0000","last_peered":"2024-04-25T12:25:09.648498+0000","last_clean":"2024-04-25T12:25:09.648498+0000","last_became_active":"2024-04-25T12:21:53.197141+0000","last_became_peered":"2024-04-25T12:21:53.197141+0000","last_unstale":"2024-04-25T12:25:09.648498+0000","last_undegraded":"2024-04-25T12:25:09.648498+0000","last_fullsized":"2024-04-25T12:25:09.648498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-25T12:25:09.648336+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-25T12:25:09.648336+0000","last_clean_scrub_stamp":"2024-04-25T12:25:09.648336+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:46.603409+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:10.931161+0000","last_change":"2024-04-25T12:25:10.931219+0000","last_active":"2024-04-25T12:25:10.931161+0000","last_peered":"2024-04-25T12:25:10.931161+0000","last_clean":"2024-04-25T12:25:10.931161+0000","last_became_active":"2024-04-25T12:21:58.249079+0000","last_became_peered":"2024-04-25T12:21:58.249079+0000","last_unstale":"2024-04-25T12:25:10.931161+0000","last_undegraded":"2024-04-25T12:25:10.931161+0000","last_fullsized":"2024-04-25T12:25:10.931161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:10.930982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:10.930982+0000","last_clean_scrub_stamp":"2024-04-25T12:25:10.930982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:29.938110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:04.823243+0000","last_change":"2024-04-25T12:25:04.823298+0000","last_active":"2024-04-25T12:25:04.823243+0000","last_peered":"2024-04-25T12:25:04.823243+0000","last_clean":"2024-04-25T12:25:04.823243+0000","last_became_active":"2024-04-25T12:21:54.208802+0000","last_became_peered":"2024-04-25T12:21:54.208802+0000","last_unstale":"2024-04-25T12:25:04.823243+0000","last_undegraded":"2024-04-25T12:25:04.823243+0000","last_fullsized":"2024-04-25T12:25:04.823243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:04.823059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:04.823059+0000","last_clean_scrub_stamp":"2024-04-25T12:25:04.823059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:28.654768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'4","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:02.505870+0000","last_change":"2024-04-25T12:25:02.505914+0000","last_active":"2024-04-25T12:25:02.505870+0000","last_peered":"2024-04-25T12:25:02.505870+0000","last_clean":"2024-04-25T12:25:02.505870+0000","last_became_active":"2024-04-25T12:21:53.164867+0000","last_became_peered":"2024-04-25T12:21:53.164867+0000","last_unstale":"2024-04-25T12:25:02.505870+0000","last_undegraded":"2024-04-25T12:25:02.505870+0000","last_fullsized":"2024-04-25T12:25:02.505870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-04-25T12:25:02.505770+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-04-25T12:25:02.505770+0000","last_clean_scrub_stamp":"2024-04-25T12:25:02.505770+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:36:53.179964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:14.907210+0000","last_change":"2024-04-25T12:25:14.907272+0000","last_active":"2024-04-25T12:25:14.907210+0000","last_peered":"2024-04-25T12:25:14.907210+0000","last_clean":"2024-04-25T12:25:14.907210+0000","last_became_active":"2024-04-25T12:21:58.259595+0000","last_became_peered":"2024-04-25T12:21:58.259595+0000","last_unstale":"2024-04-25T12:25:14.907210+0000","last_undegraded":"2024-04-25T12:25:14.907210+0000","last_fullsized":"2024-04-25T12:25:14.907210+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:14.907030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:14.907030+0000","last_clean_scrub_stamp":"2024-04-25T12:25:14.907030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:50.740058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:03.809446+0000","last_change":"2024-04-25T12:25:03.809562+0000","last_active":"2024-04-25T12:25:03.809446+0000","last_peered":"2024-04-25T12:25:03.809446+0000","last_clean":"2024-04-25T12:25:03.809446+0000","last_became_active":"2024-04-25T12:21:54.204650+0000","last_became_peered":"2024-04-25T12:21:54.204650+0000","last_unstale":"2024-04-25T12:25:03.809446+0000","last_undegraded":"2024-04-25T12:25:03.809446+0000","last_fullsized":"2024-04-25T12:25:03.809446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:03.809208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:03.809208+0000","last_clean_scrub_stamp":"2024-04-25T12:25:03.809208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:07.086067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'9","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:06.588038+0000","last_change":"2024-04-25T12:25:06.588174+0000","last_active":"2024-04-25T12:25:06.588038+0000","last_peered":"2024-04-25T12:25:06.588038+0000","last_clean":"2024-04-25T12:25:06.588038+0000","last_became_active":"2024-04-25T12:21:53.193466+0000","last_became_peered":"2024-04-25T12:21:53.193466+0000","last_unstale":"2024-04-25T12:25:06.588038+0000","last_undegraded":"2024-04-25T12:25:06.588038+0000","last_fullsized":"2024-04-25T12:25:06.588038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-04-25T12:25:06.587807+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-04-25T12:25:06.587807+0000","last_clean_scrub_stamp":"2024-04-25T12:25:06.587807+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:35.990674+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:15.655490+0000","last_change":"2024-04-25T12:25:15.655552+0000","last_active":"2024-04-25T12:25:15.655490+0000","last_peered":"2024-04-25T12:25:15.655490+0000","last_clean":"2024-04-25T12:25:15.655490+0000","last_became_active":"2024-04-25T12:21:58.347583+0000","last_became_peered":"2024-04-25T12:21:58.347583+0000","last_unstale":"2024-04-25T12:25:15.655490+0000","last_undegraded":"2024-04-25T12:25:15.655490+0000","last_fullsized":"2024-04-25T12:25:15.655490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:15.655307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:15.655307+0000","last_clean_scrub_stamp":"2024-04-25T12:25:15.655307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:42:59.032762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:03.972667+0000","last_change":"2024-04-25T12:25:03.972719+0000","last_active":"2024-04-25T12:25:03.972667+0000","last_peered":"2024-04-25T12:25:03.972667+0000","last_clean":"2024-04-25T12:25:03.972667+0000","last_became_active":"2024-04-25T12:21:54.195939+0000","last_became_peered":"2024-04-25T12:21:54.195939+0000","last_unstale":"2024-04-25T12:25:03.972667+0000","last_undegraded":"2024-04-25T12:25:03.972667+0000","last_fullsized":"2024-04-25T12:25:03.972667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:03.972499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:03.972499+0000","last_clean_scrub_stamp":"2024-04-25T12:25:03.972499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:57.157019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'3","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:05.706550+0000","last_change":"2024-04-25T12:25:05.706674+0000","last_active":"2024-04-25T12:25:05.706550+0000","last_peered":"2024-04-25T12:25:05.706550+0000","last_clean":"2024-04-25T12:25:05.706550+0000","last_became_active":"2024-04-25T12:21:53.196252+0000","last_became_peered":"2024-04-25T12:21:53.196252+0000","last_unstale":"2024-04-25T12:25:05.706550+0000","last_undegraded":"2024-04-25T12:25:05.706550+0000","last_fullsized":"2024-04-25T12:25:05.706550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-04-25T12:25:05.706334+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-04-25T12:25:05.706334+0000","last_clean_scrub_stamp":"2024-04-25T12:25:05.706334+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:15.030187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:16.913358+0000","last_change":"2024-04-25T12:25:16.913416+0000","last_active":"2024-04-25T12:25:16.913358+0000","last_peered":"2024-04-25T12:25:16.913358+0000","last_clean":"2024-04-25T12:25:16.913358+0000","last_became_active":"2024-04-25T12:22:35.031906+0000","last_became_peered":"2024-04-25T12:22:35.031906+0000","last_unstale":"2024-04-25T12:25:16.913358+0000","last_undegraded":"2024-04-25T12:25:16.913358+0000","last_fullsized":"2024-04-25T12:25:16.913358+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:16.913183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:16.913183+0000","last_clean_scrub_stamp":"2024-04-25T12:25:16.913183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:20.457288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:06.948122+0000","last_change":"2024-04-25T12:25:06.948174+0000","last_active":"2024-04-25T12:25:06.948122+0000","last_peered":"2024-04-25T12:25:06.948122+0000","last_clean":"2024-04-25T12:25:06.948122+0000","last_became_active":"2024-04-25T12:21:54.191864+0000","last_became_peered":"2024-04-25T12:21:54.191864+0000","last_unstale":"2024-04-25T12:25:06.948122+0000","last_undegraded":"2024-04-25T12:25:06.948122+0000","last_fullsized":"2024-04-25T12:25:06.948122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:06.947951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:06.947951+0000","last_clean_scrub_stamp":"2024-04-25T12:25:06.947951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:45.663700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:07.024793+0000","last_change":"2024-04-25T12:25:07.024883+0000","last_active":"2024-04-25T12:25:07.024793+0000","last_peered":"2024-04-25T12:25:07.024793+0000","last_clean":"2024-04-25T12:25:07.024793+0000","last_became_active":"2024-04-25T12:21:53.197059+0000","last_became_peered":"2024-04-25T12:21:53.197059+0000","last_unstale":"2024-04-25T12:25:07.024793+0000","last_undegraded":"2024-04-25T12:25:07.024793+0000","last_fullsized":"2024-04-25T12:25:07.024793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-04-25T12:25:07.024434+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-04-25T12:25:07.024434+0000","last_clean_scrub_stamp":"2024-04-25T12:25:07.024434+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:37.065746+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:15.930497+0000","last_change":"2024-04-25T12:25:15.930610+0000","last_active":"2024-04-25T12:25:15.930497+0000","last_peered":"2024-04-25T12:25:15.930497+0000","last_clean":"2024-04-25T12:25:15.930497+0000","last_became_active":"2024-04-25T12:21:58.353996+0000","last_became_peered":"2024-04-25T12:21:58.353996+0000","last_unstale":"2024-04-25T12:25:15.930497+0000","last_undegraded":"2024-04-25T12:25:15.930497+0000","last_fullsized":"2024-04-25T12:25:15.930497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:15.930205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:15.930205+0000","last_clean_scrub_stamp":"2024-04-25T12:25:15.930205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:24:34.091410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:14.824188+0000","last_change":"2024-04-25T12:25:14.824293+0000","last_active":"2024-04-25T12:25:14.824188+0000","last_peered":"2024-04-25T12:25:14.824188+0000","last_clean":"2024-04-25T12:25:14.824188+0000","last_became_active":"2024-04-25T12:21:54.218854+0000","last_became_peered":"2024-04-25T12:21:54.218854+0000","last_unstale":"2024-04-25T12:25:14.824188+0000","last_undegraded":"2024-04-25T12:25:14.824188+0000","last_fullsized":"2024-04-25T12:25:14.824188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:14.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:14.823988+0000","last_clean_scrub_stamp":"2024-04-25T12:25:14.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:58.219222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'9","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:05.540619+0000","last_change":"2024-04-25T12:25:05.540692+0000","last_active":"2024-04-25T12:25:05.540619+0000","last_peered":"2024-04-25T12:25:05.540619+0000","last_clean":"2024-04-25T12:25:05.540619+0000","last_became_active":"2024-04-25T12:21:53.189781+0000","last_became_peered":"2024-04-25T12:21:53.189781+0000","last_unstale":"2024-04-25T12:25:05.540619+0000","last_undegraded":"2024-04-25T12:25:05.540619+0000","last_fullsized":"2024-04-25T12:25:05.540619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-04-25T12:25:05.540421+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-04-25T12:25:05.540421+0000","last_clean_scrub_stamp":"2024-04-25T12:25:05.540421+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:54.309039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:17.773854+0000","last_change":"2024-04-25T12:25:17.773911+0000","last_active":"2024-04-25T12:25:17.773854+0000","last_peered":"2024-04-25T12:25:17.773854+0000","last_clean":"2024-04-25T12:25:17.773854+0000","last_became_active":"2024-04-25T12:21:58.341492+0000","last_became_peered":"2024-04-25T12:21:58.341492+0000","last_unstale":"2024-04-25T12:25:17.773854+0000","last_undegraded":"2024-04-25T12:25:17.773854+0000","last_fullsized":"2024-04-25T12:25:17.773854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:17.773649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:17.773649+0000","last_clean_scrub_stamp":"2024-04-25T12:25:17.773649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:09.398620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:07.581627+0000","last_change":"2024-04-25T12:25:07.581687+0000","last_active":"2024-04-25T12:25:07.581627+0000","last_peered":"2024-04-25T12:25:07.581627+0000","last_clean":"2024-04-25T12:25:07.581627+0000","last_became_active":"2024-04-25T12:21:54.181720+0000","last_became_peered":"2024-04-25T12:21:54.181720+0000","last_unstale":"2024-04-25T12:25:07.581627+0000","last_undegraded":"2024-04-25T12:25:07.581627+0000","last_fullsized":"2024-04-25T12:25:07.581627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:07.581446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:07.581446+0000","last_clean_scrub_stamp":"2024-04-25T12:25:07.581446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:33.004966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'5","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:06.677402+0000","last_change":"2024-04-25T12:25:06.677467+0000","last_active":"2024-04-25T12:25:06.677402+0000","last_peered":"2024-04-25T12:25:06.677402+0000","last_clean":"2024-04-25T12:25:06.677402+0000","last_became_active":"2024-04-25T12:21:53.196102+0000","last_became_peered":"2024-04-25T12:21:53.196102+0000","last_unstale":"2024-04-25T12:25:06.677402+0000","last_undegraded":"2024-04-25T12:25:06.677402+0000","last_fullsized":"2024-04-25T12:25:06.677402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-04-25T12:25:06.677228+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-04-25T12:25:06.677228+0000","last_clean_scrub_stamp":"2024-04-25T12:25:06.677228+0000","objects_scrubbed":3,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:27.886573+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:15.032460+0000","last_change":"2024-04-25T12:25:15.032523+0000","last_active":"2024-04-25T12:25:15.032460+0000","last_peered":"2024-04-25T12:25:15.032460+0000","last_clean":"2024-04-25T12:25:15.032460+0000","last_became_active":"2024-04-25T12:21:58.341558+0000","last_became_peered":"2024-04-25T12:21:58.341558+0000","last_unstale":"2024-04-25T12:25:15.032460+0000","last_undegraded":"2024-04-25T12:25:15.032460+0000","last_fullsized":"2024-04-25T12:25:15.032460+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:15.032265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:15.032265+0000","last_clean_scrub_stamp":"2024-04-25T12:25:15.032265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:53.345181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:11.011627+0000","last_change":"2024-04-25T12:25:11.011728+0000","last_active":"2024-04-25T12:25:11.011627+0000","last_peered":"2024-04-25T12:25:11.011627+0000","last_clean":"2024-04-25T12:25:11.011627+0000","last_became_active":"2024-04-25T12:21:54.205519+0000","last_became_peered":"2024-04-25T12:21:54.205519+0000","last_unstale":"2024-04-25T12:25:11.011627+0000","last_undegraded":"2024-04-25T12:25:11.011627+0000","last_fullsized":"2024-04-25T12:25:11.011627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:11.011366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:11.011366+0000","last_clean_scrub_stamp":"2024-04-25T12:25:11.011366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:05.683334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'1","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:01.464333+0000","last_change":"2024-04-25T12:25:01.464377+0000","last_active":"2024-04-25T12:25:01.464333+0000","last_peered":"2024-04-25T12:25:01.464333+0000","last_clean":"2024-04-25T12:25:01.464333+0000","last_became_active":"2024-04-25T12:21:53.162599+0000","last_became_peered":"2024-04-25T12:21:53.162599+0000","last_unstale":"2024-04-25T12:25:01.464333+0000","last_undegraded":"2024-04-25T12:25:01.464333+0000","last_fullsized":"2024-04-25T12:25:01.464333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-04-25T12:25:01.464249+0000","last_deep_scrub":"28'1","last_deep_scrub_stamp":"2024-04-25T12:25:01.464249+0000","last_clean_scrub_stamp":"2024-04-25T12:25:01.464249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:16.751290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:11.194664+0000","last_change":"2024-04-25T12:25:11.194725+0000","last_active":"2024-04-25T12:25:11.194664+0000","last_peered":"2024-04-25T12:25:11.194664+0000","last_clean":"2024-04-25T12:25:11.194664+0000","last_became_active":"2024-04-25T12:22:34.917798+0000","last_became_peered":"2024-04-25T12:22:34.917798+0000","last_unstale":"2024-04-25T12:25:11.194664+0000","last_undegraded":"2024-04-25T12:25:11.194664+0000","last_fullsized":"2024-04-25T12:25:11.194664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:11.194488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:11.194488+0000","last_clean_scrub_stamp":"2024-04-25T12:25:11.194488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:29.858826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:05.917023+0000","last_change":"2024-04-25T12:25:05.917079+0000","last_active":"2024-04-25T12:25:05.917023+0000","last_peered":"2024-04-25T12:25:05.917023+0000","last_clean":"2024-04-25T12:25:05.917023+0000","last_became_active":"2024-04-25T12:21:54.202112+0000","last_became_peered":"2024-04-25T12:21:54.202112+0000","last_unstale":"2024-04-25T12:25:05.917023+0000","last_undegraded":"2024-04-25T12:25:05.917023+0000","last_fullsized":"2024-04-25T12:25:05.917023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:05.916847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:05.916847+0000","last_clean_scrub_stamp":"2024-04-25T12:25:05.916847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:44.885062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:04.987671+0000","last_change":"2024-04-25T12:25:04.987818+0000","last_active":"2024-04-25T12:25:04.987671+0000","last_peered":"2024-04-25T12:25:04.987671+0000","last_clean":"2024-04-25T12:25:04.987671+0000","last_became_active":"2024-04-25T12:21:53.187855+0000","last_became_peered":"2024-04-25T12:21:53.187855+0000","last_unstale":"2024-04-25T12:25:04.987671+0000","last_undegraded":"2024-04-25T12:25:04.987671+0000","last_fullsized":"2024-04-25T12:25:04.987671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-04-25T12:25:04.987462+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-04-25T12:25:04.987462+0000","last_clean_scrub_stamp":"2024-04-25T12:25:04.987462+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:58.840367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:14.659224+0000","last_change":"2024-04-25T12:25:14.659285+0000","last_active":"2024-04-25T12:25:14.659224+0000","last_peered":"2024-04-25T12:25:14.659224+0000","last_clean":"2024-04-25T12:25:14.659224+0000","last_became_active":"2024-04-25T12:21:58.263425+0000","last_became_peered":"2024-04-25T12:21:58.263425+0000","last_unstale":"2024-04-25T12:25:14.659224+0000","last_undegraded":"2024-04-25T12:25:14.659224+0000","last_fullsized":"2024-04-25T12:25:14.659224+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:14.659028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:14.659028+0000","last_clean_scrub_stamp":"2024-04-25T12:25:14.659028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:10.747112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:09.666068+0000","last_change":"2024-04-25T12:25:09.666179+0000","last_active":"2024-04-25T12:25:09.666068+0000","last_peered":"2024-04-25T12:25:09.666068+0000","last_clean":"2024-04-25T12:25:09.666068+0000","last_became_active":"2024-04-25T12:21:54.188587+0000","last_became_peered":"2024-04-25T12:21:54.188587+0000","last_unstale":"2024-04-25T12:25:09.666068+0000","last_undegraded":"2024-04-25T12:25:09.666068+0000","last_fullsized":"2024-04-25T12:25:09.666068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:09.665862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:09.665862+0000","last_clean_scrub_stamp":"2024-04-25T12:25:09.665862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:49.975735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:03.193974+0000","last_change":"2024-04-25T12:25:03.193998+0000","last_active":"2024-04-25T12:25:03.193974+0000","last_peered":"2024-04-25T12:25:03.193974+0000","last_clean":"2024-04-25T12:25:03.193974+0000","last_became_active":"2024-04-25T12:21:53.159714+0000","last_became_peered":"2024-04-25T12:21:53.159714+0000","last_unstale":"2024-04-25T12:25:03.193974+0000","last_undegraded":"2024-04-25T12:25:03.193974+0000","last_fullsized":"2024-04-25T12:25:03.193974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-04-25T12:25:03.193910+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-04-25T12:25:03.193910+0000","last_clean_scrub_stamp":"2024-04-25T12:25:03.193910+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:49:26.751227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:12.179879+0000","last_change":"2024-04-25T12:25:12.180017+0000","last_active":"2024-04-25T12:25:12.179879+0000","last_peered":"2024-04-25T12:25:12.179879+0000","last_clean":"2024-04-25T12:25:12.179879+0000","last_became_active":"2024-04-25T12:22:34.981347+0000","last_became_peered":"2024-04-25T12:22:34.981347+0000","last_unstale":"2024-04-25T12:25:12.179879+0000","last_undegraded":"2024-04-25T12:25:12.179879+0000","last_fullsized":"2024-04-25T12:25:12.179879+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:12.179664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:12.179664+0000","last_clean_scrub_stamp":"2024-04-25T12:25:12.179664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:42:47.464608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:09.922251+0000","last_change":"2024-04-25T12:25:09.922305+0000","last_active":"2024-04-25T12:25:09.922251+0000","last_peered":"2024-04-25T12:25:09.922251+0000","last_clean":"2024-04-25T12:25:09.922251+0000","last_became_active":"2024-04-25T12:21:54.205023+0000","last_became_peered":"2024-04-25T12:21:54.205023+0000","last_unstale":"2024-04-25T12:25:09.922251+0000","last_undegraded":"2024-04-25T12:25:09.922251+0000","last_fullsized":"2024-04-25T12:25:09.922251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:09.922085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:09.922085+0000","last_clean_scrub_stamp":"2024-04-25T12:25:09.922085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:57.861156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'5","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:07.657967+0000","last_change":"2024-04-25T12:25:07.658040+0000","last_active":"2024-04-25T12:25:07.657967+0000","last_peered":"2024-04-25T12:25:07.657967+0000","last_clean":"2024-04-25T12:25:07.657967+0000","last_became_active":"2024-04-25T12:21:53.197081+0000","last_became_peered":"2024-04-25T12:21:53.197081+0000","last_unstale":"2024-04-25T12:25:07.657967+0000","last_undegraded":"2024-04-25T12:25:07.657967+0000","last_fullsized":"2024-04-25T12:25:07.657967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-04-25T12:25:07.657791+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-04-25T12:25:07.657791+0000","last_clean_scrub_stamp":"2024-04-25T12:25:07.657791+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:48.775748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:16.048406+0000","last_change":"2024-04-25T12:25:16.048468+0000","last_active":"2024-04-25T12:25:16.048406+0000","last_peered":"2024-04-25T12:25:16.048406+0000","last_clean":"2024-04-25T12:25:16.048406+0000","last_became_active":"2024-04-25T12:21:58.342796+0000","last_became_peered":"2024-04-25T12:21:58.342796+0000","last_unstale":"2024-04-25T12:25:16.048406+0000","last_undegraded":"2024-04-25T12:25:16.048406+0000","last_fullsized":"2024-04-25T12:25:16.048406+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:16.048220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:16.048220+0000","last_clean_scrub_stamp":"2024-04-25T12:25:16.048220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:27.251806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:13.837511+0000","last_change":"2024-04-25T12:25:13.837567+0000","last_active":"2024-04-25T12:25:13.837511+0000","last_peered":"2024-04-25T12:25:13.837511+0000","last_clean":"2024-04-25T12:25:13.837511+0000","last_became_active":"2024-04-25T12:21:54.204212+0000","last_became_peered":"2024-04-25T12:21:54.204212+0000","last_unstale":"2024-04-25T12:25:13.837511+0000","last_undegraded":"2024-04-25T12:25:13.837511+0000","last_fullsized":"2024-04-25T12:25:13.837511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:13.837335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:13.837335+0000","last_clean_scrub_stamp":"2024-04-25T12:25:13.837335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:34.028921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:04.010725+0000","last_change":"2024-04-25T12:25:04.010801+0000","last_active":"2024-04-25T12:25:04.010725+0000","last_peered":"2024-04-25T12:25:04.010725+0000","last_clean":"2024-04-25T12:25:04.010725+0000","last_became_active":"2024-04-25T12:21:53.168939+0000","last_became_peered":"2024-04-25T12:21:53.168939+0000","last_unstale":"2024-04-25T12:25:04.010725+0000","last_undegraded":"2024-04-25T12:25:04.010725+0000","last_fullsized":"2024-04-25T12:25:04.010725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-04-25T12:25:04.010553+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-04-25T12:25:04.010553+0000","last_clean_scrub_stamp":"2024-04-25T12:25:04.010553+0000","objects_scrubbed":5,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:35.239770+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":193,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:04.714033+0000","last_change":"2024-04-25T12:25:04.714107+0000","last_active":"2024-04-25T12:25:04.714033+0000","last_peered":"2024-04-25T12:25:04.714033+0000","last_clean":"2024-04-25T12:25:04.714033+0000","last_became_active":"2024-04-25T12:21:42.608579+0000","last_became_peered":"2024-04-25T12:21:42.608579+0000","last_unstale":"2024-04-25T12:25:04.714033+0000","last_undegraded":"2024-04-25T12:25:04.714033+0000","last_fullsized":"2024-04-25T12:25:04.714033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2024-04-25T12:25:04.713863+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2024-04-25T12:25:04.713863+0000","last_clean_scrub_stamp":"2024-04-25T12:25:04.713863+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:44.322180+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:18.053512+0000","last_change":"2024-04-25T12:25:18.053644+0000","last_active":"2024-04-25T12:25:18.053512+0000","last_peered":"2024-04-25T12:25:18.053512+0000","last_clean":"2024-04-25T12:25:18.053512+0000","last_became_active":"2024-04-25T12:21:58.350087+0000","last_became_peered":"2024-04-25T12:21:58.350087+0000","last_unstale":"2024-04-25T12:25:18.053512+0000","last_undegraded":"2024-04-25T12:25:18.053512+0000","last_fullsized":"2024-04-25T12:25:18.053512+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:18.053294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:18.053294+0000","last_clean_scrub_stamp":"2024-04-25T12:25:18.053294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:30.900742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:14.724350+0000","last_change":"2024-04-25T12:25:14.724400+0000","last_active":"2024-04-25T12:25:14.724350+0000","last_peered":"2024-04-25T12:25:14.724350+0000","last_clean":"2024-04-25T12:25:14.724350+0000","last_became_active":"2024-04-25T12:21:54.211077+0000","last_became_peered":"2024-04-25T12:21:54.211077+0000","last_unstale":"2024-04-25T12:25:14.724350+0000","last_undegraded":"2024-04-25T12:25:14.724350+0000","last_fullsized":"2024-04-25T12:25:14.724350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:14.724184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:14.724184+0000","last_clean_scrub_stamp":"2024-04-25T12:25:14.724184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:11.373285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:05.169238+0000","last_change":"2024-04-25T12:25:05.169391+0000","last_active":"2024-04-25T12:25:05.169238+0000","last_peered":"2024-04-25T12:25:05.169238+0000","last_clean":"2024-04-25T12:25:05.169238+0000","last_became_active":"2024-04-25T12:21:53.174980+0000","last_became_peered":"2024-04-25T12:21:53.174980+0000","last_unstale":"2024-04-25T12:25:05.169238+0000","last_undegraded":"2024-04-25T12:25:05.169238+0000","last_fullsized":"2024-04-25T12:25:05.169238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-04-25T12:25:05.169014+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-04-25T12:25:05.169014+0000","last_clean_scrub_stamp":"2024-04-25T12:25:05.169014+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:54.039237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:17.052901+0000","last_change":"2024-04-25T12:25:17.052962+0000","last_active":"2024-04-25T12:25:17.052901+0000","last_peered":"2024-04-25T12:25:17.052901+0000","last_clean":"2024-04-25T12:25:17.052901+0000","last_became_active":"2024-04-25T12:21:58.343502+0000","last_became_peered":"2024-04-25T12:21:58.343502+0000","last_unstale":"2024-04-25T12:25:17.052901+0000","last_undegraded":"2024-04-25T12:25:17.052901+0000","last_fullsized":"2024-04-25T12:25:17.052901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:17.052711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:17.052711+0000","last_clean_scrub_stamp":"2024-04-25T12:25:17.052711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:53.934598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:13.016380+0000","last_change":"2024-04-25T12:25:13.016437+0000","last_active":"2024-04-25T12:25:13.016380+0000","last_peered":"2024-04-25T12:25:13.016380+0000","last_clean":"2024-04-25T12:25:13.016380+0000","last_became_active":"2024-04-25T12:21:54.206749+0000","last_became_peered":"2024-04-25T12:21:54.206749+0000","last_unstale":"2024-04-25T12:25:13.016380+0000","last_undegraded":"2024-04-25T12:25:13.016380+0000","last_fullsized":"2024-04-25T12:25:13.016380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:13.016213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:13.016213+0000","last_clean_scrub_stamp":"2024-04-25T12:25:13.016213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:04.738588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'4","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:03.551232+0000","last_change":"2024-04-25T12:25:03.551275+0000","last_active":"2024-04-25T12:25:03.551232+0000","last_peered":"2024-04-25T12:25:03.551232+0000","last_clean":"2024-04-25T12:25:03.551232+0000","last_became_active":"2024-04-25T12:21:53.179142+0000","last_became_peered":"2024-04-25T12:21:53.179142+0000","last_unstale":"2024-04-25T12:25:03.551232+0000","last_undegraded":"2024-04-25T12:25:03.551232+0000","last_fullsized":"2024-04-25T12:25:03.551232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-04-25T12:25:03.551140+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-04-25T12:25:03.551140+0000","last_clean_scrub_stamp":"2024-04-25T12:25:03.551140+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:21.047002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:13.987006+0000","last_change":"2024-04-25T12:25:13.987069+0000","last_active":"2024-04-25T12:25:13.987006+0000","last_peered":"2024-04-25T12:25:13.987006+0000","last_clean":"2024-04-25T12:25:13.987006+0000","last_became_active":"2024-04-25T12:21:58.253624+0000","last_became_peered":"2024-04-25T12:21:58.253624+0000","last_unstale":"2024-04-25T12:25:13.987006+0000","last_undegraded":"2024-04-25T12:25:13.987006+0000","last_fullsized":"2024-04-25T12:25:13.987006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:13.986829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:13.986829+0000","last_clean_scrub_stamp":"2024-04-25T12:25:13.986829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:23.271518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:19.639162+0000","last_change":"2024-04-25T12:25:19.639223+0000","last_active":"2024-04-25T12:25:19.639162+0000","last_peered":"2024-04-25T12:25:19.639162+0000","last_clean":"2024-04-25T12:25:19.639162+0000","last_became_active":"2024-04-25T12:21:54.219513+0000","last_became_peered":"2024-04-25T12:21:54.219513+0000","last_unstale":"2024-04-25T12:25:19.639162+0000","last_undegraded":"2024-04-25T12:25:19.639162+0000","last_fullsized":"2024-04-25T12:25:19.639162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:19.638987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:19.638987+0000","last_clean_scrub_stamp":"2024-04-25T12:25:19.638987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:37.501057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:02.217553+0000","last_change":"2024-04-25T12:25:02.217630+0000","last_active":"2024-04-25T12:25:02.217553+0000","last_peered":"2024-04-25T12:25:02.217553+0000","last_clean":"2024-04-25T12:25:02.217553+0000","last_became_active":"2024-04-25T12:21:53.159018+0000","last_became_peered":"2024-04-25T12:21:53.159018+0000","last_unstale":"2024-04-25T12:25:02.217553+0000","last_undegraded":"2024-04-25T12:25:02.217553+0000","last_fullsized":"2024-04-25T12:25:02.217553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-25T12:25:02.217391+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-25T12:25:02.217391+0000","last_clean_scrub_stamp":"2024-04-25T12:25:02.217391+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:10.960506+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:19.068945+0000","last_change":"2024-04-25T12:25:19.069010+0000","last_active":"2024-04-25T12:25:19.068945+0000","last_peered":"2024-04-25T12:25:19.068945+0000","last_clean":"2024-04-25T12:25:19.068945+0000","last_became_active":"2024-04-25T12:21:58.343839+0000","last_became_peered":"2024-04-25T12:21:58.343839+0000","last_unstale":"2024-04-25T12:25:19.068945+0000","last_undegraded":"2024-04-25T12:25:19.068945+0000","last_fullsized":"2024-04-25T12:25:19.068945+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:19.068747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:19.068747+0000","last_clean_scrub_stamp":"2024-04-25T12:25:19.068747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:48.381186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:13.723581+0000","last_change":"2024-04-25T12:25:13.723641+0000","last_active":"2024-04-25T12:25:13.723581+0000","last_peered":"2024-04-25T12:25:13.723581+0000","last_clean":"2024-04-25T12:25:13.723581+0000","last_became_active":"2024-04-25T12:21:54.211719+0000","last_became_peered":"2024-04-25T12:21:54.211719+0000","last_unstale":"2024-04-25T12:25:13.723581+0000","last_undegraded":"2024-04-25T12:25:13.723581+0000","last_fullsized":"2024-04-25T12:25:13.723581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:13.723413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:13.723413+0000","last_clean_scrub_stamp":"2024-04-25T12:25:13.723413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:29.565972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'3","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:03.013092+0000","last_change":"2024-04-25T12:25:03.013238+0000","last_active":"2024-04-25T12:25:03.013092+0000","last_peered":"2024-04-25T12:25:03.013092+0000","last_clean":"2024-04-25T12:25:03.013092+0000","last_became_active":"2024-04-25T12:21:53.169743+0000","last_became_peered":"2024-04-25T12:21:53.169743+0000","last_unstale":"2024-04-25T12:25:03.013092+0000","last_undegraded":"2024-04-25T12:25:03.013092+0000","last_fullsized":"2024-04-25T12:25:03.013092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-04-25T12:25:03.012867+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-04-25T12:25:03.012867+0000","last_clean_scrub_stamp":"2024-04-25T12:25:03.012867+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:29.380084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:12.950779+0000","last_change":"2024-04-25T12:25:12.950839+0000","last_active":"2024-04-25T12:25:12.950779+0000","last_peered":"2024-04-25T12:25:12.950779+0000","last_clean":"2024-04-25T12:25:12.950779+0000","last_became_active":"2024-04-25T12:21:58.253256+0000","last_became_peered":"2024-04-25T12:21:58.253256+0000","last_unstale":"2024-04-25T12:25:12.950779+0000","last_undegraded":"2024-04-25T12:25:12.950779+0000","last_fullsized":"2024-04-25T12:25:12.950779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:12.950610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:12.950610+0000","last_clean_scrub_stamp":"2024-04-25T12:25:12.950610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:55.485650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:10.164394+0000","last_change":"2024-04-25T12:25:10.164449+0000","last_active":"2024-04-25T12:25:10.164394+0000","last_peered":"2024-04-25T12:25:10.164394+0000","last_clean":"2024-04-25T12:25:10.164394+0000","last_became_active":"2024-04-25T12:22:34.895584+0000","last_became_peered":"2024-04-25T12:22:34.895584+0000","last_unstale":"2024-04-25T12:25:10.164394+0000","last_undegraded":"2024-04-25T12:25:10.164394+0000","last_fullsized":"2024-04-25T12:25:10.164394+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:10.164217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:10.164217+0000","last_clean_scrub_stamp":"2024-04-25T12:25:10.164217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:04.325185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"28'25","reported_seq":61,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:04.209216+0000","last_change":"2024-04-25T12:25:04.209322+0000","last_active":"2024-04-25T12:25:04.209216+0000","last_peered":"2024-04-25T12:25:04.209216+0000","last_clean":"2024-04-25T12:25:04.209216+0000","last_became_active":"2024-04-25T12:21:53.163565+0000","last_became_peered":"2024-04-25T12:21:53.163565+0000","last_unstale":"2024-04-25T12:25:04.209216+0000","last_undegraded":"2024-04-25T12:25:04.209216+0000","last_fullsized":"2024-04-25T12:25:04.209216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'25","last_scrub_stamp":"2024-04-25T12:25:04.209036+0000","last_deep_scrub":"28'25","last_deep_scrub_stamp":"2024-04-25T12:25:04.209036+0000","last_clean_scrub_stamp":"2024-04-25T12:25:04.209036+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:24:06.395776+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:13.004463+0000","last_change":"2024-04-25T12:25:13.004527+0000","last_active":"2024-04-25T12:25:13.004463+0000","last_peered":"2024-04-25T12:25:13.004463+0000","last_clean":"2024-04-25T12:25:13.004463+0000","last_became_active":"2024-04-25T12:21:58.250136+0000","last_became_peered":"2024-04-25T12:21:58.250136+0000","last_unstale":"2024-04-25T12:25:13.004463+0000","last_undegraded":"2024-04-25T12:25:13.004463+0000","last_fullsized":"2024-04-25T12:25:13.004463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:13.004273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:13.004273+0000","last_clean_scrub_stamp":"2024-04-25T12:25:13.004273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:13.808296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:10.928117+0000","last_change":"2024-04-25T12:25:10.928211+0000","last_active":"2024-04-25T12:25:10.928117+0000","last_peered":"2024-04-25T12:25:10.928117+0000","last_clean":"2024-04-25T12:25:10.928117+0000","last_became_active":"2024-04-25T12:21:54.200187+0000","last_became_peered":"2024-04-25T12:21:54.200187+0000","last_unstale":"2024-04-25T12:25:10.928117+0000","last_undegraded":"2024-04-25T12:25:10.928117+0000","last_fullsized":"2024-04-25T12:25:10.928117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:10.927835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:10.927835+0000","last_clean_scrub_stamp":"2024-04-25T12:25:10.927835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:23.058254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:06.053113+0000","last_change":"2024-04-25T12:25:06.053185+0000","last_active":"2024-04-25T12:25:06.053113+0000","last_peered":"2024-04-25T12:25:06.053113+0000","last_clean":"2024-04-25T12:25:06.053113+0000","last_became_active":"2024-04-25T12:21:53.184866+0000","last_became_peered":"2024-04-25T12:21:53.184866+0000","last_unstale":"2024-04-25T12:25:06.053113+0000","last_undegraded":"2024-04-25T12:25:06.053113+0000","last_fullsized":"2024-04-25T12:25:06.053113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-04-25T12:25:06.052919+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-04-25T12:25:06.052919+0000","last_clean_scrub_stamp":"2024-04-25T12:25:06.052919+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:35.158394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:24.709579+0000","last_change":"2024-04-25T12:21:58.344241+0000","last_active":"2024-04-25T12:24:24.709579+0000","last_peered":"2024-04-25T12:24:24.709579+0000","last_clean":"2024-04-25T12:24:24.709579+0000","last_became_active":"2024-04-25T12:21:58.343764+0000","last_became_peered":"2024-04-25T12:21:58.343764+0000","last_unstale":"2024-04-25T12:24:24.709579+0000","last_undegraded":"2024-04-25T12:24:24.709579+0000","last_fullsized":"2024-04-25T12:24:24.709579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:16.718937+0000","last_change":"2024-04-25T12:25:16.718995+0000","last_active":"2024-04-25T12:25:16.718937+0000","last_peered":"2024-04-25T12:25:16.718937+0000","last_clean":"2024-04-25T12:25:16.718937+0000","last_became_active":"2024-04-25T12:21:54.215575+0000","last_became_peered":"2024-04-25T12:21:54.215575+0000","last_unstale":"2024-04-25T12:25:16.718937+0000","last_undegraded":"2024-04-25T12:25:16.718937+0000","last_fullsized":"2024-04-25T12:25:16.718937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:16.718762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:16.718762+0000","last_clean_scrub_stamp":"2024-04-25T12:25:16.718762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:25.684829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:05.964775+0000","last_change":"2024-04-25T12:25:05.964851+0000","last_active":"2024-04-25T12:25:05.964775+0000","last_peered":"2024-04-25T12:25:05.964775+0000","last_clean":"2024-04-25T12:25:05.964775+0000","last_became_active":"2024-04-25T12:21:53.197618+0000","last_became_peered":"2024-04-25T12:21:53.197618+0000","last_unstale":"2024-04-25T12:25:05.964775+0000","last_undegraded":"2024-04-25T12:25:05.964775+0000","last_fullsized":"2024-04-25T12:25:05.964775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-25T12:25:05.964591+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-25T12:25:05.964591+0000","last_clean_scrub_stamp":"2024-04-25T12:25:05.964591+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:02.928008+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:18.798207+0000","last_change":"2024-04-25T12:25:18.798272+0000","last_active":"2024-04-25T12:25:18.798207+0000","last_peered":"2024-04-25T12:25:18.798207+0000","last_clean":"2024-04-25T12:25:18.798207+0000","last_became_active":"2024-04-25T12:21:58.341575+0000","last_became_peered":"2024-04-25T12:21:58.341575+0000","last_unstale":"2024-04-25T12:25:18.798207+0000","last_undegraded":"2024-04-25T12:25:18.798207+0000","last_fullsized":"2024-04-25T12:25:18.798207+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:18.798027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:18.798027+0000","last_clean_scrub_stamp":"2024-04-25T12:25:18.798027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:17.306829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:08.943891+0000","last_change":"2024-04-25T12:25:08.943977+0000","last_active":"2024-04-25T12:25:08.943891+0000","last_peered":"2024-04-25T12:25:08.943891+0000","last_clean":"2024-04-25T12:25:08.943891+0000","last_became_active":"2024-04-25T12:21:54.200209+0000","last_became_peered":"2024-04-25T12:21:54.200209+0000","last_unstale":"2024-04-25T12:25:08.943891+0000","last_undegraded":"2024-04-25T12:25:08.943891+0000","last_fullsized":"2024-04-25T12:25:08.943891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:08.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:08.943695+0000","last_clean_scrub_stamp":"2024-04-25T12:25:08.943695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:51:34.835324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'13","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:01.909766+0000","last_change":"2024-04-25T12:25:01.909818+0000","last_active":"2024-04-25T12:25:01.909766+0000","last_peered":"2024-04-25T12:25:01.909766+0000","last_clean":"2024-04-25T12:25:01.909766+0000","last_became_active":"2024-04-25T12:21:53.168461+0000","last_became_peered":"2024-04-25T12:21:53.168461+0000","last_unstale":"2024-04-25T12:25:01.909766+0000","last_undegraded":"2024-04-25T12:25:01.909766+0000","last_fullsized":"2024-04-25T12:25:01.909766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2024-04-25T12:25:01.909695+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2024-04-25T12:25:01.909695+0000","last_clean_scrub_stamp":"2024-04-25T12:25:01.909695+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:10.481928+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:18.074260+0000","last_change":"2024-04-25T12:25:18.074321+0000","last_active":"2024-04-25T12:25:18.074260+0000","last_peered":"2024-04-25T12:25:18.074260+0000","last_clean":"2024-04-25T12:25:18.074260+0000","last_became_active":"2024-04-25T12:21:58.343533+0000","last_became_peered":"2024-04-25T12:21:58.343533+0000","last_unstale":"2024-04-25T12:25:18.074260+0000","last_undegraded":"2024-04-25T12:25:18.074260+0000","last_fullsized":"2024-04-25T12:25:18.074260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:18.074085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:18.074085+0000","last_clean_scrub_stamp":"2024-04-25T12:25:18.074085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:57.603011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:17.689083+0000","last_change":"2024-04-25T12:25:17.689137+0000","last_active":"2024-04-25T12:25:17.689083+0000","last_peered":"2024-04-25T12:25:17.689083+0000","last_clean":"2024-04-25T12:25:17.689083+0000","last_became_active":"2024-04-25T12:21:54.216312+0000","last_became_peered":"2024-04-25T12:21:54.216312+0000","last_unstale":"2024-04-25T12:25:17.689083+0000","last_undegraded":"2024-04-25T12:25:17.689083+0000","last_fullsized":"2024-04-25T12:25:17.689083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:17.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:17.688896+0000","last_clean_scrub_stamp":"2024-04-25T12:25:17.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:44.090376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'20","reported_seq":56,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:04.051356+0000","last_change":"2024-04-25T12:25:04.051429+0000","last_active":"2024-04-25T12:25:04.051356+0000","last_peered":"2024-04-25T12:25:04.051356+0000","last_clean":"2024-04-25T12:25:04.051356+0000","last_became_active":"2024-04-25T12:21:53.177229+0000","last_became_peered":"2024-04-25T12:21:53.177229+0000","last_unstale":"2024-04-25T12:25:04.051356+0000","last_undegraded":"2024-04-25T12:25:04.051356+0000","last_fullsized":"2024-04-25T12:25:04.051356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'20","last_scrub_stamp":"2024-04-25T12:25:04.051172+0000","last_deep_scrub":"28'20","last_deep_scrub_stamp":"2024-04-25T12:25:04.051172+0000","last_clean_scrub_stamp":"2024-04-25T12:25:04.051172+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:43.349328+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:13.660493+0000","last_change":"2024-04-25T12:25:13.660554+0000","last_active":"2024-04-25T12:25:13.660493+0000","last_peered":"2024-04-25T12:25:13.660493+0000","last_clean":"2024-04-25T12:25:13.660493+0000","last_became_active":"2024-04-25T12:21:58.244500+0000","last_became_peered":"2024-04-25T12:21:58.244500+0000","last_unstale":"2024-04-25T12:25:13.660493+0000","last_undegraded":"2024-04-25T12:25:13.660493+0000","last_fullsized":"2024-04-25T12:25:13.660493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:13.660316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:13.660316+0000","last_clean_scrub_stamp":"2024-04-25T12:25:13.660316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:58.198806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:07.968340+0000","last_change":"2024-04-25T12:25:07.968396+0000","last_active":"2024-04-25T12:25:07.968340+0000","last_peered":"2024-04-25T12:25:07.968340+0000","last_clean":"2024-04-25T12:25:07.968340+0000","last_became_active":"2024-04-25T12:21:54.213413+0000","last_became_peered":"2024-04-25T12:21:54.213413+0000","last_unstale":"2024-04-25T12:25:07.968340+0000","last_undegraded":"2024-04-25T12:25:07.968340+0000","last_fullsized":"2024-04-25T12:25:07.968340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:07.968166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:07.968166+0000","last_clean_scrub_stamp":"2024-04-25T12:25:07.968166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:07:52.470825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'8","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:04.581882+0000","last_change":"2024-04-25T12:25:04.582015+0000","last_active":"2024-04-25T12:25:04.581882+0000","last_peered":"2024-04-25T12:25:04.581882+0000","last_clean":"2024-04-25T12:25:04.581882+0000","last_became_active":"2024-04-25T12:21:53.186227+0000","last_became_peered":"2024-04-25T12:21:53.186227+0000","last_unstale":"2024-04-25T12:25:04.581882+0000","last_undegraded":"2024-04-25T12:25:04.581882+0000","last_fullsized":"2024-04-25T12:25:04.581882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-04-25T12:25:04.581677+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-04-25T12:25:04.581677+0000","last_clean_scrub_stamp":"2024-04-25T12:25:04.581677+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:25.055618+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:09.880928+0000","last_change":"2024-04-25T12:25:09.881042+0000","last_active":"2024-04-25T12:25:09.880928+0000","last_peered":"2024-04-25T12:25:09.880928+0000","last_clean":"2024-04-25T12:25:09.880928+0000","last_became_active":"2024-04-25T12:21:58.248841+0000","last_became_peered":"2024-04-25T12:21:58.248841+0000","last_unstale":"2024-04-25T12:25:09.880928+0000","last_undegraded":"2024-04-25T12:25:09.880928+0000","last_fullsized":"2024-04-25T12:25:09.880928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:09.880717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:09.880717+0000","last_clean_scrub_stamp":"2024-04-25T12:25:09.880717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:45.081170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:05.954615+0000","last_change":"2024-04-25T12:25:05.954667+0000","last_active":"2024-04-25T12:25:05.954615+0000","last_peered":"2024-04-25T12:25:05.954615+0000","last_clean":"2024-04-25T12:25:05.954615+0000","last_became_active":"2024-04-25T12:21:54.189097+0000","last_became_peered":"2024-04-25T12:21:54.189097+0000","last_unstale":"2024-04-25T12:25:05.954615+0000","last_undegraded":"2024-04-25T12:25:05.954615+0000","last_fullsized":"2024-04-25T12:25:05.954615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:05.954447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:05.954447+0000","last_clean_scrub_stamp":"2024-04-25T12:25:05.954447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:10.215893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'5","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:07.981671+0000","last_change":"2024-04-25T12:25:07.981743+0000","last_active":"2024-04-25T12:25:07.981671+0000","last_peered":"2024-04-25T12:25:07.981671+0000","last_clean":"2024-04-25T12:25:07.981671+0000","last_became_active":"2024-04-25T12:21:53.205742+0000","last_became_peered":"2024-04-25T12:21:53.205742+0000","last_unstale":"2024-04-25T12:25:07.981671+0000","last_undegraded":"2024-04-25T12:25:07.981671+0000","last_fullsized":"2024-04-25T12:25:07.981671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-04-25T12:25:07.981467+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-04-25T12:25:07.981467+0000","last_clean_scrub_stamp":"2024-04-25T12:25:07.981467+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:58.983629+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:15.808643+0000","last_change":"2024-04-25T12:25:15.808767+0000","last_active":"2024-04-25T12:25:15.808643+0000","last_peered":"2024-04-25T12:25:15.808643+0000","last_clean":"2024-04-25T12:25:15.808643+0000","last_became_active":"2024-04-25T12:21:58.260979+0000","last_became_peered":"2024-04-25T12:21:58.260979+0000","last_unstale":"2024-04-25T12:25:15.808643+0000","last_undegraded":"2024-04-25T12:25:15.808643+0000","last_fullsized":"2024-04-25T12:25:15.808643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:15.808424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:15.808424+0000","last_clean_scrub_stamp":"2024-04-25T12:25:15.808424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:19.054531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:09.131187+0000","last_change":"2024-04-25T12:25:09.131242+0000","last_active":"2024-04-25T12:25:09.131187+0000","last_peered":"2024-04-25T12:25:09.131187+0000","last_clean":"2024-04-25T12:25:09.131187+0000","last_became_active":"2024-04-25T12:22:34.889562+0000","last_became_peered":"2024-04-25T12:22:34.889562+0000","last_unstale":"2024-04-25T12:25:09.131187+0000","last_undegraded":"2024-04-25T12:25:09.131187+0000","last_fullsized":"2024-04-25T12:25:09.131187+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:09.131012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:09.131012+0000","last_clean_scrub_stamp":"2024-04-25T12:25:09.131012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:47.025513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:07.978625+0000","last_change":"2024-04-25T12:25:07.978751+0000","last_active":"2024-04-25T12:25:07.978625+0000","last_peered":"2024-04-25T12:25:07.978625+0000","last_clean":"2024-04-25T12:25:07.978625+0000","last_became_active":"2024-04-25T12:21:53.206274+0000","last_became_peered":"2024-04-25T12:21:53.206274+0000","last_unstale":"2024-04-25T12:25:07.978625+0000","last_undegraded":"2024-04-25T12:25:07.978625+0000","last_fullsized":"2024-04-25T12:25:07.978625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-04-25T12:25:07.978316+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-04-25T12:25:07.978316+0000","last_clean_scrub_stamp":"2024-04-25T12:25:07.978316+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:30.184890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:24:19.778550+0000","last_change":"2024-04-25T12:21:58.346593+0000","last_active":"2024-04-25T12:24:19.778550+0000","last_peered":"2024-04-25T12:24:19.778550+0000","last_clean":"2024-04-25T12:24:19.778550+0000","last_became_active":"2024-04-25T12:21:58.346195+0000","last_became_peered":"2024-04-25T12:21:58.346195+0000","last_unstale":"2024-04-25T12:24:19.778550+0000","last_undegraded":"2024-04-25T12:24:19.778550+0000","last_fullsized":"2024-04-25T12:24:19.778550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:21:57.198263+0000","last_clean_scrub_stamp":"2024-04-25T12:21:57.198263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:17.050751+0000","last_change":"2024-04-25T12:25:17.050861+0000","last_active":"2024-04-25T12:25:17.050751+0000","last_peered":"2024-04-25T12:25:17.050751+0000","last_clean":"2024-04-25T12:25:17.050751+0000","last_became_active":"2024-04-25T12:21:58.346887+0000","last_became_peered":"2024-04-25T12:21:58.346887+0000","last_unstale":"2024-04-25T12:25:17.050751+0000","last_undegraded":"2024-04-25T12:25:17.050751+0000","last_fullsized":"2024-04-25T12:25:17.050751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:17.050525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:17.050525+0000","last_clean_scrub_stamp":"2024-04-25T12:25:17.050525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:00.234977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:12.705896+0000","last_change":"2024-04-25T12:25:12.705948+0000","last_active":"2024-04-25T12:25:12.705896+0000","last_peered":"2024-04-25T12:25:12.705896+0000","last_clean":"2024-04-25T12:25:12.705896+0000","last_became_active":"2024-04-25T12:21:54.202399+0000","last_became_peered":"2024-04-25T12:21:54.202399+0000","last_unstale":"2024-04-25T12:25:12.705896+0000","last_undegraded":"2024-04-25T12:25:12.705896+0000","last_fullsized":"2024-04-25T12:25:12.705896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:12.705725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:12.705725+0000","last_clean_scrub_stamp":"2024-04-25T12:25:12.705725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:30.050855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'3","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:07.011509+0000","last_change":"2024-04-25T12:25:07.011575+0000","last_active":"2024-04-25T12:25:07.011509+0000","last_peered":"2024-04-25T12:25:07.011509+0000","last_clean":"2024-04-25T12:25:07.011509+0000","last_became_active":"2024-04-25T12:21:53.189592+0000","last_became_peered":"2024-04-25T12:21:53.189592+0000","last_unstale":"2024-04-25T12:25:07.011509+0000","last_undegraded":"2024-04-25T12:25:07.011509+0000","last_fullsized":"2024-04-25T12:25:07.011509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-04-25T12:25:07.011338+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-04-25T12:25:07.011338+0000","last_clean_scrub_stamp":"2024-04-25T12:25:07.011338+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:04.970996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:16.025135+0000","last_change":"2024-04-25T12:25:16.025196+0000","last_active":"2024-04-25T12:25:16.025135+0000","last_peered":"2024-04-25T12:25:16.025135+0000","last_clean":"2024-04-25T12:25:16.025135+0000","last_became_active":"2024-04-25T12:21:58.245085+0000","last_became_peered":"2024-04-25T12:21:58.245085+0000","last_unstale":"2024-04-25T12:25:16.025135+0000","last_undegraded":"2024-04-25T12:25:16.025135+0000","last_fullsized":"2024-04-25T12:25:16.025135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:16.024958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:16.024958+0000","last_clean_scrub_stamp":"2024-04-25T12:25:16.024958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:48.110420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:01.803711+0000","last_change":"2024-04-25T12:25:01.803733+0000","last_active":"2024-04-25T12:25:01.803711+0000","last_peered":"2024-04-25T12:25:01.803711+0000","last_clean":"2024-04-25T12:25:01.803711+0000","last_became_active":"2024-04-25T12:21:54.206786+0000","last_became_peered":"2024-04-25T12:21:54.206786+0000","last_unstale":"2024-04-25T12:25:01.803711+0000","last_undegraded":"2024-04-25T12:25:01.803711+0000","last_fullsized":"2024-04-25T12:25:01.803711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:01.803628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:01.803628+0000","last_clean_scrub_stamp":"2024-04-25T12:25:01.803628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:27.734459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'4","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:07.778825+0000","last_change":"2024-04-25T12:25:07.778901+0000","last_active":"2024-04-25T12:25:07.778825+0000","last_peered":"2024-04-25T12:25:07.778825+0000","last_clean":"2024-04-25T12:25:07.778825+0000","last_became_active":"2024-04-25T12:21:53.189936+0000","last_became_peered":"2024-04-25T12:21:53.189936+0000","last_unstale":"2024-04-25T12:25:07.778825+0000","last_undegraded":"2024-04-25T12:25:07.778825+0000","last_fullsized":"2024-04-25T12:25:07.778825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-04-25T12:25:07.778636+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-04-25T12:25:07.778636+0000","last_clean_scrub_stamp":"2024-04-25T12:25:07.778636+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:12.297231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:05.082012+0000","last_change":"2024-04-25T12:25:05.082091+0000","last_active":"2024-04-25T12:25:05.082012+0000","last_peered":"2024-04-25T12:25:05.082012+0000","last_clean":"2024-04-25T12:25:05.082012+0000","last_became_active":"2024-04-25T12:21:53.185357+0000","last_became_peered":"2024-04-25T12:21:53.185357+0000","last_unstale":"2024-04-25T12:25:05.082012+0000","last_undegraded":"2024-04-25T12:25:05.082012+0000","last_fullsized":"2024-04-25T12:25:05.082012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-04-25T12:25:05.081840+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-04-25T12:25:05.081840+0000","last_clean_scrub_stamp":"2024-04-25T12:25:05.081840+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:51.108619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:10.959475+0000","last_change":"2024-04-25T12:25:10.959533+0000","last_active":"2024-04-25T12:25:10.959475+0000","last_peered":"2024-04-25T12:25:10.959475+0000","last_clean":"2024-04-25T12:25:10.959475+0000","last_became_active":"2024-04-25T12:21:54.205219+0000","last_became_peered":"2024-04-25T12:21:54.205219+0000","last_unstale":"2024-04-25T12:25:10.959475+0000","last_undegraded":"2024-04-25T12:25:10.959475+0000","last_fullsized":"2024-04-25T12:25:10.959475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:10.959302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:10.959302+0000","last_clean_scrub_stamp":"2024-04-25T12:25:10.959302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:36.642805+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:08.086999+0000","last_change":"2024-04-25T12:25:08.087065+0000","last_active":"2024-04-25T12:25:08.086999+0000","last_peered":"2024-04-25T12:25:08.086999+0000","last_clean":"2024-04-25T12:25:08.086999+0000","last_became_active":"2024-04-25T12:21:58.256219+0000","last_became_peered":"2024-04-25T12:21:58.256219+0000","last_unstale":"2024-04-25T12:25:08.086999+0000","last_undegraded":"2024-04-25T12:25:08.086999+0000","last_fullsized":"2024-04-25T12:25:08.086999+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:08.086779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:08.086779+0000","last_clean_scrub_stamp":"2024-04-25T12:25:08.086779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:59.283329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'8","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:08.782710+0000","last_change":"2024-04-25T12:25:08.782775+0000","last_active":"2024-04-25T12:25:08.782710+0000","last_peered":"2024-04-25T12:25:08.782710+0000","last_clean":"2024-04-25T12:25:08.782710+0000","last_became_active":"2024-04-25T12:21:53.194306+0000","last_became_peered":"2024-04-25T12:21:53.194306+0000","last_unstale":"2024-04-25T12:25:08.782710+0000","last_undegraded":"2024-04-25T12:25:08.782710+0000","last_fullsized":"2024-04-25T12:25:08.782710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-04-25T12:25:08.782544+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-04-25T12:25:08.782544+0000","last_clean_scrub_stamp":"2024-04-25T12:25:08.782544+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:50:53.665948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:04.937933+0000","last_change":"2024-04-25T12:25:04.937989+0000","last_active":"2024-04-25T12:25:04.937933+0000","last_peered":"2024-04-25T12:25:04.937933+0000","last_clean":"2024-04-25T12:25:04.937933+0000","last_became_active":"2024-04-25T12:21:54.196085+0000","last_became_peered":"2024-04-25T12:21:54.196085+0000","last_unstale":"2024-04-25T12:25:04.937933+0000","last_undegraded":"2024-04-25T12:25:04.937933+0000","last_fullsized":"2024-04-25T12:25:04.937933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:04.937717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:04.937717+0000","last_clean_scrub_stamp":"2024-04-25T12:25:04.937717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:19.839416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:16.807098+0000","last_change":"2024-04-25T12:25:16.807231+0000","last_active":"2024-04-25T12:25:16.807098+0000","last_peered":"2024-04-25T12:25:16.807098+0000","last_clean":"2024-04-25T12:25:16.807098+0000","last_became_active":"2024-04-25T12:21:58.260821+0000","last_became_peered":"2024-04-25T12:21:58.260821+0000","last_unstale":"2024-04-25T12:25:16.807098+0000","last_undegraded":"2024-04-25T12:25:16.807098+0000","last_fullsized":"2024-04-25T12:25:16.807098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:16.806845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:16.806845+0000","last_clean_scrub_stamp":"2024-04-25T12:25:16.806845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:13.265152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:11.958545+0000","last_change":"2024-04-25T12:25:11.958601+0000","last_active":"2024-04-25T12:25:11.958545+0000","last_peered":"2024-04-25T12:25:11.958545+0000","last_clean":"2024-04-25T12:25:11.958545+0000","last_became_active":"2024-04-25T12:21:54.200446+0000","last_became_peered":"2024-04-25T12:21:54.200446+0000","last_unstale":"2024-04-25T12:25:11.958545+0000","last_undegraded":"2024-04-25T12:25:11.958545+0000","last_fullsized":"2024-04-25T12:25:11.958545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:11.958333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:11.958333+0000","last_clean_scrub_stamp":"2024-04-25T12:25:11.958333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:31.087585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:06.133378+0000","last_change":"2024-04-25T12:25:06.133435+0000","last_active":"2024-04-25T12:25:06.133378+0000","last_peered":"2024-04-25T12:25:06.133378+0000","last_clean":"2024-04-25T12:25:06.133378+0000","last_became_active":"2024-04-25T12:21:54.187254+0000","last_became_peered":"2024-04-25T12:21:54.187254+0000","last_unstale":"2024-04-25T12:25:06.133378+0000","last_undegraded":"2024-04-25T12:25:06.133378+0000","last_fullsized":"2024-04-25T12:25:06.133378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:06.133189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:06.133189+0000","last_clean_scrub_stamp":"2024-04-25T12:25:06.133189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:11.262025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:11.980421+0000","last_change":"2024-04-25T12:25:11.980472+0000","last_active":"2024-04-25T12:25:11.980421+0000","last_peered":"2024-04-25T12:25:11.980421+0000","last_clean":"2024-04-25T12:25:11.980421+0000","last_became_active":"2024-04-25T12:21:54.204904+0000","last_became_peered":"2024-04-25T12:21:54.204904+0000","last_unstale":"2024-04-25T12:25:11.980421+0000","last_undegraded":"2024-04-25T12:25:11.980421+0000","last_fullsized":"2024-04-25T12:25:11.980421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:11.980247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:11.980247+0000","last_clean_scrub_stamp":"2024-04-25T12:25:11.980247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:53.808737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:00.914064+0000","last_change":"2024-04-25T12:25:00.914092+0000","last_active":"2024-04-25T12:25:00.914064+0000","last_peered":"2024-04-25T12:25:00.914064+0000","last_clean":"2024-04-25T12:25:00.914064+0000","last_became_active":"2024-04-25T12:21:54.203922+0000","last_became_peered":"2024-04-25T12:21:54.203922+0000","last_unstale":"2024-04-25T12:25:00.914064+0000","last_undegraded":"2024-04-25T12:25:00.914064+0000","last_fullsized":"2024-04-25T12:25:00.914064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:00.913977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:00.913977+0000","last_clean_scrub_stamp":"2024-04-25T12:25:00.913977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:39.380897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:02.783091+0000","last_change":"2024-04-25T12:25:02.783116+0000","last_active":"2024-04-25T12:25:02.783091+0000","last_peered":"2024-04-25T12:25:02.783091+0000","last_clean":"2024-04-25T12:25:02.783091+0000","last_became_active":"2024-04-25T12:21:54.206993+0000","last_became_peered":"2024-04-25T12:21:54.206993+0000","last_unstale":"2024-04-25T12:25:02.783091+0000","last_undegraded":"2024-04-25T12:25:02.783091+0000","last_fullsized":"2024-04-25T12:25:02.783091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:02.783003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:02.783003+0000","last_clean_scrub_stamp":"2024-04-25T12:25:02.783003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:17.298278+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:10.684676+0000","last_change":"2024-04-25T12:25:10.684733+0000","last_active":"2024-04-25T12:25:10.684676+0000","last_peered":"2024-04-25T12:25:10.684676+0000","last_clean":"2024-04-25T12:25:10.684676+0000","last_became_active":"2024-04-25T12:21:54.201551+0000","last_became_peered":"2024-04-25T12:21:54.201551+0000","last_unstale":"2024-04-25T12:25:10.684676+0000","last_undegraded":"2024-04-25T12:25:10.684676+0000","last_fullsized":"2024-04-25T12:25:10.684676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:10.684497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:10.684497+0000","last_clean_scrub_stamp":"2024-04-25T12:25:10.684497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:05.310024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:15.009059+0000","last_change":"2024-04-25T12:25:15.009113+0000","last_active":"2024-04-25T12:25:15.009059+0000","last_peered":"2024-04-25T12:25:15.009059+0000","last_clean":"2024-04-25T12:25:15.009059+0000","last_became_active":"2024-04-25T12:21:54.220435+0000","last_became_peered":"2024-04-25T12:21:54.220435+0000","last_unstale":"2024-04-25T12:25:15.009059+0000","last_undegraded":"2024-04-25T12:25:15.009059+0000","last_fullsized":"2024-04-25T12:25:15.009059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:15.008873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:15.008873+0000","last_clean_scrub_stamp":"2024-04-25T12:25:15.008873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:25:07.446517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:05.790978+0000","last_change":"2024-04-25T12:25:05.791030+0000","last_active":"2024-04-25T12:25:05.790978+0000","last_peered":"2024-04-25T12:25:05.790978+0000","last_clean":"2024-04-25T12:25:05.790978+0000","last_became_active":"2024-04-25T12:21:54.204587+0000","last_became_peered":"2024-04-25T12:21:54.204587+0000","last_unstale":"2024-04-25T12:25:05.790978+0000","last_undegraded":"2024-04-25T12:25:05.790978+0000","last_fullsized":"2024-04-25T12:25:05.790978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:05.790802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:05.790802+0000","last_clean_scrub_stamp":"2024-04-25T12:25:05.790802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:05:55.801569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:13.149955+0000","last_change":"2024-04-25T12:25:13.150064+0000","last_active":"2024-04-25T12:25:13.149955+0000","last_peered":"2024-04-25T12:25:13.149955+0000","last_clean":"2024-04-25T12:25:13.149955+0000","last_became_active":"2024-04-25T12:22:35.295116+0000","last_became_peered":"2024-04-25T12:22:35.295116+0000","last_unstale":"2024-04-25T12:25:13.149955+0000","last_undegraded":"2024-04-25T12:25:13.149955+0000","last_fullsized":"2024-04-25T12:25:13.149955+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:13.149743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:13.149743+0000","last_clean_scrub_stamp":"2024-04-25T12:25:13.149743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:42.339081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:12.833582+0000","last_change":"2024-04-25T12:25:12.833635+0000","last_active":"2024-04-25T12:25:12.833582+0000","last_peered":"2024-04-25T12:25:12.833582+0000","last_clean":"2024-04-25T12:25:12.833582+0000","last_became_active":"2024-04-25T12:21:54.203464+0000","last_became_peered":"2024-04-25T12:21:54.203464+0000","last_unstale":"2024-04-25T12:25:12.833582+0000","last_undegraded":"2024-04-25T12:25:12.833582+0000","last_fullsized":"2024-04-25T12:25:12.833582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:12.833417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:12.833417+0000","last_clean_scrub_stamp":"2024-04-25T12:25:12.833417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:11.576709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:16.048328+0000","last_change":"2024-04-25T12:25:16.048422+0000","last_active":"2024-04-25T12:25:16.048328+0000","last_peered":"2024-04-25T12:25:16.048328+0000","last_clean":"2024-04-25T12:25:16.048328+0000","last_became_active":"2024-04-25T12:21:54.212559+0000","last_became_peered":"2024-04-25T12:21:54.212559+0000","last_unstale":"2024-04-25T12:25:16.048328+0000","last_undegraded":"2024-04-25T12:25:16.048328+0000","last_fullsized":"2024-04-25T12:25:16.048328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:16.048107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:16.048107+0000","last_clean_scrub_stamp":"2024-04-25T12:25:16.048107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:36.881625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:11.965946+0000","last_change":"2024-04-25T12:25:11.966000+0000","last_active":"2024-04-25T12:25:11.965946+0000","last_peered":"2024-04-25T12:25:11.965946+0000","last_clean":"2024-04-25T12:25:11.965946+0000","last_became_active":"2024-04-25T12:21:54.215446+0000","last_became_peered":"2024-04-25T12:21:54.215446+0000","last_unstale":"2024-04-25T12:25:11.965946+0000","last_undegraded":"2024-04-25T12:25:11.965946+0000","last_fullsized":"2024-04-25T12:25:11.965946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:11.965750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:11.965750+0000","last_clean_scrub_stamp":"2024-04-25T12:25:11.965750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:18:58.210859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:14.009872+0000","last_change":"2024-04-25T12:25:14.009926+0000","last_active":"2024-04-25T12:25:14.009872+0000","last_peered":"2024-04-25T12:25:14.009872+0000","last_clean":"2024-04-25T12:25:14.009872+0000","last_became_active":"2024-04-25T12:21:54.209393+0000","last_became_peered":"2024-04-25T12:21:54.209393+0000","last_unstale":"2024-04-25T12:25:14.009872+0000","last_undegraded":"2024-04-25T12:25:14.009872+0000","last_fullsized":"2024-04-25T12:25:14.009872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:14.009694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:14.009694+0000","last_clean_scrub_stamp":"2024-04-25T12:25:14.009694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:24.270706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:15.684838+0000","last_change":"2024-04-25T12:25:15.684894+0000","last_active":"2024-04-25T12:25:15.684838+0000","last_peered":"2024-04-25T12:25:15.684838+0000","last_clean":"2024-04-25T12:25:15.684838+0000","last_became_active":"2024-04-25T12:21:54.211787+0000","last_became_peered":"2024-04-25T12:21:54.211787+0000","last_unstale":"2024-04-25T12:25:15.684838+0000","last_undegraded":"2024-04-25T12:25:15.684838+0000","last_fullsized":"2024-04-25T12:25:15.684838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:15.684663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:15.684663+0000","last_clean_scrub_stamp":"2024-04-25T12:25:15.684663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:51.244720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:07.131535+0000","last_change":"2024-04-25T12:25:07.131589+0000","last_active":"2024-04-25T12:25:07.131535+0000","last_peered":"2024-04-25T12:25:07.131535+0000","last_clean":"2024-04-25T12:25:07.131535+0000","last_became_active":"2024-04-25T12:21:54.200123+0000","last_became_peered":"2024-04-25T12:21:54.200123+0000","last_unstale":"2024-04-25T12:25:07.131535+0000","last_undegraded":"2024-04-25T12:25:07.131535+0000","last_fullsized":"2024-04-25T12:25:07.131535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:07.131351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:07.131351+0000","last_clean_scrub_stamp":"2024-04-25T12:25:07.131351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:04.207876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:17.058121+0000","last_change":"2024-04-25T12:25:17.058243+0000","last_active":"2024-04-25T12:25:17.058121+0000","last_peered":"2024-04-25T12:25:17.058121+0000","last_clean":"2024-04-25T12:25:17.058121+0000","last_became_active":"2024-04-25T12:21:54.220272+0000","last_became_peered":"2024-04-25T12:21:54.220272+0000","last_unstale":"2024-04-25T12:25:17.058121+0000","last_undegraded":"2024-04-25T12:25:17.058121+0000","last_fullsized":"2024-04-25T12:25:17.058121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:17.057919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:17.057919+0000","last_clean_scrub_stamp":"2024-04-25T12:25:17.057919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:37.870424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:09.004552+0000","last_change":"2024-04-25T12:25:09.004604+0000","last_active":"2024-04-25T12:25:09.004552+0000","last_peered":"2024-04-25T12:25:09.004552+0000","last_clean":"2024-04-25T12:25:09.004552+0000","last_became_active":"2024-04-25T12:21:54.189535+0000","last_became_peered":"2024-04-25T12:21:54.189535+0000","last_unstale":"2024-04-25T12:25:09.004552+0000","last_undegraded":"2024-04-25T12:25:09.004552+0000","last_fullsized":"2024-04-25T12:25:09.004552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:09.004366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:09.004366+0000","last_clean_scrub_stamp":"2024-04-25T12:25:09.004366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:20.833926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:11.702403+0000","last_change":"2024-04-25T12:25:11.702460+0000","last_active":"2024-04-25T12:25:11.702403+0000","last_peered":"2024-04-25T12:25:11.702403+0000","last_clean":"2024-04-25T12:25:11.702403+0000","last_became_active":"2024-04-25T12:21:54.201641+0000","last_became_peered":"2024-04-25T12:21:54.201641+0000","last_unstale":"2024-04-25T12:25:11.702403+0000","last_undegraded":"2024-04-25T12:25:11.702403+0000","last_fullsized":"2024-04-25T12:25:11.702403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:11.702199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:11.702199+0000","last_clean_scrub_stamp":"2024-04-25T12:25:11.702199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:24.563739+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:07.976611+0000","last_change":"2024-04-25T12:25:07.976666+0000","last_active":"2024-04-25T12:25:07.976611+0000","last_peered":"2024-04-25T12:25:07.976611+0000","last_clean":"2024-04-25T12:25:07.976611+0000","last_became_active":"2024-04-25T12:21:54.192052+0000","last_became_peered":"2024-04-25T12:21:54.192052+0000","last_unstale":"2024-04-25T12:25:07.976611+0000","last_undegraded":"2024-04-25T12:25:07.976611+0000","last_fullsized":"2024-04-25T12:25:07.976611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:07.976423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:07.976423+0000","last_clean_scrub_stamp":"2024-04-25T12:25:07.976423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:39.871737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:11.827564+0000","last_change":"2024-04-25T12:25:11.827616+0000","last_active":"2024-04-25T12:25:11.827564+0000","last_peered":"2024-04-25T12:25:11.827564+0000","last_clean":"2024-04-25T12:25:11.827564+0000","last_became_active":"2024-04-25T12:21:54.203472+0000","last_became_peered":"2024-04-25T12:21:54.203472+0000","last_unstale":"2024-04-25T12:25:11.827564+0000","last_undegraded":"2024-04-25T12:25:11.827564+0000","last_fullsized":"2024-04-25T12:25:11.827564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:11.827391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:11.827391+0000","last_clean_scrub_stamp":"2024-04-25T12:25:11.827391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:15.349388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:06.929267+0000","last_change":"2024-04-25T12:25:06.929321+0000","last_active":"2024-04-25T12:25:06.929267+0000","last_peered":"2024-04-25T12:25:06.929267+0000","last_clean":"2024-04-25T12:25:06.929267+0000","last_became_active":"2024-04-25T12:21:54.203030+0000","last_became_peered":"2024-04-25T12:21:54.203030+0000","last_unstale":"2024-04-25T12:25:06.929267+0000","last_undegraded":"2024-04-25T12:25:06.929267+0000","last_fullsized":"2024-04-25T12:25:06.929267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:06.929096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:06.929096+0000","last_clean_scrub_stamp":"2024-04-25T12:25:06.929096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:05.894136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:09.930283+0000","last_change":"2024-04-25T12:25:09.930339+0000","last_active":"2024-04-25T12:25:09.930283+0000","last_peered":"2024-04-25T12:25:09.930283+0000","last_clean":"2024-04-25T12:25:09.930283+0000","last_became_active":"2024-04-25T12:21:54.199362+0000","last_became_peered":"2024-04-25T12:21:54.199362+0000","last_unstale":"2024-04-25T12:25:09.930283+0000","last_undegraded":"2024-04-25T12:25:09.930283+0000","last_fullsized":"2024-04-25T12:25:09.930283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:09.930072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:09.930072+0000","last_clean_scrub_stamp":"2024-04-25T12:25:09.930072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:47.459211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:08.939087+0000","last_change":"2024-04-25T12:25:08.939140+0000","last_active":"2024-04-25T12:25:08.939087+0000","last_peered":"2024-04-25T12:25:08.939087+0000","last_clean":"2024-04-25T12:25:08.939087+0000","last_became_active":"2024-04-25T12:21:54.198432+0000","last_became_peered":"2024-04-25T12:21:54.198432+0000","last_unstale":"2024-04-25T12:25:08.939087+0000","last_undegraded":"2024-04-25T12:25:08.939087+0000","last_fullsized":"2024-04-25T12:25:08.939087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:08.938920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:08.938920+0000","last_clean_scrub_stamp":"2024-04-25T12:25:08.938920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:25.715922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:18.647837+0000","last_change":"2024-04-25T12:25:18.647950+0000","last_active":"2024-04-25T12:25:18.647837+0000","last_peered":"2024-04-25T12:25:18.647837+0000","last_clean":"2024-04-25T12:25:18.647837+0000","last_became_active":"2024-04-25T12:21:54.216949+0000","last_became_peered":"2024-04-25T12:21:54.216949+0000","last_unstale":"2024-04-25T12:25:18.647837+0000","last_undegraded":"2024-04-25T12:25:18.647837+0000","last_fullsized":"2024-04-25T12:25:18.647837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:18.647612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:18.647612+0000","last_clean_scrub_stamp":"2024-04-25T12:25:18.647612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:50:04.651042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:10.839451+0000","last_change":"2024-04-25T12:25:10.839509+0000","last_active":"2024-04-25T12:25:10.839451+0000","last_peered":"2024-04-25T12:25:10.839451+0000","last_clean":"2024-04-25T12:25:10.839451+0000","last_became_active":"2024-04-25T12:21:54.200248+0000","last_became_peered":"2024-04-25T12:21:54.200248+0000","last_unstale":"2024-04-25T12:25:10.839451+0000","last_undegraded":"2024-04-25T12:25:10.839451+0000","last_fullsized":"2024-04-25T12:25:10.839451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:10.839247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:10.839247+0000","last_clean_scrub_stamp":"2024-04-25T12:25:10.839247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:56.595410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:03.684461+0000","last_change":"2024-04-25T12:25:03.684521+0000","last_active":"2024-04-25T12:25:03.684461+0000","last_peered":"2024-04-25T12:25:03.684461+0000","last_clean":"2024-04-25T12:25:03.684461+0000","last_became_active":"2024-04-25T12:21:54.197028+0000","last_became_peered":"2024-04-25T12:21:54.197028+0000","last_unstale":"2024-04-25T12:25:03.684461+0000","last_undegraded":"2024-04-25T12:25:03.684461+0000","last_fullsized":"2024-04-25T12:25:03.684461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:03.684266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:03.684266+0000","last_clean_scrub_stamp":"2024-04-25T12:25:03.684266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:11.437807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:09.989588+0000","last_change":"2024-04-25T12:25:09.989640+0000","last_active":"2024-04-25T12:25:09.989588+0000","last_peered":"2024-04-25T12:25:09.989588+0000","last_clean":"2024-04-25T12:25:09.989588+0000","last_became_active":"2024-04-25T12:21:54.189711+0000","last_became_peered":"2024-04-25T12:21:54.189711+0000","last_unstale":"2024-04-25T12:25:09.989588+0000","last_undegraded":"2024-04-25T12:25:09.989588+0000","last_fullsized":"2024-04-25T12:25:09.989588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:09.989420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:09.989420+0000","last_clean_scrub_stamp":"2024-04-25T12:25:09.989420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:45.790954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:11.714801+0000","last_change":"2024-04-25T12:25:11.714861+0000","last_active":"2024-04-25T12:25:11.714801+0000","last_peered":"2024-04-25T12:25:11.714801+0000","last_clean":"2024-04-25T12:25:11.714801+0000","last_became_active":"2024-04-25T12:21:54.196933+0000","last_became_peered":"2024-04-25T12:21:54.196933+0000","last_unstale":"2024-04-25T12:25:11.714801+0000","last_undegraded":"2024-04-25T12:25:11.714801+0000","last_fullsized":"2024-04-25T12:25:11.714801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:11.714616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:11.714616+0000","last_clean_scrub_stamp":"2024-04-25T12:25:11.714616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:14:38.510829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:14.044769+0000","last_change":"2024-04-25T12:25:14.044824+0000","last_active":"2024-04-25T12:25:14.044769+0000","last_peered":"2024-04-25T12:25:14.044769+0000","last_clean":"2024-04-25T12:25:14.044769+0000","last_became_active":"2024-04-25T12:21:54.207027+0000","last_became_peered":"2024-04-25T12:21:54.207027+0000","last_unstale":"2024-04-25T12:25:14.044769+0000","last_undegraded":"2024-04-25T12:25:14.044769+0000","last_fullsized":"2024-04-25T12:25:14.044769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:14.044600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:14.044600+0000","last_clean_scrub_stamp":"2024-04-25T12:25:14.044600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:08:22.404623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:03.908236+0000","last_change":"2024-04-25T12:25:03.908272+0000","last_active":"2024-04-25T12:25:03.908236+0000","last_peered":"2024-04-25T12:25:03.908236+0000","last_clean":"2024-04-25T12:25:03.908236+0000","last_became_active":"2024-04-25T12:21:54.184502+0000","last_became_peered":"2024-04-25T12:21:54.184502+0000","last_unstale":"2024-04-25T12:25:03.908236+0000","last_undegraded":"2024-04-25T12:25:03.908236+0000","last_fullsized":"2024-04-25T12:25:03.908236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:03.908133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:03.908133+0000","last_clean_scrub_stamp":"2024-04-25T12:25:03.908133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:07:02.783831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:08.619693+0000","last_change":"2024-04-25T12:25:08.619747+0000","last_active":"2024-04-25T12:25:08.619693+0000","last_peered":"2024-04-25T12:25:08.619693+0000","last_clean":"2024-04-25T12:25:08.619693+0000","last_became_active":"2024-04-25T12:21:54.182924+0000","last_became_peered":"2024-04-25T12:21:54.182924+0000","last_unstale":"2024-04-25T12:25:08.619693+0000","last_undegraded":"2024-04-25T12:25:08.619693+0000","last_fullsized":"2024-04-25T12:25:08.619693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:08.619496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:08.619496+0000","last_clean_scrub_stamp":"2024-04-25T12:25:08.619496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:10.421445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:12.741765+0000","last_change":"2024-04-25T12:25:12.741820+0000","last_active":"2024-04-25T12:25:12.741765+0000","last_peered":"2024-04-25T12:25:12.741765+0000","last_clean":"2024-04-25T12:25:12.741765+0000","last_became_active":"2024-04-25T12:21:54.210333+0000","last_became_peered":"2024-04-25T12:21:54.210333+0000","last_unstale":"2024-04-25T12:25:12.741765+0000","last_undegraded":"2024-04-25T12:25:12.741765+0000","last_fullsized":"2024-04-25T12:25:12.741765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:12.741579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:12.741579+0000","last_clean_scrub_stamp":"2024-04-25T12:25:12.741579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:39.099202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12592,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":25184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":250,"ondisk_log_size":250,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476783,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":921600,"data_stored":712870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476784,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":125616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476783,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":124334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476782,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":121732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542191,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":125650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542192,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":121864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542191,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":121352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542191,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36228,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335612,"statfs":{"total":96636764160,"available":96599666688,"internally_reserved":0,"allocated":913408,"data_stored":711062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:25:24.349 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:24.350 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:24.350 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T12:21:57.198263+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:25:24.351 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T12:25:44.352 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:25:44.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.474+0000 7f8a8382a640 1 Processor -- start 2024-04-25T12:25:44.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.478+0000 7f8a8382a640 1 -- start start 2024-04-25T12:25:44.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.478+0000 7f8a8382a640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f8a7c14fbc0 0x7f8a7c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:44.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.478+0000 7f8a8382a640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8a7c074100 0x7f8a7c0c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:44.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.478+0000 7f8a8382a640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a7c0c5d70 con 0x7f8a7c14ffa0 2024-04-25T12:25:44.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.478+0000 7f8a8382a640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f8a7c0c6050 con 0x7f8a7c074100 2024-04-25T12:25:44.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.478+0000 7f8a8382a640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f8a7c0c6330 con 0x7f8a7c14fbc0 2024-04-25T12:25:44.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.478+0000 7f8a81dc7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8a7c074100 0x7f8a7c0c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:44.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.478+0000 7f8a81dc7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8a7c074100 0x7f8a7c0c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:49620/0 (socket says 172.21.15.94:49620) 2024-04-25T12:25:44.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.478+0000 7f8a81dc7640 1 -- 172.21.15.94:0/3794707212 learned_addr learned my addr 172.21.15.94:0/3794707212 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:44.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.478+0000 7f8a815c6640 1 --2- 172.21.15.94:0/3794707212 >> v2:172.21.15.111:3300/0 conn(0x7f8a7c14fbc0 0x7f8a7c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:44.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.478+0000 7f8a81dc7640 1 -- 172.21.15.94:0/3794707212 >> v2:172.21.15.111:3300/0 conn(0x7f8a7c14fbc0 msgr2=0x7f8a7c06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:44.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.478+0000 7f8a81dc7640 1 --2- 172.21.15.94:0/3794707212 >> v2:172.21.15.111:3300/0 conn(0x7f8a7c14fbc0 0x7f8a7c06f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:44.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.478+0000 7f8a81dc7640 1 -- 172.21.15.94:0/3794707212 >> v1:172.21.15.111:6789/0 conn(0x7f8a7c14ffa0 legacy=0x7f8a7c0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:44.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.478+0000 7f8a81dc7640 1 -- 172.21.15.94:0/3794707212 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7c0c6610 con 0x7f8a7c074100 2024-04-25T12:25:44.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.482+0000 7f8a81dc7640 1 --2- 172.21.15.94:0/3794707212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a7c074100 0x7f8a7c0c7250 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8a74009870 tx=0x7f8a7401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3942c5e1bb08f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:44.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.482+0000 7f8a7bfff640 1 -- 172.21.15.94:0/3794707212 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a740aa660 con 0x7f8a7c074100 2024-04-25T12:25:44.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.482+0000 7f8a7bfff640 1 -- 172.21.15.94:0/3794707212 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a740af070 con 0x7f8a7c074100 2024-04-25T12:25:44.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.482+0000 7f8a7bfff640 1 -- 172.21.15.94:0/3794707212 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a740aaa20 con 0x7f8a7c074100 2024-04-25T12:25:44.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.482+0000 7f8a8382a640 1 -- 172.21.15.94:0/3794707212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a7c074100 msgr2=0x7f8a7c0c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:44.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.482+0000 7f8a8382a640 1 --2- 172.21.15.94:0/3794707212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a7c074100 0x7f8a7c0c7250 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8a74009870 tx=0x7f8a7401c4e0 comp rx=0 tx=0).stop 2024-04-25T12:25:44.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.482+0000 7f8a8382a640 1 -- 172.21.15.94:0/3794707212 shutdown_connections 2024-04-25T12:25:44.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.482+0000 7f8a8382a640 1 --2- 172.21.15.94:0/3794707212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a7c074100 0x7f8a7c0c7250 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:44.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.482+0000 7f8a8382a640 1 --2- 172.21.15.94:0/3794707212 >> v2:172.21.15.111:3300/0 conn(0x7f8a7c14fbc0 0x7f8a7c06f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:44.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.482+0000 7f8a8382a640 1 -- 172.21.15.94:0/3794707212 >> 172.21.15.94:0/3794707212 conn(0x7f8a7c06b9d0 msgr2=0x7f8a7c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:44.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.482+0000 7f8a8382a640 1 -- 172.21.15.94:0/3794707212 shutdown_connections 2024-04-25T12:25:44.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.482+0000 7f8a8382a640 1 -- 172.21.15.94:0/3794707212 wait complete. 2024-04-25T12:25:44.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.482+0000 7f8a8382a640 1 Processor -- start 2024-04-25T12:25:44.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.482+0000 7f8a8382a640 1 -- start start 2024-04-25T12:25:44.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a8382a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a7c074100 0x7f8a7c1f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:44.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a8382a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a7c14fbc0 0x7f8a7c161a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:44.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a8382a640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a7c14ffa0 0x7f8a7c142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:44.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a8382a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c0c8ab0 con 0x7f8a7c14fbc0 2024-04-25T12:25:44.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a8382a640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c0c8930 con 0x7f8a7c074100 2024-04-25T12:25:44.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a8382a640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f8a7c166090 con 0x7f8a7c14ffa0 2024-04-25T12:25:44.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a80dc5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a7c14fbc0 0x7f8a7c161a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:44.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a80dc5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a7c14fbc0 0x7f8a7c161a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:49628/0 (socket says 172.21.15.94:49628) 2024-04-25T12:25:44.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a80dc5640 1 -- 172.21.15.94:0/4253309879 learned_addr learned my addr 172.21.15.94:0/4253309879 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:44.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a815c6640 1 --2- 172.21.15.94:0/4253309879 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a7c074100 0x7f8a7c1f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:44.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a81dc7640 1 --2- 172.21.15.94:0/4253309879 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a7c14ffa0 0x7f8a7c142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:44.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a80dc5640 1 -- 172.21.15.94:0/4253309879 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a7c14ffa0 msgr2=0x7f8a7c142d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:44.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a80dc5640 1 --2- 172.21.15.94:0/4253309879 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a7c14ffa0 0x7f8a7c142d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:44.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a80dc5640 1 -- 172.21.15.94:0/4253309879 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a7c074100 msgr2=0x7f8a7c1f4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:44.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a80dc5640 1 --2- 172.21.15.94:0/4253309879 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a7c074100 0x7f8a7c1f4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:44.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a80dc5640 1 -- 172.21.15.94:0/4253309879 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7c163020 con 0x7f8a7c14fbc0 2024-04-25T12:25:44.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a815c6640 1 --2- 172.21.15.94:0/4253309879 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a7c074100 0x7f8a7c1f4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:25:44.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a80dc5640 1 --2- 172.21.15.94:0/4253309879 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a7c14fbc0 0x7f8a7c161a40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000ba80 tx=0x7f8a7000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:44.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a79ffb640 1 -- 172.21.15.94:0/4253309879 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7000cc00 con 0x7f8a7c14fbc0 2024-04-25T12:25:44.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a79ffb640 1 -- 172.21.15.94:0/4253309879 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a7000cda0 con 0x7f8a7c14fbc0 2024-04-25T12:25:44.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a8382a640 1 -- 172.21.15.94:0/4253309879 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a7c163300 con 0x7f8a7c14fbc0 2024-04-25T12:25:44.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a79ffb640 1 -- 172.21.15.94:0/4253309879 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70003bc0 con 0x7f8a7c14fbc0 2024-04-25T12:25:44.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a8382a640 1 -- 172.21.15.94:0/4253309879 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a7c1f43d0 con 0x7f8a7c14fbc0 2024-04-25T12:25:44.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a8382a640 1 -- 172.21.15.94:0/4253309879 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a7c075df0 con 0x7f8a7c14fbc0 2024-04-25T12:25:44.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a79ffb640 1 -- 172.21.15.94:0/4253309879 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8a70006d10 con 0x7f8a7c14fbc0 2024-04-25T12:25:44.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a79ffb640 1 --2- 172.21.15.94:0/4253309879 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8a68068380 0x7f8a6806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:44.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a79ffb640 1 -- 172.21.15.94:0/4253309879 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f8a70086a30 con 0x7f8a7c14fbc0 2024-04-25T12:25:44.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a815c6640 1 --2- 172.21.15.94:0/4253309879 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8a68068380 0x7f8a6806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:44.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.486+0000 7f8a815c6640 1 --2- 172.21.15.94:0/4253309879 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8a68068380 0x7f8a6806a840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c006fd0 tx=0x7f8a6c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:44.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.490+0000 7f8a79ffb640 1 -- 172.21.15.94:0/4253309879 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8a70056bf0 con 0x7f8a7c14fbc0 2024-04-25T12:25:44.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.650+0000 7f8a8382a640 1 -- 172.21.15.94:0/4253309879 --> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8a7c149c50 con 0x7f8a68068380 2024-04-25T12:25:44.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.670+0000 7f8a79ffb640 1 -- 172.21.15.94:0/4253309879 <== mgr.4101 v2:172.21.15.94:6832/549402167 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332743 (secure 0 0 0) 0x7f8a7c149c50 con 0x7f8a68068380 2024-04-25T12:25:44.680 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:25:44.682 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-04-25T12:25:44.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.674+0000 7f8a8382a640 1 -- 172.21.15.94:0/4253309879 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8a68068380 msgr2=0x7f8a6806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:44.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.674+0000 7f8a8382a640 1 --2- 172.21.15.94:0/4253309879 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8a68068380 0x7f8a6806a840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c006fd0 tx=0x7f8a6c008040 comp rx=0 tx=0).stop 2024-04-25T12:25:44.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.674+0000 7f8a8382a640 1 -- 172.21.15.94:0/4253309879 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a7c14fbc0 msgr2=0x7f8a7c161a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:44.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.674+0000 7f8a8382a640 1 --2- 172.21.15.94:0/4253309879 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a7c14fbc0 0x7f8a7c161a40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000ba80 tx=0x7f8a7000bf40 comp rx=0 tx=0).stop 2024-04-25T12:25:44.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.674+0000 7f8a8382a640 1 -- 172.21.15.94:0/4253309879 shutdown_connections 2024-04-25T12:25:44.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.674+0000 7f8a8382a640 1 --2- 172.21.15.94:0/4253309879 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f8a68068380 0x7f8a6806a840 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:44.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.674+0000 7f8a8382a640 1 --2- 172.21.15.94:0/4253309879 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a7c14ffa0 0x7f8a7c142d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:44.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.674+0000 7f8a8382a640 1 --2- 172.21.15.94:0/4253309879 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a7c14fbc0 0x7f8a7c161a40 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:44.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.674+0000 7f8a8382a640 1 --2- 172.21.15.94:0/4253309879 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a7c074100 0x7f8a7c1f4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:44.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.674+0000 7f8a8382a640 1 -- 172.21.15.94:0/4253309879 >> 172.21.15.94:0/4253309879 conn(0x7f8a7c06b9d0 msgr2=0x7f8a7c14ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:44.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.674+0000 7f8a8382a640 1 -- 172.21.15.94:0/4253309879 shutdown_connections 2024-04-25T12:25:44.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.674+0000 7f8a8382a640 1 -- 172.21.15.94:0/4253309879 wait complete. 2024-04-25T12:25:44.698 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-04-25T12:25:43.835632+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602960,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":380,"num_write_kb":2495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":369,"ondisk_log_size":369,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240616,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734104,"statfs":{"total":773094113280,"available":772847722496,"internally_reserved":0,"allocated":3776512,"data_stored":2164480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005164"},"pg_stats":[{"pgid":"2.1f","version":"28'17","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:02.950410+0000","last_change":"2024-04-25T12:25:02.950440+0000","last_active":"2024-04-25T12:25:02.950410+0000","last_peered":"2024-04-25T12:25:02.950410+0000","last_clean":"2024-04-25T12:25:02.950410+0000","last_became_active":"2024-04-25T12:21:53.194480+0000","last_became_peered":"2024-04-25T12:21:53.194480+0000","last_unstale":"2024-04-25T12:25:02.950410+0000","last_undegraded":"2024-04-25T12:25:02.950410+0000","last_fullsized":"2024-04-25T12:25:02.950410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'17","last_scrub_stamp":"2024-04-25T12:25:02.950337+0000","last_deep_scrub":"28'17","last_deep_scrub_stamp":"2024-04-25T12:25:02.950337+0000","last_clean_scrub_stamp":"2024-04-25T12:25:02.950337+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:54:13.356764+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:09.799771+0000","last_change":"2024-04-25T12:25:09.799826+0000","last_active":"2024-04-25T12:25:09.799771+0000","last_peered":"2024-04-25T12:25:09.799771+0000","last_clean":"2024-04-25T12:25:09.799771+0000","last_became_active":"2024-04-25T12:21:54.199679+0000","last_became_peered":"2024-04-25T12:21:54.199679+0000","last_unstale":"2024-04-25T12:25:09.799771+0000","last_undegraded":"2024-04-25T12:25:09.799771+0000","last_fullsized":"2024-04-25T12:25:09.799771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:09.799590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:09.799590+0000","last_clean_scrub_stamp":"2024-04-25T12:25:09.799590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:33:04.145443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:21.816801+0000","last_change":"2024-04-25T12:25:21.816857+0000","last_active":"2024-04-25T12:25:21.816801+0000","last_peered":"2024-04-25T12:25:21.816801+0000","last_clean":"2024-04-25T12:25:21.816801+0000","last_became_active":"2024-04-25T12:21:58.346337+0000","last_became_peered":"2024-04-25T12:21:58.346337+0000","last_unstale":"2024-04-25T12:25:21.816801+0000","last_undegraded":"2024-04-25T12:25:21.816801+0000","last_fullsized":"2024-04-25T12:25:21.816801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:21.816615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:21.816615+0000","last_clean_scrub_stamp":"2024-04-25T12:25:21.816615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:47.332514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:06.786075+0000","last_change":"2024-04-25T12:25:06.786139+0000","last_active":"2024-04-25T12:25:06.786075+0000","last_peered":"2024-04-25T12:25:06.786075+0000","last_clean":"2024-04-25T12:25:06.786075+0000","last_became_active":"2024-04-25T12:21:53.165990+0000","last_became_peered":"2024-04-25T12:21:53.165990+0000","last_unstale":"2024-04-25T12:25:06.786075+0000","last_undegraded":"2024-04-25T12:25:06.786075+0000","last_fullsized":"2024-04-25T12:25:06.786075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-04-25T12:25:06.785902+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-04-25T12:25:06.785902+0000","last_clean_scrub_stamp":"2024-04-25T12:25:06.785902+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:00.437912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:04.936764+0000","last_change":"2024-04-25T12:25:04.936828+0000","last_active":"2024-04-25T12:25:04.936764+0000","last_peered":"2024-04-25T12:25:04.936764+0000","last_clean":"2024-04-25T12:25:04.936764+0000","last_became_active":"2024-04-25T12:21:54.188987+0000","last_became_peered":"2024-04-25T12:21:54.188987+0000","last_unstale":"2024-04-25T12:25:04.936764+0000","last_undegraded":"2024-04-25T12:25:04.936764+0000","last_fullsized":"2024-04-25T12:25:04.936764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:04.936544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:04.936544+0000","last_clean_scrub_stamp":"2024-04-25T12:25:04.936544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:53:57.716206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:11.966886+0000","last_change":"2024-04-25T12:25:11.966955+0000","last_active":"2024-04-25T12:25:11.966886+0000","last_peered":"2024-04-25T12:25:11.966886+0000","last_clean":"2024-04-25T12:25:11.966886+0000","last_became_active":"2024-04-25T12:21:58.250542+0000","last_became_peered":"2024-04-25T12:21:58.250542+0000","last_unstale":"2024-04-25T12:25:11.966886+0000","last_undegraded":"2024-04-25T12:25:11.966886+0000","last_fullsized":"2024-04-25T12:25:11.966886+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:11.966640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:11.966640+0000","last_clean_scrub_stamp":"2024-04-25T12:25:11.966640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:18.064520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'16","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:08.678413+0000","last_change":"2024-04-25T12:25:08.678495+0000","last_active":"2024-04-25T12:25:08.678413+0000","last_peered":"2024-04-25T12:25:08.678413+0000","last_clean":"2024-04-25T12:25:08.678413+0000","last_became_active":"2024-04-25T12:21:53.202760+0000","last_became_peered":"2024-04-25T12:21:53.202760+0000","last_unstale":"2024-04-25T12:25:08.678413+0000","last_undegraded":"2024-04-25T12:25:08.678413+0000","last_fullsized":"2024-04-25T12:25:08.678413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'16","last_scrub_stamp":"2024-04-25T12:25:08.678215+0000","last_deep_scrub":"28'16","last_deep_scrub_stamp":"2024-04-25T12:25:08.678215+0000","last_clean_scrub_stamp":"2024-04-25T12:25:08.678215+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:05.859008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:15.046439+0000","last_change":"2024-04-25T12:25:15.046497+0000","last_active":"2024-04-25T12:25:15.046439+0000","last_peered":"2024-04-25T12:25:15.046439+0000","last_clean":"2024-04-25T12:25:15.046439+0000","last_became_active":"2024-04-25T12:21:54.208093+0000","last_became_peered":"2024-04-25T12:21:54.208093+0000","last_unstale":"2024-04-25T12:25:15.046439+0000","last_undegraded":"2024-04-25T12:25:15.046439+0000","last_fullsized":"2024-04-25T12:25:15.046439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:15.046249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:15.046249+0000","last_clean_scrub_stamp":"2024-04-25T12:25:15.046249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:03.282446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:13.937600+0000","last_change":"2024-04-25T12:25:13.937660+0000","last_active":"2024-04-25T12:25:13.937600+0000","last_peered":"2024-04-25T12:25:13.937600+0000","last_clean":"2024-04-25T12:25:13.937600+0000","last_became_active":"2024-04-25T12:21:58.254021+0000","last_became_peered":"2024-04-25T12:21:58.254021+0000","last_unstale":"2024-04-25T12:25:13.937600+0000","last_undegraded":"2024-04-25T12:25:13.937600+0000","last_fullsized":"2024-04-25T12:25:13.937600+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:13.937424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:13.937424+0000","last_clean_scrub_stamp":"2024-04-25T12:25:13.937424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:36.247253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'6","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:10.690238+0000","last_change":"2024-04-25T12:25:10.690308+0000","last_active":"2024-04-25T12:25:10.690238+0000","last_peered":"2024-04-25T12:25:10.690238+0000","last_clean":"2024-04-25T12:25:10.690238+0000","last_became_active":"2024-04-25T12:21:53.207929+0000","last_became_peered":"2024-04-25T12:21:53.207929+0000","last_unstale":"2024-04-25T12:25:10.690238+0000","last_undegraded":"2024-04-25T12:25:10.690238+0000","last_fullsized":"2024-04-25T12:25:10.690238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-25T12:25:10.690075+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-25T12:25:10.690075+0000","last_clean_scrub_stamp":"2024-04-25T12:25:10.690075+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:02.510735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:03.044298+0000","last_change":"2024-04-25T12:25:03.044399+0000","last_active":"2024-04-25T12:25:03.044298+0000","last_peered":"2024-04-25T12:25:03.044298+0000","last_clean":"2024-04-25T12:25:03.044298+0000","last_became_active":"2024-04-25T12:21:54.206138+0000","last_became_peered":"2024-04-25T12:21:54.206138+0000","last_unstale":"2024-04-25T12:25:03.044298+0000","last_undegraded":"2024-04-25T12:25:03.044298+0000","last_fullsized":"2024-04-25T12:25:03.044298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:03.044084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:03.044084+0000","last_clean_scrub_stamp":"2024-04-25T12:25:03.044084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:02:04.875380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:08.927359+0000","last_change":"2024-04-25T12:25:08.927418+0000","last_active":"2024-04-25T12:25:08.927359+0000","last_peered":"2024-04-25T12:25:08.927359+0000","last_clean":"2024-04-25T12:25:08.927359+0000","last_became_active":"2024-04-25T12:21:58.244313+0000","last_became_peered":"2024-04-25T12:21:58.244313+0000","last_unstale":"2024-04-25T12:25:08.927359+0000","last_undegraded":"2024-04-25T12:25:08.927359+0000","last_fullsized":"2024-04-25T12:25:08.927359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:08.927164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:08.927164+0000","last_clean_scrub_stamp":"2024-04-25T12:25:08.927164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:45.878771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:13.008017+0000","last_change":"2024-04-25T12:25:13.008072+0000","last_active":"2024-04-25T12:25:13.008017+0000","last_peered":"2024-04-25T12:25:13.008017+0000","last_clean":"2024-04-25T12:25:13.008017+0000","last_became_active":"2024-04-25T12:21:54.208338+0000","last_became_peered":"2024-04-25T12:21:54.208338+0000","last_unstale":"2024-04-25T12:25:13.008017+0000","last_undegraded":"2024-04-25T12:25:13.008017+0000","last_fullsized":"2024-04-25T12:25:13.008017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:13.007834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:13.007834+0000","last_clean_scrub_stamp":"2024-04-25T12:25:13.007834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:15.613849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'6","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:09.648498+0000","last_change":"2024-04-25T12:25:09.648565+0000","last_active":"2024-04-25T12:25:09.648498+0000","last_peered":"2024-04-25T12:25:09.648498+0000","last_clean":"2024-04-25T12:25:09.648498+0000","last_became_active":"2024-04-25T12:21:53.197141+0000","last_became_peered":"2024-04-25T12:21:53.197141+0000","last_unstale":"2024-04-25T12:25:09.648498+0000","last_undegraded":"2024-04-25T12:25:09.648498+0000","last_fullsized":"2024-04-25T12:25:09.648498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-25T12:25:09.648336+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-25T12:25:09.648336+0000","last_clean_scrub_stamp":"2024-04-25T12:25:09.648336+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:46.603409+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:10.931161+0000","last_change":"2024-04-25T12:25:10.931219+0000","last_active":"2024-04-25T12:25:10.931161+0000","last_peered":"2024-04-25T12:25:10.931161+0000","last_clean":"2024-04-25T12:25:10.931161+0000","last_became_active":"2024-04-25T12:21:58.249079+0000","last_became_peered":"2024-04-25T12:21:58.249079+0000","last_unstale":"2024-04-25T12:25:10.931161+0000","last_undegraded":"2024-04-25T12:25:10.931161+0000","last_fullsized":"2024-04-25T12:25:10.931161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:10.930982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:10.930982+0000","last_clean_scrub_stamp":"2024-04-25T12:25:10.930982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:29.938110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:04.823243+0000","last_change":"2024-04-25T12:25:04.823298+0000","last_active":"2024-04-25T12:25:04.823243+0000","last_peered":"2024-04-25T12:25:04.823243+0000","last_clean":"2024-04-25T12:25:04.823243+0000","last_became_active":"2024-04-25T12:21:54.208802+0000","last_became_peered":"2024-04-25T12:21:54.208802+0000","last_unstale":"2024-04-25T12:25:04.823243+0000","last_undegraded":"2024-04-25T12:25:04.823243+0000","last_fullsized":"2024-04-25T12:25:04.823243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:04.823059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:04.823059+0000","last_clean_scrub_stamp":"2024-04-25T12:25:04.823059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:28.654768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'4","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:02.505870+0000","last_change":"2024-04-25T12:25:02.505914+0000","last_active":"2024-04-25T12:25:02.505870+0000","last_peered":"2024-04-25T12:25:02.505870+0000","last_clean":"2024-04-25T12:25:02.505870+0000","last_became_active":"2024-04-25T12:21:53.164867+0000","last_became_peered":"2024-04-25T12:21:53.164867+0000","last_unstale":"2024-04-25T12:25:02.505870+0000","last_undegraded":"2024-04-25T12:25:02.505870+0000","last_fullsized":"2024-04-25T12:25:02.505870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-04-25T12:25:02.505770+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-04-25T12:25:02.505770+0000","last_clean_scrub_stamp":"2024-04-25T12:25:02.505770+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:36:53.179964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:14.907210+0000","last_change":"2024-04-25T12:25:14.907272+0000","last_active":"2024-04-25T12:25:14.907210+0000","last_peered":"2024-04-25T12:25:14.907210+0000","last_clean":"2024-04-25T12:25:14.907210+0000","last_became_active":"2024-04-25T12:21:58.259595+0000","last_became_peered":"2024-04-25T12:21:58.259595+0000","last_unstale":"2024-04-25T12:25:14.907210+0000","last_undegraded":"2024-04-25T12:25:14.907210+0000","last_fullsized":"2024-04-25T12:25:14.907210+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:14.907030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:14.907030+0000","last_clean_scrub_stamp":"2024-04-25T12:25:14.907030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:50.740058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:03.809446+0000","last_change":"2024-04-25T12:25:03.809562+0000","last_active":"2024-04-25T12:25:03.809446+0000","last_peered":"2024-04-25T12:25:03.809446+0000","last_clean":"2024-04-25T12:25:03.809446+0000","last_became_active":"2024-04-25T12:21:54.204650+0000","last_became_peered":"2024-04-25T12:21:54.204650+0000","last_unstale":"2024-04-25T12:25:03.809446+0000","last_undegraded":"2024-04-25T12:25:03.809446+0000","last_fullsized":"2024-04-25T12:25:03.809446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:03.809208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:03.809208+0000","last_clean_scrub_stamp":"2024-04-25T12:25:03.809208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:07.086067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'9","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:06.588038+0000","last_change":"2024-04-25T12:25:06.588174+0000","last_active":"2024-04-25T12:25:06.588038+0000","last_peered":"2024-04-25T12:25:06.588038+0000","last_clean":"2024-04-25T12:25:06.588038+0000","last_became_active":"2024-04-25T12:21:53.193466+0000","last_became_peered":"2024-04-25T12:21:53.193466+0000","last_unstale":"2024-04-25T12:25:06.588038+0000","last_undegraded":"2024-04-25T12:25:06.588038+0000","last_fullsized":"2024-04-25T12:25:06.588038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-04-25T12:25:06.587807+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-04-25T12:25:06.587807+0000","last_clean_scrub_stamp":"2024-04-25T12:25:06.587807+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:35.990674+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:15.655490+0000","last_change":"2024-04-25T12:25:15.655552+0000","last_active":"2024-04-25T12:25:15.655490+0000","last_peered":"2024-04-25T12:25:15.655490+0000","last_clean":"2024-04-25T12:25:15.655490+0000","last_became_active":"2024-04-25T12:21:58.347583+0000","last_became_peered":"2024-04-25T12:21:58.347583+0000","last_unstale":"2024-04-25T12:25:15.655490+0000","last_undegraded":"2024-04-25T12:25:15.655490+0000","last_fullsized":"2024-04-25T12:25:15.655490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:15.655307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:15.655307+0000","last_clean_scrub_stamp":"2024-04-25T12:25:15.655307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:42:59.032762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:03.972667+0000","last_change":"2024-04-25T12:25:03.972719+0000","last_active":"2024-04-25T12:25:03.972667+0000","last_peered":"2024-04-25T12:25:03.972667+0000","last_clean":"2024-04-25T12:25:03.972667+0000","last_became_active":"2024-04-25T12:21:54.195939+0000","last_became_peered":"2024-04-25T12:21:54.195939+0000","last_unstale":"2024-04-25T12:25:03.972667+0000","last_undegraded":"2024-04-25T12:25:03.972667+0000","last_fullsized":"2024-04-25T12:25:03.972667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:03.972499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:03.972499+0000","last_clean_scrub_stamp":"2024-04-25T12:25:03.972499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:57.157019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'3","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:05.706550+0000","last_change":"2024-04-25T12:25:05.706674+0000","last_active":"2024-04-25T12:25:05.706550+0000","last_peered":"2024-04-25T12:25:05.706550+0000","last_clean":"2024-04-25T12:25:05.706550+0000","last_became_active":"2024-04-25T12:21:53.196252+0000","last_became_peered":"2024-04-25T12:21:53.196252+0000","last_unstale":"2024-04-25T12:25:05.706550+0000","last_undegraded":"2024-04-25T12:25:05.706550+0000","last_fullsized":"2024-04-25T12:25:05.706550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-04-25T12:25:05.706334+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-04-25T12:25:05.706334+0000","last_clean_scrub_stamp":"2024-04-25T12:25:05.706334+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:15.030187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:16.913358+0000","last_change":"2024-04-25T12:25:16.913416+0000","last_active":"2024-04-25T12:25:16.913358+0000","last_peered":"2024-04-25T12:25:16.913358+0000","last_clean":"2024-04-25T12:25:16.913358+0000","last_became_active":"2024-04-25T12:22:35.031906+0000","last_became_peered":"2024-04-25T12:22:35.031906+0000","last_unstale":"2024-04-25T12:25:16.913358+0000","last_undegraded":"2024-04-25T12:25:16.913358+0000","last_fullsized":"2024-04-25T12:25:16.913358+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:16.913183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:16.913183+0000","last_clean_scrub_stamp":"2024-04-25T12:25:16.913183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:20.457288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:06.948122+0000","last_change":"2024-04-25T12:25:06.948174+0000","last_active":"2024-04-25T12:25:06.948122+0000","last_peered":"2024-04-25T12:25:06.948122+0000","last_clean":"2024-04-25T12:25:06.948122+0000","last_became_active":"2024-04-25T12:21:54.191864+0000","last_became_peered":"2024-04-25T12:21:54.191864+0000","last_unstale":"2024-04-25T12:25:06.948122+0000","last_undegraded":"2024-04-25T12:25:06.948122+0000","last_fullsized":"2024-04-25T12:25:06.948122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:06.947951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:06.947951+0000","last_clean_scrub_stamp":"2024-04-25T12:25:06.947951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:45.663700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:07.024793+0000","last_change":"2024-04-25T12:25:07.024883+0000","last_active":"2024-04-25T12:25:07.024793+0000","last_peered":"2024-04-25T12:25:07.024793+0000","last_clean":"2024-04-25T12:25:07.024793+0000","last_became_active":"2024-04-25T12:21:53.197059+0000","last_became_peered":"2024-04-25T12:21:53.197059+0000","last_unstale":"2024-04-25T12:25:07.024793+0000","last_undegraded":"2024-04-25T12:25:07.024793+0000","last_fullsized":"2024-04-25T12:25:07.024793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-04-25T12:25:07.024434+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-04-25T12:25:07.024434+0000","last_clean_scrub_stamp":"2024-04-25T12:25:07.024434+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:37.065746+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:15.930497+0000","last_change":"2024-04-25T12:25:15.930610+0000","last_active":"2024-04-25T12:25:15.930497+0000","last_peered":"2024-04-25T12:25:15.930497+0000","last_clean":"2024-04-25T12:25:15.930497+0000","last_became_active":"2024-04-25T12:21:58.353996+0000","last_became_peered":"2024-04-25T12:21:58.353996+0000","last_unstale":"2024-04-25T12:25:15.930497+0000","last_undegraded":"2024-04-25T12:25:15.930497+0000","last_fullsized":"2024-04-25T12:25:15.930497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:15.930205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:15.930205+0000","last_clean_scrub_stamp":"2024-04-25T12:25:15.930205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:24:34.091410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:14.824188+0000","last_change":"2024-04-25T12:25:14.824293+0000","last_active":"2024-04-25T12:25:14.824188+0000","last_peered":"2024-04-25T12:25:14.824188+0000","last_clean":"2024-04-25T12:25:14.824188+0000","last_became_active":"2024-04-25T12:21:54.218854+0000","last_became_peered":"2024-04-25T12:21:54.218854+0000","last_unstale":"2024-04-25T12:25:14.824188+0000","last_undegraded":"2024-04-25T12:25:14.824188+0000","last_fullsized":"2024-04-25T12:25:14.824188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:14.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:14.823988+0000","last_clean_scrub_stamp":"2024-04-25T12:25:14.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:58.219222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'9","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:05.540619+0000","last_change":"2024-04-25T12:25:05.540692+0000","last_active":"2024-04-25T12:25:05.540619+0000","last_peered":"2024-04-25T12:25:05.540619+0000","last_clean":"2024-04-25T12:25:05.540619+0000","last_became_active":"2024-04-25T12:21:53.189781+0000","last_became_peered":"2024-04-25T12:21:53.189781+0000","last_unstale":"2024-04-25T12:25:05.540619+0000","last_undegraded":"2024-04-25T12:25:05.540619+0000","last_fullsized":"2024-04-25T12:25:05.540619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-04-25T12:25:05.540421+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-04-25T12:25:05.540421+0000","last_clean_scrub_stamp":"2024-04-25T12:25:05.540421+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:54.309039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:17.773854+0000","last_change":"2024-04-25T12:25:17.773911+0000","last_active":"2024-04-25T12:25:17.773854+0000","last_peered":"2024-04-25T12:25:17.773854+0000","last_clean":"2024-04-25T12:25:17.773854+0000","last_became_active":"2024-04-25T12:21:58.341492+0000","last_became_peered":"2024-04-25T12:21:58.341492+0000","last_unstale":"2024-04-25T12:25:17.773854+0000","last_undegraded":"2024-04-25T12:25:17.773854+0000","last_fullsized":"2024-04-25T12:25:17.773854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:17.773649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:17.773649+0000","last_clean_scrub_stamp":"2024-04-25T12:25:17.773649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:09.398620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:07.581627+0000","last_change":"2024-04-25T12:25:07.581687+0000","last_active":"2024-04-25T12:25:07.581627+0000","last_peered":"2024-04-25T12:25:07.581627+0000","last_clean":"2024-04-25T12:25:07.581627+0000","last_became_active":"2024-04-25T12:21:54.181720+0000","last_became_peered":"2024-04-25T12:21:54.181720+0000","last_unstale":"2024-04-25T12:25:07.581627+0000","last_undegraded":"2024-04-25T12:25:07.581627+0000","last_fullsized":"2024-04-25T12:25:07.581627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:07.581446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:07.581446+0000","last_clean_scrub_stamp":"2024-04-25T12:25:07.581446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:33.004966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'5","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:06.677402+0000","last_change":"2024-04-25T12:25:06.677467+0000","last_active":"2024-04-25T12:25:06.677402+0000","last_peered":"2024-04-25T12:25:06.677402+0000","last_clean":"2024-04-25T12:25:06.677402+0000","last_became_active":"2024-04-25T12:21:53.196102+0000","last_became_peered":"2024-04-25T12:21:53.196102+0000","last_unstale":"2024-04-25T12:25:06.677402+0000","last_undegraded":"2024-04-25T12:25:06.677402+0000","last_fullsized":"2024-04-25T12:25:06.677402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-04-25T12:25:06.677228+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-04-25T12:25:06.677228+0000","last_clean_scrub_stamp":"2024-04-25T12:25:06.677228+0000","objects_scrubbed":3,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:27.886573+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:15.032460+0000","last_change":"2024-04-25T12:25:15.032523+0000","last_active":"2024-04-25T12:25:15.032460+0000","last_peered":"2024-04-25T12:25:15.032460+0000","last_clean":"2024-04-25T12:25:15.032460+0000","last_became_active":"2024-04-25T12:21:58.341558+0000","last_became_peered":"2024-04-25T12:21:58.341558+0000","last_unstale":"2024-04-25T12:25:15.032460+0000","last_undegraded":"2024-04-25T12:25:15.032460+0000","last_fullsized":"2024-04-25T12:25:15.032460+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:15.032265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:15.032265+0000","last_clean_scrub_stamp":"2024-04-25T12:25:15.032265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:53.345181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:11.011627+0000","last_change":"2024-04-25T12:25:11.011728+0000","last_active":"2024-04-25T12:25:11.011627+0000","last_peered":"2024-04-25T12:25:11.011627+0000","last_clean":"2024-04-25T12:25:11.011627+0000","last_became_active":"2024-04-25T12:21:54.205519+0000","last_became_peered":"2024-04-25T12:21:54.205519+0000","last_unstale":"2024-04-25T12:25:11.011627+0000","last_undegraded":"2024-04-25T12:25:11.011627+0000","last_fullsized":"2024-04-25T12:25:11.011627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:11.011366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:11.011366+0000","last_clean_scrub_stamp":"2024-04-25T12:25:11.011366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:05.683334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'1","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:01.464333+0000","last_change":"2024-04-25T12:25:01.464377+0000","last_active":"2024-04-25T12:25:01.464333+0000","last_peered":"2024-04-25T12:25:01.464333+0000","last_clean":"2024-04-25T12:25:01.464333+0000","last_became_active":"2024-04-25T12:21:53.162599+0000","last_became_peered":"2024-04-25T12:21:53.162599+0000","last_unstale":"2024-04-25T12:25:01.464333+0000","last_undegraded":"2024-04-25T12:25:01.464333+0000","last_fullsized":"2024-04-25T12:25:01.464333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-04-25T12:25:01.464249+0000","last_deep_scrub":"28'1","last_deep_scrub_stamp":"2024-04-25T12:25:01.464249+0000","last_clean_scrub_stamp":"2024-04-25T12:25:01.464249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:16.751290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:11.194664+0000","last_change":"2024-04-25T12:25:11.194725+0000","last_active":"2024-04-25T12:25:11.194664+0000","last_peered":"2024-04-25T12:25:11.194664+0000","last_clean":"2024-04-25T12:25:11.194664+0000","last_became_active":"2024-04-25T12:22:34.917798+0000","last_became_peered":"2024-04-25T12:22:34.917798+0000","last_unstale":"2024-04-25T12:25:11.194664+0000","last_undegraded":"2024-04-25T12:25:11.194664+0000","last_fullsized":"2024-04-25T12:25:11.194664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:11.194488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:11.194488+0000","last_clean_scrub_stamp":"2024-04-25T12:25:11.194488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:29.858826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:05.917023+0000","last_change":"2024-04-25T12:25:05.917079+0000","last_active":"2024-04-25T12:25:05.917023+0000","last_peered":"2024-04-25T12:25:05.917023+0000","last_clean":"2024-04-25T12:25:05.917023+0000","last_became_active":"2024-04-25T12:21:54.202112+0000","last_became_peered":"2024-04-25T12:21:54.202112+0000","last_unstale":"2024-04-25T12:25:05.917023+0000","last_undegraded":"2024-04-25T12:25:05.917023+0000","last_fullsized":"2024-04-25T12:25:05.917023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:05.916847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:05.916847+0000","last_clean_scrub_stamp":"2024-04-25T12:25:05.916847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:44.885062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:04.987671+0000","last_change":"2024-04-25T12:25:04.987818+0000","last_active":"2024-04-25T12:25:04.987671+0000","last_peered":"2024-04-25T12:25:04.987671+0000","last_clean":"2024-04-25T12:25:04.987671+0000","last_became_active":"2024-04-25T12:21:53.187855+0000","last_became_peered":"2024-04-25T12:21:53.187855+0000","last_unstale":"2024-04-25T12:25:04.987671+0000","last_undegraded":"2024-04-25T12:25:04.987671+0000","last_fullsized":"2024-04-25T12:25:04.987671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-04-25T12:25:04.987462+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-04-25T12:25:04.987462+0000","last_clean_scrub_stamp":"2024-04-25T12:25:04.987462+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:58.840367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:14.659224+0000","last_change":"2024-04-25T12:25:14.659285+0000","last_active":"2024-04-25T12:25:14.659224+0000","last_peered":"2024-04-25T12:25:14.659224+0000","last_clean":"2024-04-25T12:25:14.659224+0000","last_became_active":"2024-04-25T12:21:58.263425+0000","last_became_peered":"2024-04-25T12:21:58.263425+0000","last_unstale":"2024-04-25T12:25:14.659224+0000","last_undegraded":"2024-04-25T12:25:14.659224+0000","last_fullsized":"2024-04-25T12:25:14.659224+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:14.659028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:14.659028+0000","last_clean_scrub_stamp":"2024-04-25T12:25:14.659028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:10.747112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:09.666068+0000","last_change":"2024-04-25T12:25:09.666179+0000","last_active":"2024-04-25T12:25:09.666068+0000","last_peered":"2024-04-25T12:25:09.666068+0000","last_clean":"2024-04-25T12:25:09.666068+0000","last_became_active":"2024-04-25T12:21:54.188587+0000","last_became_peered":"2024-04-25T12:21:54.188587+0000","last_unstale":"2024-04-25T12:25:09.666068+0000","last_undegraded":"2024-04-25T12:25:09.666068+0000","last_fullsized":"2024-04-25T12:25:09.666068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:09.665862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:09.665862+0000","last_clean_scrub_stamp":"2024-04-25T12:25:09.665862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:49.975735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:03.193974+0000","last_change":"2024-04-25T12:25:03.193998+0000","last_active":"2024-04-25T12:25:03.193974+0000","last_peered":"2024-04-25T12:25:03.193974+0000","last_clean":"2024-04-25T12:25:03.193974+0000","last_became_active":"2024-04-25T12:21:53.159714+0000","last_became_peered":"2024-04-25T12:21:53.159714+0000","last_unstale":"2024-04-25T12:25:03.193974+0000","last_undegraded":"2024-04-25T12:25:03.193974+0000","last_fullsized":"2024-04-25T12:25:03.193974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-04-25T12:25:03.193910+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-04-25T12:25:03.193910+0000","last_clean_scrub_stamp":"2024-04-25T12:25:03.193910+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:49:26.751227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:12.179879+0000","last_change":"2024-04-25T12:25:12.180017+0000","last_active":"2024-04-25T12:25:12.179879+0000","last_peered":"2024-04-25T12:25:12.179879+0000","last_clean":"2024-04-25T12:25:12.179879+0000","last_became_active":"2024-04-25T12:22:34.981347+0000","last_became_peered":"2024-04-25T12:22:34.981347+0000","last_unstale":"2024-04-25T12:25:12.179879+0000","last_undegraded":"2024-04-25T12:25:12.179879+0000","last_fullsized":"2024-04-25T12:25:12.179879+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:12.179664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:12.179664+0000","last_clean_scrub_stamp":"2024-04-25T12:25:12.179664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:42:47.464608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:09.922251+0000","last_change":"2024-04-25T12:25:09.922305+0000","last_active":"2024-04-25T12:25:09.922251+0000","last_peered":"2024-04-25T12:25:09.922251+0000","last_clean":"2024-04-25T12:25:09.922251+0000","last_became_active":"2024-04-25T12:21:54.205023+0000","last_became_peered":"2024-04-25T12:21:54.205023+0000","last_unstale":"2024-04-25T12:25:09.922251+0000","last_undegraded":"2024-04-25T12:25:09.922251+0000","last_fullsized":"2024-04-25T12:25:09.922251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:09.922085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:09.922085+0000","last_clean_scrub_stamp":"2024-04-25T12:25:09.922085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:57.861156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'5","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:07.657967+0000","last_change":"2024-04-25T12:25:07.658040+0000","last_active":"2024-04-25T12:25:07.657967+0000","last_peered":"2024-04-25T12:25:07.657967+0000","last_clean":"2024-04-25T12:25:07.657967+0000","last_became_active":"2024-04-25T12:21:53.197081+0000","last_became_peered":"2024-04-25T12:21:53.197081+0000","last_unstale":"2024-04-25T12:25:07.657967+0000","last_undegraded":"2024-04-25T12:25:07.657967+0000","last_fullsized":"2024-04-25T12:25:07.657967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-04-25T12:25:07.657791+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-04-25T12:25:07.657791+0000","last_clean_scrub_stamp":"2024-04-25T12:25:07.657791+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:48.775748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:16.048406+0000","last_change":"2024-04-25T12:25:16.048468+0000","last_active":"2024-04-25T12:25:16.048406+0000","last_peered":"2024-04-25T12:25:16.048406+0000","last_clean":"2024-04-25T12:25:16.048406+0000","last_became_active":"2024-04-25T12:21:58.342796+0000","last_became_peered":"2024-04-25T12:21:58.342796+0000","last_unstale":"2024-04-25T12:25:16.048406+0000","last_undegraded":"2024-04-25T12:25:16.048406+0000","last_fullsized":"2024-04-25T12:25:16.048406+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:16.048220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:16.048220+0000","last_clean_scrub_stamp":"2024-04-25T12:25:16.048220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:27.251806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:13.837511+0000","last_change":"2024-04-25T12:25:13.837567+0000","last_active":"2024-04-25T12:25:13.837511+0000","last_peered":"2024-04-25T12:25:13.837511+0000","last_clean":"2024-04-25T12:25:13.837511+0000","last_became_active":"2024-04-25T12:21:54.204212+0000","last_became_peered":"2024-04-25T12:21:54.204212+0000","last_unstale":"2024-04-25T12:25:13.837511+0000","last_undegraded":"2024-04-25T12:25:13.837511+0000","last_fullsized":"2024-04-25T12:25:13.837511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:13.837335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:13.837335+0000","last_clean_scrub_stamp":"2024-04-25T12:25:13.837335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:34.028921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:04.010725+0000","last_change":"2024-04-25T12:25:04.010801+0000","last_active":"2024-04-25T12:25:04.010725+0000","last_peered":"2024-04-25T12:25:04.010725+0000","last_clean":"2024-04-25T12:25:04.010725+0000","last_became_active":"2024-04-25T12:21:53.168939+0000","last_became_peered":"2024-04-25T12:21:53.168939+0000","last_unstale":"2024-04-25T12:25:04.010725+0000","last_undegraded":"2024-04-25T12:25:04.010725+0000","last_fullsized":"2024-04-25T12:25:04.010725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-04-25T12:25:04.010553+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-04-25T12:25:04.010553+0000","last_clean_scrub_stamp":"2024-04-25T12:25:04.010553+0000","objects_scrubbed":5,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:35.239770+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":194,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:04.714107+0000","last_change":"2024-04-25T12:25:04.714107+0000","last_active":"2024-04-25T12:25:04.714107+0000","last_peered":"2024-04-25T12:25:04.714107+0000","last_clean":"2024-04-25T12:25:04.714107+0000","last_became_active":"2024-04-25T12:21:42.608579+0000","last_became_peered":"2024-04-25T12:21:42.608579+0000","last_unstale":"2024-04-25T12:25:04.714107+0000","last_undegraded":"2024-04-25T12:25:04.714107+0000","last_fullsized":"2024-04-25T12:25:04.714107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2024-04-25T12:25:04.713863+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2024-04-25T12:25:04.713863+0000","last_clean_scrub_stamp":"2024-04-25T12:25:04.713863+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:44.322180+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:18.053512+0000","last_change":"2024-04-25T12:25:18.053644+0000","last_active":"2024-04-25T12:25:18.053512+0000","last_peered":"2024-04-25T12:25:18.053512+0000","last_clean":"2024-04-25T12:25:18.053512+0000","last_became_active":"2024-04-25T12:21:58.350087+0000","last_became_peered":"2024-04-25T12:21:58.350087+0000","last_unstale":"2024-04-25T12:25:18.053512+0000","last_undegraded":"2024-04-25T12:25:18.053512+0000","last_fullsized":"2024-04-25T12:25:18.053512+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:18.053294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:18.053294+0000","last_clean_scrub_stamp":"2024-04-25T12:25:18.053294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:30.900742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:14.724350+0000","last_change":"2024-04-25T12:25:14.724400+0000","last_active":"2024-04-25T12:25:14.724350+0000","last_peered":"2024-04-25T12:25:14.724350+0000","last_clean":"2024-04-25T12:25:14.724350+0000","last_became_active":"2024-04-25T12:21:54.211077+0000","last_became_peered":"2024-04-25T12:21:54.211077+0000","last_unstale":"2024-04-25T12:25:14.724350+0000","last_undegraded":"2024-04-25T12:25:14.724350+0000","last_fullsized":"2024-04-25T12:25:14.724350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:14.724184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:14.724184+0000","last_clean_scrub_stamp":"2024-04-25T12:25:14.724184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:11.373285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:05.169238+0000","last_change":"2024-04-25T12:25:05.169391+0000","last_active":"2024-04-25T12:25:05.169238+0000","last_peered":"2024-04-25T12:25:05.169238+0000","last_clean":"2024-04-25T12:25:05.169238+0000","last_became_active":"2024-04-25T12:21:53.174980+0000","last_became_peered":"2024-04-25T12:21:53.174980+0000","last_unstale":"2024-04-25T12:25:05.169238+0000","last_undegraded":"2024-04-25T12:25:05.169238+0000","last_fullsized":"2024-04-25T12:25:05.169238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-04-25T12:25:05.169014+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-04-25T12:25:05.169014+0000","last_clean_scrub_stamp":"2024-04-25T12:25:05.169014+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:54.039237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:17.052901+0000","last_change":"2024-04-25T12:25:17.052962+0000","last_active":"2024-04-25T12:25:17.052901+0000","last_peered":"2024-04-25T12:25:17.052901+0000","last_clean":"2024-04-25T12:25:17.052901+0000","last_became_active":"2024-04-25T12:21:58.343502+0000","last_became_peered":"2024-04-25T12:21:58.343502+0000","last_unstale":"2024-04-25T12:25:17.052901+0000","last_undegraded":"2024-04-25T12:25:17.052901+0000","last_fullsized":"2024-04-25T12:25:17.052901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:17.052711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:17.052711+0000","last_clean_scrub_stamp":"2024-04-25T12:25:17.052711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:53.934598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:13.016380+0000","last_change":"2024-04-25T12:25:13.016437+0000","last_active":"2024-04-25T12:25:13.016380+0000","last_peered":"2024-04-25T12:25:13.016380+0000","last_clean":"2024-04-25T12:25:13.016380+0000","last_became_active":"2024-04-25T12:21:54.206749+0000","last_became_peered":"2024-04-25T12:21:54.206749+0000","last_unstale":"2024-04-25T12:25:13.016380+0000","last_undegraded":"2024-04-25T12:25:13.016380+0000","last_fullsized":"2024-04-25T12:25:13.016380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:13.016213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:13.016213+0000","last_clean_scrub_stamp":"2024-04-25T12:25:13.016213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:04.738588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'4","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:03.551232+0000","last_change":"2024-04-25T12:25:03.551275+0000","last_active":"2024-04-25T12:25:03.551232+0000","last_peered":"2024-04-25T12:25:03.551232+0000","last_clean":"2024-04-25T12:25:03.551232+0000","last_became_active":"2024-04-25T12:21:53.179142+0000","last_became_peered":"2024-04-25T12:21:53.179142+0000","last_unstale":"2024-04-25T12:25:03.551232+0000","last_undegraded":"2024-04-25T12:25:03.551232+0000","last_fullsized":"2024-04-25T12:25:03.551232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-04-25T12:25:03.551140+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-04-25T12:25:03.551140+0000","last_clean_scrub_stamp":"2024-04-25T12:25:03.551140+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:21.047002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:13.987006+0000","last_change":"2024-04-25T12:25:13.987069+0000","last_active":"2024-04-25T12:25:13.987006+0000","last_peered":"2024-04-25T12:25:13.987006+0000","last_clean":"2024-04-25T12:25:13.987006+0000","last_became_active":"2024-04-25T12:21:58.253624+0000","last_became_peered":"2024-04-25T12:21:58.253624+0000","last_unstale":"2024-04-25T12:25:13.987006+0000","last_undegraded":"2024-04-25T12:25:13.987006+0000","last_fullsized":"2024-04-25T12:25:13.987006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:13.986829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:13.986829+0000","last_clean_scrub_stamp":"2024-04-25T12:25:13.986829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:23.271518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:19.639162+0000","last_change":"2024-04-25T12:25:19.639223+0000","last_active":"2024-04-25T12:25:19.639162+0000","last_peered":"2024-04-25T12:25:19.639162+0000","last_clean":"2024-04-25T12:25:19.639162+0000","last_became_active":"2024-04-25T12:21:54.219513+0000","last_became_peered":"2024-04-25T12:21:54.219513+0000","last_unstale":"2024-04-25T12:25:19.639162+0000","last_undegraded":"2024-04-25T12:25:19.639162+0000","last_fullsized":"2024-04-25T12:25:19.639162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:19.638987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:19.638987+0000","last_clean_scrub_stamp":"2024-04-25T12:25:19.638987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:37.501057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:02.217553+0000","last_change":"2024-04-25T12:25:02.217630+0000","last_active":"2024-04-25T12:25:02.217553+0000","last_peered":"2024-04-25T12:25:02.217553+0000","last_clean":"2024-04-25T12:25:02.217553+0000","last_became_active":"2024-04-25T12:21:53.159018+0000","last_became_peered":"2024-04-25T12:21:53.159018+0000","last_unstale":"2024-04-25T12:25:02.217553+0000","last_undegraded":"2024-04-25T12:25:02.217553+0000","last_fullsized":"2024-04-25T12:25:02.217553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-25T12:25:02.217391+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-25T12:25:02.217391+0000","last_clean_scrub_stamp":"2024-04-25T12:25:02.217391+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:10.960506+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:19.068945+0000","last_change":"2024-04-25T12:25:19.069010+0000","last_active":"2024-04-25T12:25:19.068945+0000","last_peered":"2024-04-25T12:25:19.068945+0000","last_clean":"2024-04-25T12:25:19.068945+0000","last_became_active":"2024-04-25T12:21:58.343839+0000","last_became_peered":"2024-04-25T12:21:58.343839+0000","last_unstale":"2024-04-25T12:25:19.068945+0000","last_undegraded":"2024-04-25T12:25:19.068945+0000","last_fullsized":"2024-04-25T12:25:19.068945+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:19.068747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:19.068747+0000","last_clean_scrub_stamp":"2024-04-25T12:25:19.068747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:48.381186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:13.723581+0000","last_change":"2024-04-25T12:25:13.723641+0000","last_active":"2024-04-25T12:25:13.723581+0000","last_peered":"2024-04-25T12:25:13.723581+0000","last_clean":"2024-04-25T12:25:13.723581+0000","last_became_active":"2024-04-25T12:21:54.211719+0000","last_became_peered":"2024-04-25T12:21:54.211719+0000","last_unstale":"2024-04-25T12:25:13.723581+0000","last_undegraded":"2024-04-25T12:25:13.723581+0000","last_fullsized":"2024-04-25T12:25:13.723581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:13.723413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:13.723413+0000","last_clean_scrub_stamp":"2024-04-25T12:25:13.723413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:29.565972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'3","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:03.013092+0000","last_change":"2024-04-25T12:25:03.013238+0000","last_active":"2024-04-25T12:25:03.013092+0000","last_peered":"2024-04-25T12:25:03.013092+0000","last_clean":"2024-04-25T12:25:03.013092+0000","last_became_active":"2024-04-25T12:21:53.169743+0000","last_became_peered":"2024-04-25T12:21:53.169743+0000","last_unstale":"2024-04-25T12:25:03.013092+0000","last_undegraded":"2024-04-25T12:25:03.013092+0000","last_fullsized":"2024-04-25T12:25:03.013092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-04-25T12:25:03.012867+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-04-25T12:25:03.012867+0000","last_clean_scrub_stamp":"2024-04-25T12:25:03.012867+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:29.380084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:12.950779+0000","last_change":"2024-04-25T12:25:12.950839+0000","last_active":"2024-04-25T12:25:12.950779+0000","last_peered":"2024-04-25T12:25:12.950779+0000","last_clean":"2024-04-25T12:25:12.950779+0000","last_became_active":"2024-04-25T12:21:58.253256+0000","last_became_peered":"2024-04-25T12:21:58.253256+0000","last_unstale":"2024-04-25T12:25:12.950779+0000","last_undegraded":"2024-04-25T12:25:12.950779+0000","last_fullsized":"2024-04-25T12:25:12.950779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:12.950610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:12.950610+0000","last_clean_scrub_stamp":"2024-04-25T12:25:12.950610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:55.485650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:10.164394+0000","last_change":"2024-04-25T12:25:10.164449+0000","last_active":"2024-04-25T12:25:10.164394+0000","last_peered":"2024-04-25T12:25:10.164394+0000","last_clean":"2024-04-25T12:25:10.164394+0000","last_became_active":"2024-04-25T12:22:34.895584+0000","last_became_peered":"2024-04-25T12:22:34.895584+0000","last_unstale":"2024-04-25T12:25:10.164394+0000","last_undegraded":"2024-04-25T12:25:10.164394+0000","last_fullsized":"2024-04-25T12:25:10.164394+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:10.164217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:10.164217+0000","last_clean_scrub_stamp":"2024-04-25T12:25:10.164217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:04.325185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"28'25","reported_seq":61,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:04.209216+0000","last_change":"2024-04-25T12:25:04.209322+0000","last_active":"2024-04-25T12:25:04.209216+0000","last_peered":"2024-04-25T12:25:04.209216+0000","last_clean":"2024-04-25T12:25:04.209216+0000","last_became_active":"2024-04-25T12:21:53.163565+0000","last_became_peered":"2024-04-25T12:21:53.163565+0000","last_unstale":"2024-04-25T12:25:04.209216+0000","last_undegraded":"2024-04-25T12:25:04.209216+0000","last_fullsized":"2024-04-25T12:25:04.209216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'25","last_scrub_stamp":"2024-04-25T12:25:04.209036+0000","last_deep_scrub":"28'25","last_deep_scrub_stamp":"2024-04-25T12:25:04.209036+0000","last_clean_scrub_stamp":"2024-04-25T12:25:04.209036+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:24:06.395776+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:13.004463+0000","last_change":"2024-04-25T12:25:13.004527+0000","last_active":"2024-04-25T12:25:13.004463+0000","last_peered":"2024-04-25T12:25:13.004463+0000","last_clean":"2024-04-25T12:25:13.004463+0000","last_became_active":"2024-04-25T12:21:58.250136+0000","last_became_peered":"2024-04-25T12:21:58.250136+0000","last_unstale":"2024-04-25T12:25:13.004463+0000","last_undegraded":"2024-04-25T12:25:13.004463+0000","last_fullsized":"2024-04-25T12:25:13.004463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:13.004273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:13.004273+0000","last_clean_scrub_stamp":"2024-04-25T12:25:13.004273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:13.808296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:10.928117+0000","last_change":"2024-04-25T12:25:10.928211+0000","last_active":"2024-04-25T12:25:10.928117+0000","last_peered":"2024-04-25T12:25:10.928117+0000","last_clean":"2024-04-25T12:25:10.928117+0000","last_became_active":"2024-04-25T12:21:54.200187+0000","last_became_peered":"2024-04-25T12:21:54.200187+0000","last_unstale":"2024-04-25T12:25:10.928117+0000","last_undegraded":"2024-04-25T12:25:10.928117+0000","last_fullsized":"2024-04-25T12:25:10.928117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:10.927835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:10.927835+0000","last_clean_scrub_stamp":"2024-04-25T12:25:10.927835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:23.058254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:06.053113+0000","last_change":"2024-04-25T12:25:06.053185+0000","last_active":"2024-04-25T12:25:06.053113+0000","last_peered":"2024-04-25T12:25:06.053113+0000","last_clean":"2024-04-25T12:25:06.053113+0000","last_became_active":"2024-04-25T12:21:53.184866+0000","last_became_peered":"2024-04-25T12:21:53.184866+0000","last_unstale":"2024-04-25T12:25:06.053113+0000","last_undegraded":"2024-04-25T12:25:06.053113+0000","last_fullsized":"2024-04-25T12:25:06.053113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-04-25T12:25:06.052919+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-04-25T12:25:06.052919+0000","last_clean_scrub_stamp":"2024-04-25T12:25:06.052919+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:35.158394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:19.838504+0000","last_change":"2024-04-25T12:25:19.838626+0000","last_active":"2024-04-25T12:25:19.838504+0000","last_peered":"2024-04-25T12:25:19.838504+0000","last_clean":"2024-04-25T12:25:19.838504+0000","last_became_active":"2024-04-25T12:21:58.343764+0000","last_became_peered":"2024-04-25T12:21:58.343764+0000","last_unstale":"2024-04-25T12:25:19.838504+0000","last_undegraded":"2024-04-25T12:25:19.838504+0000","last_fullsized":"2024-04-25T12:25:19.838504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:19.838215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:19.838215+0000","last_clean_scrub_stamp":"2024-04-25T12:25:19.838215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:17:36.594704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:16.718937+0000","last_change":"2024-04-25T12:25:16.718995+0000","last_active":"2024-04-25T12:25:16.718937+0000","last_peered":"2024-04-25T12:25:16.718937+0000","last_clean":"2024-04-25T12:25:16.718937+0000","last_became_active":"2024-04-25T12:21:54.215575+0000","last_became_peered":"2024-04-25T12:21:54.215575+0000","last_unstale":"2024-04-25T12:25:16.718937+0000","last_undegraded":"2024-04-25T12:25:16.718937+0000","last_fullsized":"2024-04-25T12:25:16.718937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:16.718762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:16.718762+0000","last_clean_scrub_stamp":"2024-04-25T12:25:16.718762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:25.684829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:05.964775+0000","last_change":"2024-04-25T12:25:05.964851+0000","last_active":"2024-04-25T12:25:05.964775+0000","last_peered":"2024-04-25T12:25:05.964775+0000","last_clean":"2024-04-25T12:25:05.964775+0000","last_became_active":"2024-04-25T12:21:53.197618+0000","last_became_peered":"2024-04-25T12:21:53.197618+0000","last_unstale":"2024-04-25T12:25:05.964775+0000","last_undegraded":"2024-04-25T12:25:05.964775+0000","last_fullsized":"2024-04-25T12:25:05.964775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-25T12:25:05.964591+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-25T12:25:05.964591+0000","last_clean_scrub_stamp":"2024-04-25T12:25:05.964591+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:02.928008+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:18.798207+0000","last_change":"2024-04-25T12:25:18.798272+0000","last_active":"2024-04-25T12:25:18.798207+0000","last_peered":"2024-04-25T12:25:18.798207+0000","last_clean":"2024-04-25T12:25:18.798207+0000","last_became_active":"2024-04-25T12:21:58.341575+0000","last_became_peered":"2024-04-25T12:21:58.341575+0000","last_unstale":"2024-04-25T12:25:18.798207+0000","last_undegraded":"2024-04-25T12:25:18.798207+0000","last_fullsized":"2024-04-25T12:25:18.798207+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:18.798027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:18.798027+0000","last_clean_scrub_stamp":"2024-04-25T12:25:18.798027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:17.306829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:08.943891+0000","last_change":"2024-04-25T12:25:08.943977+0000","last_active":"2024-04-25T12:25:08.943891+0000","last_peered":"2024-04-25T12:25:08.943891+0000","last_clean":"2024-04-25T12:25:08.943891+0000","last_became_active":"2024-04-25T12:21:54.200209+0000","last_became_peered":"2024-04-25T12:21:54.200209+0000","last_unstale":"2024-04-25T12:25:08.943891+0000","last_undegraded":"2024-04-25T12:25:08.943891+0000","last_fullsized":"2024-04-25T12:25:08.943891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:08.943695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:08.943695+0000","last_clean_scrub_stamp":"2024-04-25T12:25:08.943695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:51:34.835324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'13","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:01.909766+0000","last_change":"2024-04-25T12:25:01.909818+0000","last_active":"2024-04-25T12:25:01.909766+0000","last_peered":"2024-04-25T12:25:01.909766+0000","last_clean":"2024-04-25T12:25:01.909766+0000","last_became_active":"2024-04-25T12:21:53.168461+0000","last_became_peered":"2024-04-25T12:21:53.168461+0000","last_unstale":"2024-04-25T12:25:01.909766+0000","last_undegraded":"2024-04-25T12:25:01.909766+0000","last_fullsized":"2024-04-25T12:25:01.909766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2024-04-25T12:25:01.909695+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2024-04-25T12:25:01.909695+0000","last_clean_scrub_stamp":"2024-04-25T12:25:01.909695+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:10.481928+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:18.074260+0000","last_change":"2024-04-25T12:25:18.074321+0000","last_active":"2024-04-25T12:25:18.074260+0000","last_peered":"2024-04-25T12:25:18.074260+0000","last_clean":"2024-04-25T12:25:18.074260+0000","last_became_active":"2024-04-25T12:21:58.343533+0000","last_became_peered":"2024-04-25T12:21:58.343533+0000","last_unstale":"2024-04-25T12:25:18.074260+0000","last_undegraded":"2024-04-25T12:25:18.074260+0000","last_fullsized":"2024-04-25T12:25:18.074260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:18.074085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:18.074085+0000","last_clean_scrub_stamp":"2024-04-25T12:25:18.074085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:57.603011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:17.689083+0000","last_change":"2024-04-25T12:25:17.689137+0000","last_active":"2024-04-25T12:25:17.689083+0000","last_peered":"2024-04-25T12:25:17.689083+0000","last_clean":"2024-04-25T12:25:17.689083+0000","last_became_active":"2024-04-25T12:21:54.216312+0000","last_became_peered":"2024-04-25T12:21:54.216312+0000","last_unstale":"2024-04-25T12:25:17.689083+0000","last_undegraded":"2024-04-25T12:25:17.689083+0000","last_fullsized":"2024-04-25T12:25:17.689083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:17.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:17.688896+0000","last_clean_scrub_stamp":"2024-04-25T12:25:17.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:44.090376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'20","reported_seq":56,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:04.051356+0000","last_change":"2024-04-25T12:25:04.051429+0000","last_active":"2024-04-25T12:25:04.051356+0000","last_peered":"2024-04-25T12:25:04.051356+0000","last_clean":"2024-04-25T12:25:04.051356+0000","last_became_active":"2024-04-25T12:21:53.177229+0000","last_became_peered":"2024-04-25T12:21:53.177229+0000","last_unstale":"2024-04-25T12:25:04.051356+0000","last_undegraded":"2024-04-25T12:25:04.051356+0000","last_fullsized":"2024-04-25T12:25:04.051356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'20","last_scrub_stamp":"2024-04-25T12:25:04.051172+0000","last_deep_scrub":"28'20","last_deep_scrub_stamp":"2024-04-25T12:25:04.051172+0000","last_clean_scrub_stamp":"2024-04-25T12:25:04.051172+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:43.349328+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:13.660493+0000","last_change":"2024-04-25T12:25:13.660554+0000","last_active":"2024-04-25T12:25:13.660493+0000","last_peered":"2024-04-25T12:25:13.660493+0000","last_clean":"2024-04-25T12:25:13.660493+0000","last_became_active":"2024-04-25T12:21:58.244500+0000","last_became_peered":"2024-04-25T12:21:58.244500+0000","last_unstale":"2024-04-25T12:25:13.660493+0000","last_undegraded":"2024-04-25T12:25:13.660493+0000","last_fullsized":"2024-04-25T12:25:13.660493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:13.660316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:13.660316+0000","last_clean_scrub_stamp":"2024-04-25T12:25:13.660316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:58.198806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:07.968340+0000","last_change":"2024-04-25T12:25:07.968396+0000","last_active":"2024-04-25T12:25:07.968340+0000","last_peered":"2024-04-25T12:25:07.968340+0000","last_clean":"2024-04-25T12:25:07.968340+0000","last_became_active":"2024-04-25T12:21:54.213413+0000","last_became_peered":"2024-04-25T12:21:54.213413+0000","last_unstale":"2024-04-25T12:25:07.968340+0000","last_undegraded":"2024-04-25T12:25:07.968340+0000","last_fullsized":"2024-04-25T12:25:07.968340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:07.968166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:07.968166+0000","last_clean_scrub_stamp":"2024-04-25T12:25:07.968166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:07:52.470825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'8","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:04.581882+0000","last_change":"2024-04-25T12:25:04.582015+0000","last_active":"2024-04-25T12:25:04.581882+0000","last_peered":"2024-04-25T12:25:04.581882+0000","last_clean":"2024-04-25T12:25:04.581882+0000","last_became_active":"2024-04-25T12:21:53.186227+0000","last_became_peered":"2024-04-25T12:21:53.186227+0000","last_unstale":"2024-04-25T12:25:04.581882+0000","last_undegraded":"2024-04-25T12:25:04.581882+0000","last_fullsized":"2024-04-25T12:25:04.581882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-04-25T12:25:04.581677+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-04-25T12:25:04.581677+0000","last_clean_scrub_stamp":"2024-04-25T12:25:04.581677+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:25.055618+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:09.880928+0000","last_change":"2024-04-25T12:25:09.881042+0000","last_active":"2024-04-25T12:25:09.880928+0000","last_peered":"2024-04-25T12:25:09.880928+0000","last_clean":"2024-04-25T12:25:09.880928+0000","last_became_active":"2024-04-25T12:21:58.248841+0000","last_became_peered":"2024-04-25T12:21:58.248841+0000","last_unstale":"2024-04-25T12:25:09.880928+0000","last_undegraded":"2024-04-25T12:25:09.880928+0000","last_fullsized":"2024-04-25T12:25:09.880928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:09.880717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:09.880717+0000","last_clean_scrub_stamp":"2024-04-25T12:25:09.880717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:45.081170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:05.954615+0000","last_change":"2024-04-25T12:25:05.954667+0000","last_active":"2024-04-25T12:25:05.954615+0000","last_peered":"2024-04-25T12:25:05.954615+0000","last_clean":"2024-04-25T12:25:05.954615+0000","last_became_active":"2024-04-25T12:21:54.189097+0000","last_became_peered":"2024-04-25T12:21:54.189097+0000","last_unstale":"2024-04-25T12:25:05.954615+0000","last_undegraded":"2024-04-25T12:25:05.954615+0000","last_fullsized":"2024-04-25T12:25:05.954615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:05.954447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:05.954447+0000","last_clean_scrub_stamp":"2024-04-25T12:25:05.954447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:10.215893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'5","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:07.981671+0000","last_change":"2024-04-25T12:25:07.981743+0000","last_active":"2024-04-25T12:25:07.981671+0000","last_peered":"2024-04-25T12:25:07.981671+0000","last_clean":"2024-04-25T12:25:07.981671+0000","last_became_active":"2024-04-25T12:21:53.205742+0000","last_became_peered":"2024-04-25T12:21:53.205742+0000","last_unstale":"2024-04-25T12:25:07.981671+0000","last_undegraded":"2024-04-25T12:25:07.981671+0000","last_fullsized":"2024-04-25T12:25:07.981671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-04-25T12:25:07.981467+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-04-25T12:25:07.981467+0000","last_clean_scrub_stamp":"2024-04-25T12:25:07.981467+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:58.983629+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:15.808643+0000","last_change":"2024-04-25T12:25:15.808767+0000","last_active":"2024-04-25T12:25:15.808643+0000","last_peered":"2024-04-25T12:25:15.808643+0000","last_clean":"2024-04-25T12:25:15.808643+0000","last_became_active":"2024-04-25T12:21:58.260979+0000","last_became_peered":"2024-04-25T12:21:58.260979+0000","last_unstale":"2024-04-25T12:25:15.808643+0000","last_undegraded":"2024-04-25T12:25:15.808643+0000","last_fullsized":"2024-04-25T12:25:15.808643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:15.808424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:15.808424+0000","last_clean_scrub_stamp":"2024-04-25T12:25:15.808424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:19.054531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:09.131187+0000","last_change":"2024-04-25T12:25:09.131242+0000","last_active":"2024-04-25T12:25:09.131187+0000","last_peered":"2024-04-25T12:25:09.131187+0000","last_clean":"2024-04-25T12:25:09.131187+0000","last_became_active":"2024-04-25T12:22:34.889562+0000","last_became_peered":"2024-04-25T12:22:34.889562+0000","last_unstale":"2024-04-25T12:25:09.131187+0000","last_undegraded":"2024-04-25T12:25:09.131187+0000","last_fullsized":"2024-04-25T12:25:09.131187+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:09.131012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:09.131012+0000","last_clean_scrub_stamp":"2024-04-25T12:25:09.131012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:47.025513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:07.978625+0000","last_change":"2024-04-25T12:25:07.978751+0000","last_active":"2024-04-25T12:25:07.978625+0000","last_peered":"2024-04-25T12:25:07.978625+0000","last_clean":"2024-04-25T12:25:07.978625+0000","last_became_active":"2024-04-25T12:21:53.206274+0000","last_became_peered":"2024-04-25T12:21:53.206274+0000","last_unstale":"2024-04-25T12:25:07.978625+0000","last_undegraded":"2024-04-25T12:25:07.978625+0000","last_fullsized":"2024-04-25T12:25:07.978625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-04-25T12:25:07.978316+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-04-25T12:25:07.978316+0000","last_clean_scrub_stamp":"2024-04-25T12:25:07.978316+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:30.184890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:20.821063+0000","last_change":"2024-04-25T12:25:20.821122+0000","last_active":"2024-04-25T12:25:20.821063+0000","last_peered":"2024-04-25T12:25:20.821063+0000","last_clean":"2024-04-25T12:25:20.821063+0000","last_became_active":"2024-04-25T12:21:58.346195+0000","last_became_peered":"2024-04-25T12:21:58.346195+0000","last_unstale":"2024-04-25T12:25:20.821063+0000","last_undegraded":"2024-04-25T12:25:20.821063+0000","last_fullsized":"2024-04-25T12:25:20.821063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:20.820861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:20.820861+0000","last_clean_scrub_stamp":"2024-04-25T12:25:20.820861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:33.573688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:17.050751+0000","last_change":"2024-04-25T12:25:17.050861+0000","last_active":"2024-04-25T12:25:17.050751+0000","last_peered":"2024-04-25T12:25:17.050751+0000","last_clean":"2024-04-25T12:25:17.050751+0000","last_became_active":"2024-04-25T12:21:58.346887+0000","last_became_peered":"2024-04-25T12:21:58.346887+0000","last_unstale":"2024-04-25T12:25:17.050751+0000","last_undegraded":"2024-04-25T12:25:17.050751+0000","last_fullsized":"2024-04-25T12:25:17.050751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:17.050525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:17.050525+0000","last_clean_scrub_stamp":"2024-04-25T12:25:17.050525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:00.234977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:12.705896+0000","last_change":"2024-04-25T12:25:12.705948+0000","last_active":"2024-04-25T12:25:12.705896+0000","last_peered":"2024-04-25T12:25:12.705896+0000","last_clean":"2024-04-25T12:25:12.705896+0000","last_became_active":"2024-04-25T12:21:54.202399+0000","last_became_peered":"2024-04-25T12:21:54.202399+0000","last_unstale":"2024-04-25T12:25:12.705896+0000","last_undegraded":"2024-04-25T12:25:12.705896+0000","last_fullsized":"2024-04-25T12:25:12.705896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:12.705725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:12.705725+0000","last_clean_scrub_stamp":"2024-04-25T12:25:12.705725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:30.050855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'3","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:07.011509+0000","last_change":"2024-04-25T12:25:07.011575+0000","last_active":"2024-04-25T12:25:07.011509+0000","last_peered":"2024-04-25T12:25:07.011509+0000","last_clean":"2024-04-25T12:25:07.011509+0000","last_became_active":"2024-04-25T12:21:53.189592+0000","last_became_peered":"2024-04-25T12:21:53.189592+0000","last_unstale":"2024-04-25T12:25:07.011509+0000","last_undegraded":"2024-04-25T12:25:07.011509+0000","last_fullsized":"2024-04-25T12:25:07.011509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-04-25T12:25:07.011338+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-04-25T12:25:07.011338+0000","last_clean_scrub_stamp":"2024-04-25T12:25:07.011338+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:04.970996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:16.025135+0000","last_change":"2024-04-25T12:25:16.025196+0000","last_active":"2024-04-25T12:25:16.025135+0000","last_peered":"2024-04-25T12:25:16.025135+0000","last_clean":"2024-04-25T12:25:16.025135+0000","last_became_active":"2024-04-25T12:21:58.245085+0000","last_became_peered":"2024-04-25T12:21:58.245085+0000","last_unstale":"2024-04-25T12:25:16.025135+0000","last_undegraded":"2024-04-25T12:25:16.025135+0000","last_fullsized":"2024-04-25T12:25:16.025135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:16.024958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:16.024958+0000","last_clean_scrub_stamp":"2024-04-25T12:25:16.024958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:48.110420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:01.803711+0000","last_change":"2024-04-25T12:25:01.803733+0000","last_active":"2024-04-25T12:25:01.803711+0000","last_peered":"2024-04-25T12:25:01.803711+0000","last_clean":"2024-04-25T12:25:01.803711+0000","last_became_active":"2024-04-25T12:21:54.206786+0000","last_became_peered":"2024-04-25T12:21:54.206786+0000","last_unstale":"2024-04-25T12:25:01.803711+0000","last_undegraded":"2024-04-25T12:25:01.803711+0000","last_fullsized":"2024-04-25T12:25:01.803711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:01.803628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:01.803628+0000","last_clean_scrub_stamp":"2024-04-25T12:25:01.803628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:27.734459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'4","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:07.778825+0000","last_change":"2024-04-25T12:25:07.778901+0000","last_active":"2024-04-25T12:25:07.778825+0000","last_peered":"2024-04-25T12:25:07.778825+0000","last_clean":"2024-04-25T12:25:07.778825+0000","last_became_active":"2024-04-25T12:21:53.189936+0000","last_became_peered":"2024-04-25T12:21:53.189936+0000","last_unstale":"2024-04-25T12:25:07.778825+0000","last_undegraded":"2024-04-25T12:25:07.778825+0000","last_fullsized":"2024-04-25T12:25:07.778825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-04-25T12:25:07.778636+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-04-25T12:25:07.778636+0000","last_clean_scrub_stamp":"2024-04-25T12:25:07.778636+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:12.297231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:05.082012+0000","last_change":"2024-04-25T12:25:05.082091+0000","last_active":"2024-04-25T12:25:05.082012+0000","last_peered":"2024-04-25T12:25:05.082012+0000","last_clean":"2024-04-25T12:25:05.082012+0000","last_became_active":"2024-04-25T12:21:53.185357+0000","last_became_peered":"2024-04-25T12:21:53.185357+0000","last_unstale":"2024-04-25T12:25:05.082012+0000","last_undegraded":"2024-04-25T12:25:05.082012+0000","last_fullsized":"2024-04-25T12:25:05.082012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-04-25T12:25:05.081840+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-04-25T12:25:05.081840+0000","last_clean_scrub_stamp":"2024-04-25T12:25:05.081840+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:51.108619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:10.959475+0000","last_change":"2024-04-25T12:25:10.959533+0000","last_active":"2024-04-25T12:25:10.959475+0000","last_peered":"2024-04-25T12:25:10.959475+0000","last_clean":"2024-04-25T12:25:10.959475+0000","last_became_active":"2024-04-25T12:21:54.205219+0000","last_became_peered":"2024-04-25T12:21:54.205219+0000","last_unstale":"2024-04-25T12:25:10.959475+0000","last_undegraded":"2024-04-25T12:25:10.959475+0000","last_fullsized":"2024-04-25T12:25:10.959475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:10.959302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:10.959302+0000","last_clean_scrub_stamp":"2024-04-25T12:25:10.959302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:36.642805+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:08.086999+0000","last_change":"2024-04-25T12:25:08.087065+0000","last_active":"2024-04-25T12:25:08.086999+0000","last_peered":"2024-04-25T12:25:08.086999+0000","last_clean":"2024-04-25T12:25:08.086999+0000","last_became_active":"2024-04-25T12:21:58.256219+0000","last_became_peered":"2024-04-25T12:21:58.256219+0000","last_unstale":"2024-04-25T12:25:08.086999+0000","last_undegraded":"2024-04-25T12:25:08.086999+0000","last_fullsized":"2024-04-25T12:25:08.086999+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:08.086779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:08.086779+0000","last_clean_scrub_stamp":"2024-04-25T12:25:08.086779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:59.283329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'8","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:08.782710+0000","last_change":"2024-04-25T12:25:08.782775+0000","last_active":"2024-04-25T12:25:08.782710+0000","last_peered":"2024-04-25T12:25:08.782710+0000","last_clean":"2024-04-25T12:25:08.782710+0000","last_became_active":"2024-04-25T12:21:53.194306+0000","last_became_peered":"2024-04-25T12:21:53.194306+0000","last_unstale":"2024-04-25T12:25:08.782710+0000","last_undegraded":"2024-04-25T12:25:08.782710+0000","last_fullsized":"2024-04-25T12:25:08.782710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-04-25T12:25:08.782544+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-04-25T12:25:08.782544+0000","last_clean_scrub_stamp":"2024-04-25T12:25:08.782544+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:50:53.665948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:04.937933+0000","last_change":"2024-04-25T12:25:04.937989+0000","last_active":"2024-04-25T12:25:04.937933+0000","last_peered":"2024-04-25T12:25:04.937933+0000","last_clean":"2024-04-25T12:25:04.937933+0000","last_became_active":"2024-04-25T12:21:54.196085+0000","last_became_peered":"2024-04-25T12:21:54.196085+0000","last_unstale":"2024-04-25T12:25:04.937933+0000","last_undegraded":"2024-04-25T12:25:04.937933+0000","last_fullsized":"2024-04-25T12:25:04.937933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:04.937717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:04.937717+0000","last_clean_scrub_stamp":"2024-04-25T12:25:04.937717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:19.839416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:16.807098+0000","last_change":"2024-04-25T12:25:16.807231+0000","last_active":"2024-04-25T12:25:16.807098+0000","last_peered":"2024-04-25T12:25:16.807098+0000","last_clean":"2024-04-25T12:25:16.807098+0000","last_became_active":"2024-04-25T12:21:58.260821+0000","last_became_peered":"2024-04-25T12:21:58.260821+0000","last_unstale":"2024-04-25T12:25:16.807098+0000","last_undegraded":"2024-04-25T12:25:16.807098+0000","last_fullsized":"2024-04-25T12:25:16.807098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:16.806845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:16.806845+0000","last_clean_scrub_stamp":"2024-04-25T12:25:16.806845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:13.265152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:11.958545+0000","last_change":"2024-04-25T12:25:11.958601+0000","last_active":"2024-04-25T12:25:11.958545+0000","last_peered":"2024-04-25T12:25:11.958545+0000","last_clean":"2024-04-25T12:25:11.958545+0000","last_became_active":"2024-04-25T12:21:54.200446+0000","last_became_peered":"2024-04-25T12:21:54.200446+0000","last_unstale":"2024-04-25T12:25:11.958545+0000","last_undegraded":"2024-04-25T12:25:11.958545+0000","last_fullsized":"2024-04-25T12:25:11.958545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:11.958333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:11.958333+0000","last_clean_scrub_stamp":"2024-04-25T12:25:11.958333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:31.087585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:06.133378+0000","last_change":"2024-04-25T12:25:06.133435+0000","last_active":"2024-04-25T12:25:06.133378+0000","last_peered":"2024-04-25T12:25:06.133378+0000","last_clean":"2024-04-25T12:25:06.133378+0000","last_became_active":"2024-04-25T12:21:54.187254+0000","last_became_peered":"2024-04-25T12:21:54.187254+0000","last_unstale":"2024-04-25T12:25:06.133378+0000","last_undegraded":"2024-04-25T12:25:06.133378+0000","last_fullsized":"2024-04-25T12:25:06.133378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:06.133189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:06.133189+0000","last_clean_scrub_stamp":"2024-04-25T12:25:06.133189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:11.262025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:11.980421+0000","last_change":"2024-04-25T12:25:11.980472+0000","last_active":"2024-04-25T12:25:11.980421+0000","last_peered":"2024-04-25T12:25:11.980421+0000","last_clean":"2024-04-25T12:25:11.980421+0000","last_became_active":"2024-04-25T12:21:54.204904+0000","last_became_peered":"2024-04-25T12:21:54.204904+0000","last_unstale":"2024-04-25T12:25:11.980421+0000","last_undegraded":"2024-04-25T12:25:11.980421+0000","last_fullsized":"2024-04-25T12:25:11.980421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:11.980247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:11.980247+0000","last_clean_scrub_stamp":"2024-04-25T12:25:11.980247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:53.808737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:00.914064+0000","last_change":"2024-04-25T12:25:00.914092+0000","last_active":"2024-04-25T12:25:00.914064+0000","last_peered":"2024-04-25T12:25:00.914064+0000","last_clean":"2024-04-25T12:25:00.914064+0000","last_became_active":"2024-04-25T12:21:54.203922+0000","last_became_peered":"2024-04-25T12:21:54.203922+0000","last_unstale":"2024-04-25T12:25:00.914064+0000","last_undegraded":"2024-04-25T12:25:00.914064+0000","last_fullsized":"2024-04-25T12:25:00.914064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:00.913977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:00.913977+0000","last_clean_scrub_stamp":"2024-04-25T12:25:00.913977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:39.380897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:02.783091+0000","last_change":"2024-04-25T12:25:02.783116+0000","last_active":"2024-04-25T12:25:02.783091+0000","last_peered":"2024-04-25T12:25:02.783091+0000","last_clean":"2024-04-25T12:25:02.783091+0000","last_became_active":"2024-04-25T12:21:54.206993+0000","last_became_peered":"2024-04-25T12:21:54.206993+0000","last_unstale":"2024-04-25T12:25:02.783091+0000","last_undegraded":"2024-04-25T12:25:02.783091+0000","last_fullsized":"2024-04-25T12:25:02.783091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:02.783003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:02.783003+0000","last_clean_scrub_stamp":"2024-04-25T12:25:02.783003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:17.298278+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:10.684676+0000","last_change":"2024-04-25T12:25:10.684733+0000","last_active":"2024-04-25T12:25:10.684676+0000","last_peered":"2024-04-25T12:25:10.684676+0000","last_clean":"2024-04-25T12:25:10.684676+0000","last_became_active":"2024-04-25T12:21:54.201551+0000","last_became_peered":"2024-04-25T12:21:54.201551+0000","last_unstale":"2024-04-25T12:25:10.684676+0000","last_undegraded":"2024-04-25T12:25:10.684676+0000","last_fullsized":"2024-04-25T12:25:10.684676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:10.684497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:10.684497+0000","last_clean_scrub_stamp":"2024-04-25T12:25:10.684497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:05.310024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:15.009059+0000","last_change":"2024-04-25T12:25:15.009113+0000","last_active":"2024-04-25T12:25:15.009059+0000","last_peered":"2024-04-25T12:25:15.009059+0000","last_clean":"2024-04-25T12:25:15.009059+0000","last_became_active":"2024-04-25T12:21:54.220435+0000","last_became_peered":"2024-04-25T12:21:54.220435+0000","last_unstale":"2024-04-25T12:25:15.009059+0000","last_undegraded":"2024-04-25T12:25:15.009059+0000","last_fullsized":"2024-04-25T12:25:15.009059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:15.008873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:15.008873+0000","last_clean_scrub_stamp":"2024-04-25T12:25:15.008873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:25:07.446517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:05.790978+0000","last_change":"2024-04-25T12:25:05.791030+0000","last_active":"2024-04-25T12:25:05.790978+0000","last_peered":"2024-04-25T12:25:05.790978+0000","last_clean":"2024-04-25T12:25:05.790978+0000","last_became_active":"2024-04-25T12:21:54.204587+0000","last_became_peered":"2024-04-25T12:21:54.204587+0000","last_unstale":"2024-04-25T12:25:05.790978+0000","last_undegraded":"2024-04-25T12:25:05.790978+0000","last_fullsized":"2024-04-25T12:25:05.790978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:05.790802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:05.790802+0000","last_clean_scrub_stamp":"2024-04-25T12:25:05.790802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:05:55.801569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:13.149955+0000","last_change":"2024-04-25T12:25:13.150064+0000","last_active":"2024-04-25T12:25:13.149955+0000","last_peered":"2024-04-25T12:25:13.149955+0000","last_clean":"2024-04-25T12:25:13.149955+0000","last_became_active":"2024-04-25T12:22:35.295116+0000","last_became_peered":"2024-04-25T12:22:35.295116+0000","last_unstale":"2024-04-25T12:25:13.149955+0000","last_undegraded":"2024-04-25T12:25:13.149955+0000","last_fullsized":"2024-04-25T12:25:13.149955+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:13.149743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:13.149743+0000","last_clean_scrub_stamp":"2024-04-25T12:25:13.149743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:42.339081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:12.833582+0000","last_change":"2024-04-25T12:25:12.833635+0000","last_active":"2024-04-25T12:25:12.833582+0000","last_peered":"2024-04-25T12:25:12.833582+0000","last_clean":"2024-04-25T12:25:12.833582+0000","last_became_active":"2024-04-25T12:21:54.203464+0000","last_became_peered":"2024-04-25T12:21:54.203464+0000","last_unstale":"2024-04-25T12:25:12.833582+0000","last_undegraded":"2024-04-25T12:25:12.833582+0000","last_fullsized":"2024-04-25T12:25:12.833582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:12.833417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:12.833417+0000","last_clean_scrub_stamp":"2024-04-25T12:25:12.833417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:11.576709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:16.048328+0000","last_change":"2024-04-25T12:25:16.048422+0000","last_active":"2024-04-25T12:25:16.048328+0000","last_peered":"2024-04-25T12:25:16.048328+0000","last_clean":"2024-04-25T12:25:16.048328+0000","last_became_active":"2024-04-25T12:21:54.212559+0000","last_became_peered":"2024-04-25T12:21:54.212559+0000","last_unstale":"2024-04-25T12:25:16.048328+0000","last_undegraded":"2024-04-25T12:25:16.048328+0000","last_fullsized":"2024-04-25T12:25:16.048328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:16.048107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:16.048107+0000","last_clean_scrub_stamp":"2024-04-25T12:25:16.048107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:36.881625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:11.965946+0000","last_change":"2024-04-25T12:25:11.966000+0000","last_active":"2024-04-25T12:25:11.965946+0000","last_peered":"2024-04-25T12:25:11.965946+0000","last_clean":"2024-04-25T12:25:11.965946+0000","last_became_active":"2024-04-25T12:21:54.215446+0000","last_became_peered":"2024-04-25T12:21:54.215446+0000","last_unstale":"2024-04-25T12:25:11.965946+0000","last_undegraded":"2024-04-25T12:25:11.965946+0000","last_fullsized":"2024-04-25T12:25:11.965946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:11.965750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:11.965750+0000","last_clean_scrub_stamp":"2024-04-25T12:25:11.965750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:18:58.210859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:14.009872+0000","last_change":"2024-04-25T12:25:14.009926+0000","last_active":"2024-04-25T12:25:14.009872+0000","last_peered":"2024-04-25T12:25:14.009872+0000","last_clean":"2024-04-25T12:25:14.009872+0000","last_became_active":"2024-04-25T12:21:54.209393+0000","last_became_peered":"2024-04-25T12:21:54.209393+0000","last_unstale":"2024-04-25T12:25:14.009872+0000","last_undegraded":"2024-04-25T12:25:14.009872+0000","last_fullsized":"2024-04-25T12:25:14.009872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:14.009694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:14.009694+0000","last_clean_scrub_stamp":"2024-04-25T12:25:14.009694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:24.270706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:15.684838+0000","last_change":"2024-04-25T12:25:15.684894+0000","last_active":"2024-04-25T12:25:15.684838+0000","last_peered":"2024-04-25T12:25:15.684838+0000","last_clean":"2024-04-25T12:25:15.684838+0000","last_became_active":"2024-04-25T12:21:54.211787+0000","last_became_peered":"2024-04-25T12:21:54.211787+0000","last_unstale":"2024-04-25T12:25:15.684838+0000","last_undegraded":"2024-04-25T12:25:15.684838+0000","last_fullsized":"2024-04-25T12:25:15.684838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:15.684663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:15.684663+0000","last_clean_scrub_stamp":"2024-04-25T12:25:15.684663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:51.244720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:07.131535+0000","last_change":"2024-04-25T12:25:07.131589+0000","last_active":"2024-04-25T12:25:07.131535+0000","last_peered":"2024-04-25T12:25:07.131535+0000","last_clean":"2024-04-25T12:25:07.131535+0000","last_became_active":"2024-04-25T12:21:54.200123+0000","last_became_peered":"2024-04-25T12:21:54.200123+0000","last_unstale":"2024-04-25T12:25:07.131535+0000","last_undegraded":"2024-04-25T12:25:07.131535+0000","last_fullsized":"2024-04-25T12:25:07.131535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:07.131351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:07.131351+0000","last_clean_scrub_stamp":"2024-04-25T12:25:07.131351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:04.207876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:17.058121+0000","last_change":"2024-04-25T12:25:17.058243+0000","last_active":"2024-04-25T12:25:17.058121+0000","last_peered":"2024-04-25T12:25:17.058121+0000","last_clean":"2024-04-25T12:25:17.058121+0000","last_became_active":"2024-04-25T12:21:54.220272+0000","last_became_peered":"2024-04-25T12:21:54.220272+0000","last_unstale":"2024-04-25T12:25:17.058121+0000","last_undegraded":"2024-04-25T12:25:17.058121+0000","last_fullsized":"2024-04-25T12:25:17.058121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:17.057919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:17.057919+0000","last_clean_scrub_stamp":"2024-04-25T12:25:17.057919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:37.870424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:09.004552+0000","last_change":"2024-04-25T12:25:09.004604+0000","last_active":"2024-04-25T12:25:09.004552+0000","last_peered":"2024-04-25T12:25:09.004552+0000","last_clean":"2024-04-25T12:25:09.004552+0000","last_became_active":"2024-04-25T12:21:54.189535+0000","last_became_peered":"2024-04-25T12:21:54.189535+0000","last_unstale":"2024-04-25T12:25:09.004552+0000","last_undegraded":"2024-04-25T12:25:09.004552+0000","last_fullsized":"2024-04-25T12:25:09.004552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:09.004366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:09.004366+0000","last_clean_scrub_stamp":"2024-04-25T12:25:09.004366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:20.833926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:11.702403+0000","last_change":"2024-04-25T12:25:11.702460+0000","last_active":"2024-04-25T12:25:11.702403+0000","last_peered":"2024-04-25T12:25:11.702403+0000","last_clean":"2024-04-25T12:25:11.702403+0000","last_became_active":"2024-04-25T12:21:54.201641+0000","last_became_peered":"2024-04-25T12:21:54.201641+0000","last_unstale":"2024-04-25T12:25:11.702403+0000","last_undegraded":"2024-04-25T12:25:11.702403+0000","last_fullsized":"2024-04-25T12:25:11.702403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:11.702199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:11.702199+0000","last_clean_scrub_stamp":"2024-04-25T12:25:11.702199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:24.563739+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:07.976611+0000","last_change":"2024-04-25T12:25:07.976666+0000","last_active":"2024-04-25T12:25:07.976611+0000","last_peered":"2024-04-25T12:25:07.976611+0000","last_clean":"2024-04-25T12:25:07.976611+0000","last_became_active":"2024-04-25T12:21:54.192052+0000","last_became_peered":"2024-04-25T12:21:54.192052+0000","last_unstale":"2024-04-25T12:25:07.976611+0000","last_undegraded":"2024-04-25T12:25:07.976611+0000","last_fullsized":"2024-04-25T12:25:07.976611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:07.976423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:07.976423+0000","last_clean_scrub_stamp":"2024-04-25T12:25:07.976423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:39.871737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:11.827564+0000","last_change":"2024-04-25T12:25:11.827616+0000","last_active":"2024-04-25T12:25:11.827564+0000","last_peered":"2024-04-25T12:25:11.827564+0000","last_clean":"2024-04-25T12:25:11.827564+0000","last_became_active":"2024-04-25T12:21:54.203472+0000","last_became_peered":"2024-04-25T12:21:54.203472+0000","last_unstale":"2024-04-25T12:25:11.827564+0000","last_undegraded":"2024-04-25T12:25:11.827564+0000","last_fullsized":"2024-04-25T12:25:11.827564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:11.827391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:11.827391+0000","last_clean_scrub_stamp":"2024-04-25T12:25:11.827391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:15.349388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:06.929267+0000","last_change":"2024-04-25T12:25:06.929321+0000","last_active":"2024-04-25T12:25:06.929267+0000","last_peered":"2024-04-25T12:25:06.929267+0000","last_clean":"2024-04-25T12:25:06.929267+0000","last_became_active":"2024-04-25T12:21:54.203030+0000","last_became_peered":"2024-04-25T12:21:54.203030+0000","last_unstale":"2024-04-25T12:25:06.929267+0000","last_undegraded":"2024-04-25T12:25:06.929267+0000","last_fullsized":"2024-04-25T12:25:06.929267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:06.929096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:06.929096+0000","last_clean_scrub_stamp":"2024-04-25T12:25:06.929096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:05.894136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:09.930283+0000","last_change":"2024-04-25T12:25:09.930339+0000","last_active":"2024-04-25T12:25:09.930283+0000","last_peered":"2024-04-25T12:25:09.930283+0000","last_clean":"2024-04-25T12:25:09.930283+0000","last_became_active":"2024-04-25T12:21:54.199362+0000","last_became_peered":"2024-04-25T12:21:54.199362+0000","last_unstale":"2024-04-25T12:25:09.930283+0000","last_undegraded":"2024-04-25T12:25:09.930283+0000","last_fullsized":"2024-04-25T12:25:09.930283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:09.930072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:09.930072+0000","last_clean_scrub_stamp":"2024-04-25T12:25:09.930072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:47.459211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:08.939087+0000","last_change":"2024-04-25T12:25:08.939140+0000","last_active":"2024-04-25T12:25:08.939087+0000","last_peered":"2024-04-25T12:25:08.939087+0000","last_clean":"2024-04-25T12:25:08.939087+0000","last_became_active":"2024-04-25T12:21:54.198432+0000","last_became_peered":"2024-04-25T12:21:54.198432+0000","last_unstale":"2024-04-25T12:25:08.939087+0000","last_undegraded":"2024-04-25T12:25:08.939087+0000","last_fullsized":"2024-04-25T12:25:08.939087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:08.938920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:08.938920+0000","last_clean_scrub_stamp":"2024-04-25T12:25:08.938920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:25.715922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:18.647837+0000","last_change":"2024-04-25T12:25:18.647950+0000","last_active":"2024-04-25T12:25:18.647837+0000","last_peered":"2024-04-25T12:25:18.647837+0000","last_clean":"2024-04-25T12:25:18.647837+0000","last_became_active":"2024-04-25T12:21:54.216949+0000","last_became_peered":"2024-04-25T12:21:54.216949+0000","last_unstale":"2024-04-25T12:25:18.647837+0000","last_undegraded":"2024-04-25T12:25:18.647837+0000","last_fullsized":"2024-04-25T12:25:18.647837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:18.647612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:18.647612+0000","last_clean_scrub_stamp":"2024-04-25T12:25:18.647612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:50:04.651042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:10.839451+0000","last_change":"2024-04-25T12:25:10.839509+0000","last_active":"2024-04-25T12:25:10.839451+0000","last_peered":"2024-04-25T12:25:10.839451+0000","last_clean":"2024-04-25T12:25:10.839451+0000","last_became_active":"2024-04-25T12:21:54.200248+0000","last_became_peered":"2024-04-25T12:21:54.200248+0000","last_unstale":"2024-04-25T12:25:10.839451+0000","last_undegraded":"2024-04-25T12:25:10.839451+0000","last_fullsized":"2024-04-25T12:25:10.839451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:10.839247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:10.839247+0000","last_clean_scrub_stamp":"2024-04-25T12:25:10.839247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:56.595410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:03.684461+0000","last_change":"2024-04-25T12:25:03.684521+0000","last_active":"2024-04-25T12:25:03.684461+0000","last_peered":"2024-04-25T12:25:03.684461+0000","last_clean":"2024-04-25T12:25:03.684461+0000","last_became_active":"2024-04-25T12:21:54.197028+0000","last_became_peered":"2024-04-25T12:21:54.197028+0000","last_unstale":"2024-04-25T12:25:03.684461+0000","last_undegraded":"2024-04-25T12:25:03.684461+0000","last_fullsized":"2024-04-25T12:25:03.684461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:03.684266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:03.684266+0000","last_clean_scrub_stamp":"2024-04-25T12:25:03.684266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:11.437807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:09.989588+0000","last_change":"2024-04-25T12:25:09.989640+0000","last_active":"2024-04-25T12:25:09.989588+0000","last_peered":"2024-04-25T12:25:09.989588+0000","last_clean":"2024-04-25T12:25:09.989588+0000","last_became_active":"2024-04-25T12:21:54.189711+0000","last_became_peered":"2024-04-25T12:21:54.189711+0000","last_unstale":"2024-04-25T12:25:09.989588+0000","last_undegraded":"2024-04-25T12:25:09.989588+0000","last_fullsized":"2024-04-25T12:25:09.989588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:09.989420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:09.989420+0000","last_clean_scrub_stamp":"2024-04-25T12:25:09.989420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:45.790954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:11.714801+0000","last_change":"2024-04-25T12:25:11.714861+0000","last_active":"2024-04-25T12:25:11.714801+0000","last_peered":"2024-04-25T12:25:11.714801+0000","last_clean":"2024-04-25T12:25:11.714801+0000","last_became_active":"2024-04-25T12:21:54.196933+0000","last_became_peered":"2024-04-25T12:21:54.196933+0000","last_unstale":"2024-04-25T12:25:11.714801+0000","last_undegraded":"2024-04-25T12:25:11.714801+0000","last_fullsized":"2024-04-25T12:25:11.714801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:11.714616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:11.714616+0000","last_clean_scrub_stamp":"2024-04-25T12:25:11.714616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:14:38.510829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:14.044769+0000","last_change":"2024-04-25T12:25:14.044824+0000","last_active":"2024-04-25T12:25:14.044769+0000","last_peered":"2024-04-25T12:25:14.044769+0000","last_clean":"2024-04-25T12:25:14.044769+0000","last_became_active":"2024-04-25T12:21:54.207027+0000","last_became_peered":"2024-04-25T12:21:54.207027+0000","last_unstale":"2024-04-25T12:25:14.044769+0000","last_undegraded":"2024-04-25T12:25:14.044769+0000","last_fullsized":"2024-04-25T12:25:14.044769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:14.044600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:14.044600+0000","last_clean_scrub_stamp":"2024-04-25T12:25:14.044600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:08:22.404623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:03.908236+0000","last_change":"2024-04-25T12:25:03.908272+0000","last_active":"2024-04-25T12:25:03.908236+0000","last_peered":"2024-04-25T12:25:03.908236+0000","last_clean":"2024-04-25T12:25:03.908236+0000","last_became_active":"2024-04-25T12:21:54.184502+0000","last_became_peered":"2024-04-25T12:21:54.184502+0000","last_unstale":"2024-04-25T12:25:03.908236+0000","last_undegraded":"2024-04-25T12:25:03.908236+0000","last_fullsized":"2024-04-25T12:25:03.908236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:03.908133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:03.908133+0000","last_clean_scrub_stamp":"2024-04-25T12:25:03.908133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:07:02.783831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:08.619693+0000","last_change":"2024-04-25T12:25:08.619747+0000","last_active":"2024-04-25T12:25:08.619693+0000","last_peered":"2024-04-25T12:25:08.619693+0000","last_clean":"2024-04-25T12:25:08.619693+0000","last_became_active":"2024-04-25T12:21:54.182924+0000","last_became_peered":"2024-04-25T12:21:54.182924+0000","last_unstale":"2024-04-25T12:25:08.619693+0000","last_undegraded":"2024-04-25T12:25:08.619693+0000","last_fullsized":"2024-04-25T12:25:08.619693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:08.619496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:08.619496+0000","last_clean_scrub_stamp":"2024-04-25T12:25:08.619496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:10.421445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T12:25:12.741765+0000","last_change":"2024-04-25T12:25:12.741820+0000","last_active":"2024-04-25T12:25:12.741765+0000","last_peered":"2024-04-25T12:25:12.741765+0000","last_clean":"2024-04-25T12:25:12.741765+0000","last_became_active":"2024-04-25T12:21:54.210333+0000","last_became_peered":"2024-04-25T12:21:54.210333+0000","last_unstale":"2024-04-25T12:25:12.741765+0000","last_undegraded":"2024-04-25T12:25:12.741765+0000","last_fullsized":"2024-04-25T12:25:12.741765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:25:12.741579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:25:12.741579+0000","last_clean_scrub_stamp":"2024-04-25T12:25:12.741579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:39.099202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12592,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":25184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":250,"ondisk_log_size":250,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476787,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":921600,"data_stored":712870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476788,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":125616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476787,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":124334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476786,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":121732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542195,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":125650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542196,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":121864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542195,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":121352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542195,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36228,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335612,"statfs":{"total":96636764160,"available":96599666688,"internally_reserved":0,"allocated":913408,"data_stored":711062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:25:44.706 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T12:25:44.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.862+0000 7f5a7fe8f640 1 Processor -- start 2024-04-25T12:25:44.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.862+0000 7f5a7fe8f640 1 -- start start 2024-04-25T12:25:44.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.862+0000 7f5a7fe8f640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5a7814ffa0 0x7f5a7806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:44.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.862+0000 7f5a7fe8f640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f5a78074100 0x7f5a780c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:44.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.862+0000 7f5a7fe8f640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a780c5d70 con 0x7f5a7814fbc0 2024-04-25T12:25:44.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.862+0000 7f5a7fe8f640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f5a780c6050 con 0x7f5a78074100 2024-04-25T12:25:44.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.862+0000 7f5a7fe8f640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f5a780c6330 con 0x7f5a7814ffa0 2024-04-25T12:25:44.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.862+0000 7f5a7d42a640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5a7814ffa0 0x7f5a7806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:44.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.862+0000 7f5a7e42c640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f5a78074100 0x7f5a780c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:44.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.862+0000 7f5a7d42a640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5a7814ffa0 0x7f5a7806f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.94:43104/0 (socket says 172.21.15.94:43104) 2024-04-25T12:25:44.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.862+0000 7f5a7d42a640 1 -- 172.21.15.94:0/4198866337 learned_addr learned my addr 172.21.15.94:0/4198866337 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:44.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.862+0000 7f5a7e42c640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f5a78074100 0x7f5a780c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.94:41258/0 (socket says 172.21.15.94:41258) 2024-04-25T12:25:44.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.862+0000 7f5a7cc29640 1 -- 172.21.15.94:0/4198866337 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1843694039 0 0) 0x7f5a780c5d70 con 0x7f5a7814fbc0 2024-04-25T12:25:44.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.862+0000 7f5a7cc29640 1 -- 172.21.15.94:0/4198866337 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a64003530 con 0x7f5a7814fbc0 2024-04-25T12:25:44.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.862+0000 7f5a7d42a640 1 -- 172.21.15.94:0/4198866337 >> v2:172.21.15.111:3300/0 conn(0x7f5a78074100 msgr2=0x7f5a780c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:44.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.862+0000 7f5a7d42a640 1 --2- 172.21.15.94:0/4198866337 >> v2:172.21.15.111:3300/0 conn(0x7f5a78074100 0x7f5a780c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:44.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.862+0000 7f5a7d42a640 1 -- 172.21.15.94:0/4198866337 >> v1:172.21.15.111:6789/0 conn(0x7f5a7814fbc0 legacy=0x7f5a780c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:44.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.862+0000 7f5a7d42a640 1 -- 172.21.15.94:0/4198866337 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a780c6610 con 0x7f5a7814ffa0 2024-04-25T12:25:44.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.862+0000 7f5a7e42c640 1 --2- 172.21.15.94:0/4198866337 >> v2:172.21.15.111:3300/0 conn(0x7f5a78074100 0x7f5a780c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:25:44.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.866+0000 7f5a7d42a640 1 --2- 172.21.15.94:0/4198866337 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5a7814ffa0 0x7f5a7806f700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009870 tx=0x7f5a7401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5c32408c5dc81c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:44.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.866+0000 7f5a7cc29640 1 -- 172.21.15.94:0/4198866337 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a740a9640 con 0x7f5a7814ffa0 2024-04-25T12:25:44.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.866+0000 7f5a7cc29640 1 -- 172.21.15.94:0/4198866337 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a740a97e0 con 0x7f5a7814ffa0 2024-04-25T12:25:44.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.866+0000 7f5a7cc29640 1 -- 172.21.15.94:0/4198866337 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a740a9bb0 con 0x7f5a7814ffa0 2024-04-25T12:25:44.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.866+0000 7f5a7fe8f640 1 -- 172.21.15.94:0/4198866337 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5a7814ffa0 msgr2=0x7f5a7806f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:44.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.866+0000 7f5a7fe8f640 1 --2- 172.21.15.94:0/4198866337 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5a7814ffa0 0x7f5a7806f700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009870 tx=0x7f5a7401c560 comp rx=0 tx=0).stop 2024-04-25T12:25:44.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.866+0000 7f5a7fe8f640 1 -- 172.21.15.94:0/4198866337 shutdown_connections 2024-04-25T12:25:44.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.866+0000 7f5a7fe8f640 1 --2- 172.21.15.94:0/4198866337 >> v2:172.21.15.111:3300/0 conn(0x7f5a78074100 0x7f5a780c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:44.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.866+0000 7f5a7fe8f640 1 --2- 172.21.15.94:0/4198866337 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5a7814ffa0 0x7f5a7806f700 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:44.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.866+0000 7f5a7fe8f640 1 -- 172.21.15.94:0/4198866337 >> 172.21.15.94:0/4198866337 conn(0x7f5a7806b9d0 msgr2=0x7f5a7806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:44.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.866+0000 7f5a7fe8f640 1 -- 172.21.15.94:0/4198866337 shutdown_connections 2024-04-25T12:25:44.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.866+0000 7f5a7fe8f640 1 -- 172.21.15.94:0/4198866337 wait complete. 2024-04-25T12:25:44.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.866+0000 7f5a7fe8f640 1 Processor -- start 2024-04-25T12:25:44.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.866+0000 7f5a7fe8f640 1 -- start start 2024-04-25T12:25:44.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a7fe8f640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5a78074100 0x7f5a781f2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:44.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a7fe8f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a7814fbc0 0x7f5a781428b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:44.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a7fe8f640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5a7814ffa0 0x7f5a7815a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:44.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a7fe8f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5a780c8ab0 con 0x7f5a7814fbc0 2024-04-25T12:25:44.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a7fe8f640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5a780c8930 con 0x7f5a7814ffa0 2024-04-25T12:25:44.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a7fe8f640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f5a78166090 con 0x7f5a78074100 2024-04-25T12:25:44.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a7d42a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a7814fbc0 0x7f5a781428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:44.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a7d42a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a7814fbc0 0x7f5a781428b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:49630/0 (socket says 172.21.15.94:49630) 2024-04-25T12:25:44.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a7d42a640 1 -- 172.21.15.94:0/3007213007 learned_addr learned my addr 172.21.15.94:0/3007213007 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:44.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a7e42c640 1 --2- 172.21.15.94:0/3007213007 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5a7814ffa0 0x7f5a7815a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:44.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a7dc2b640 1 --2- 172.21.15.94:0/3007213007 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5a78074100 0x7f5a781f2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:44.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a7d42a640 1 -- 172.21.15.94:0/3007213007 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5a78074100 msgr2=0x7f5a781f2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:44.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a7d42a640 1 --2- 172.21.15.94:0/3007213007 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5a78074100 0x7f5a781f2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:44.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a7d42a640 1 -- 172.21.15.94:0/3007213007 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5a7814ffa0 msgr2=0x7f5a7815a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:44.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a7d42a640 1 --2- 172.21.15.94:0/3007213007 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5a7814ffa0 0x7f5a7815a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:44.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a7d42a640 1 -- 172.21.15.94:0/3007213007 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7815a150 con 0x7f5a7814fbc0 2024-04-25T12:25:44.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a7d42a640 1 --2- 172.21.15.94:0/3007213007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a7814fbc0 0x7f5a781428b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5a7401ca40 tx=0x7f5a74019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:44.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a6e7fc640 1 -- 172.21.15.94:0/3007213007 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a740ba680 con 0x7f5a7814fbc0 2024-04-25T12:25:44.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a6e7fc640 1 -- 172.21.15.94:0/3007213007 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a740ba820 con 0x7f5a7814fbc0 2024-04-25T12:25:44.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a7fe8f640 1 -- 172.21.15.94:0/3007213007 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7815c030 con 0x7f5a7814fbc0 2024-04-25T12:25:44.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a6e7fc640 1 -- 172.21.15.94:0/3007213007 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a740babf0 con 0x7f5a7814fbc0 2024-04-25T12:25:44.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a7fe8f640 1 -- 172.21.15.94:0/3007213007 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a7815c5f0 con 0x7f5a7814fbc0 2024-04-25T12:25:44.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a7fe8f640 1 -- 172.21.15.94:0/3007213007 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a78075df0 con 0x7f5a7814fbc0 2024-04-25T12:25:44.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a6e7fc640 1 -- 172.21.15.94:0/3007213007 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5a740c33f0 con 0x7f5a7814fbc0 2024-04-25T12:25:44.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a6e7fc640 1 --2- 172.21.15.94:0/3007213007 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5a5c068380 0x7f5a5c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:44.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a6e7fc640 1 -- 172.21.15.94:0/3007213007 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f5a74121650 con 0x7f5a7814fbc0 2024-04-25T12:25:44.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a7dc2b640 1 --2- 172.21.15.94:0/3007213007 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5a5c068380 0x7f5a5c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:44.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.870+0000 7f5a7dc2b640 1 --2- 172.21.15.94:0/3007213007 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5a5c068380 0x7f5a5c06a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5a68007fd0 tx=0x7f5a68009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:44.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:44.874+0000 7f5a6e7fc640 1 -- 172.21.15.94:0/3007213007 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5a740ad020 con 0x7f5a7814fbc0 2024-04-25T12:25:45.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.030+0000 7f5a7fe8f640 1 -- 172.21.15.94:0/3007213007 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f5a78149c50 con 0x7f5a7814fbc0 2024-04-25T12:25:45.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.034+0000 7f5a6e7fc640 1 -- 172.21.15.94:0/3007213007 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f5a74016150 con 0x7f5a7814fbc0 2024-04-25T12:25:45.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.034+0000 7f5a6e7fc640 1 -- 172.21.15.94:0/3007213007 <== mon.0 v2:172.21.15.94:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5a740f18b0 con 0x7f5a7814fbc0 2024-04-25T12:25:45.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.038+0000 7f5a7fe8f640 1 -- 172.21.15.94:0/3007213007 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5a5c068380 msgr2=0x7f5a5c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:45.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.038+0000 7f5a7fe8f640 1 --2- 172.21.15.94:0/3007213007 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5a5c068380 0x7f5a5c06a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5a68007fd0 tx=0x7f5a68009040 comp rx=0 tx=0).stop 2024-04-25T12:25:45.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.038+0000 7f5a7fe8f640 1 -- 172.21.15.94:0/3007213007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a7814fbc0 msgr2=0x7f5a781428b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:45.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.038+0000 7f5a7fe8f640 1 --2- 172.21.15.94:0/3007213007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a7814fbc0 0x7f5a781428b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5a7401ca40 tx=0x7f5a74019300 comp rx=0 tx=0).stop 2024-04-25T12:25:45.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.038+0000 7f5a7fe8f640 1 -- 172.21.15.94:0/3007213007 shutdown_connections 2024-04-25T12:25:45.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.038+0000 7f5a7fe8f640 1 --2- 172.21.15.94:0/3007213007 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f5a5c068380 0x7f5a5c06a840 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.038+0000 7f5a7fe8f640 1 --2- 172.21.15.94:0/3007213007 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5a7814ffa0 0x7f5a7815a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.038+0000 7f5a7fe8f640 1 --2- 172.21.15.94:0/3007213007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a7814fbc0 0x7f5a781428b0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.038+0000 7f5a7fe8f640 1 --2- 172.21.15.94:0/3007213007 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5a78074100 0x7f5a781f2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.038+0000 7f5a7fe8f640 1 -- 172.21.15.94:0/3007213007 >> 172.21.15.94:0/3007213007 conn(0x7f5a7806b9d0 msgr2=0x7f5a7806e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:45.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.038+0000 7f5a7fe8f640 1 -- 172.21.15.94:0/3007213007 shutdown_connections 2024-04-25T12:25:45.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.038+0000 7f5a7fe8f640 1 -- 172.21.15.94:0/3007213007 wait complete. 2024-04-25T12:25:45.058 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T12:25:45.059 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:25:45.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.170+0000 7fd468239640 1 Processor -- start 2024-04-25T12:25:45.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.170+0000 7fd468239640 1 -- start start 2024-04-25T12:25:45.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.170+0000 7fd468239640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd460155350 0x7fd4600c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:45.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.170+0000 7fd468239640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd46015b0b0 0x7fd46015b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:45.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.170+0000 7fd468239640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd46015beb0 con 0x7fd4600cda50 2024-04-25T12:25:45.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.170+0000 7fd468239640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fd4600cca40 con 0x7fd460155350 2024-04-25T12:25:45.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.170+0000 7fd468239640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fd4600ccc90 con 0x7fd46015b0b0 2024-04-25T12:25:45.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.170+0000 7fd465fd5640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd460155350 0x7fd4600c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:45.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.170+0000 7fd465fd5640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd460155350 0x7fd4600c59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:49638/0 (socket says 172.21.15.94:49638) 2024-04-25T12:25:45.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.170+0000 7fd4657d4640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fd4600cda50 0x7fd4600cb7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60576/0 (socket says 172.21.15.94:60576) 2024-04-25T12:25:45.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.170+0000 7fd465fd5640 1 -- 172.21.15.94:0/4198507388 learned_addr learned my addr 172.21.15.94:0/4198507388 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:45.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.170+0000 7fd4667d6640 1 --2- 172.21.15.94:0/4198507388 >> v2:172.21.15.111:3300/0 conn(0x7fd46015b0b0 0x7fd46015b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:45.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.170+0000 7fd465fd5640 1 -- 172.21.15.94:0/4198507388 >> v2:172.21.15.111:3300/0 conn(0x7fd46015b0b0 msgr2=0x7fd46015b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:45.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.170+0000 7fd465fd5640 1 --2- 172.21.15.94:0/4198507388 >> v2:172.21.15.111:3300/0 conn(0x7fd46015b0b0 0x7fd46015b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.170+0000 7fd465fd5640 1 -- 172.21.15.94:0/4198507388 >> v1:172.21.15.94:6789/0 conn(0x7fd4600cda50 legacy=0x7fd4600cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:45.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.170+0000 7fd465fd5640 1 -- 172.21.15.94:0/4198507388 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4600ccf70 con 0x7fd460155350 2024-04-25T12:25:45.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.170+0000 7fd4667d6640 1 --2- 172.21.15.94:0/4198507388 >> v2:172.21.15.111:3300/0 conn(0x7fd46015b0b0 0x7fd46015b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:25:45.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd465fd5640 1 --2- 172.21.15.94:0/4198507388 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd460155350 0x7fd4600c59c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd4600b44e0 tx=0x7fd45c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e811ec46413e06e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:45.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd464fd3640 1 -- 172.21.15.94:0/4198507388 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45c0b1070 con 0x7fd460155350 2024-04-25T12:25:45.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd464fd3640 1 -- 172.21.15.94:0/4198507388 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd45c0a8050 con 0x7fd460155350 2024-04-25T12:25:45.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd464fd3640 1 -- 172.21.15.94:0/4198507388 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45c0ac880 con 0x7fd460155350 2024-04-25T12:25:45.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd468239640 1 -- 172.21.15.94:0/4198507388 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd460155350 msgr2=0x7fd4600c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:45.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd468239640 1 --2- 172.21.15.94:0/4198507388 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd460155350 0x7fd4600c59c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd4600b44e0 tx=0x7fd45c01c440 comp rx=0 tx=0).stop 2024-04-25T12:25:45.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd468239640 1 -- 172.21.15.94:0/4198507388 shutdown_connections 2024-04-25T12:25:45.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd468239640 1 --2- 172.21.15.94:0/4198507388 >> v2:172.21.15.111:3300/0 conn(0x7fd46015b0b0 0x7fd46015b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd468239640 1 --2- 172.21.15.94:0/4198507388 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd460155350 0x7fd4600c59c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd468239640 1 -- 172.21.15.94:0/4198507388 >> 172.21.15.94:0/4198507388 conn(0x7fd46006cc30 msgr2=0x7fd46006d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:45.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd468239640 1 -- 172.21.15.94:0/4198507388 shutdown_connections 2024-04-25T12:25:45.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd468239640 1 -- 172.21.15.94:0/4198507388 wait complete. 2024-04-25T12:25:45.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd468239640 1 Processor -- start 2024-04-25T12:25:45.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd468239640 1 -- start start 2024-04-25T12:25:45.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd468239640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd4600cda50 0x7fd4600b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:45.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd468239640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd460155350 0x7fd460152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:45.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd468239640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd46015b0b0 0x7fd4601462b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:45.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd468239640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd460155730 con 0x7fd460155350 2024-04-25T12:25:45.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd468239640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd4600cd530 con 0x7fd4600cda50 2024-04-25T12:25:45.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd468239640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd46015e860 con 0x7fd46015b0b0 2024-04-25T12:25:45.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd4657d4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd460155350 0x7fd460152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:45.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd4657d4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd460155350 0x7fd460152f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:49652/0 (socket says 172.21.15.94:49652) 2024-04-25T12:25:45.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd4657d4640 1 -- 172.21.15.94:0/3500337826 learned_addr learned my addr 172.21.15.94:0/3500337826 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:45.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd4667d6640 1 --2- 172.21.15.94:0/3500337826 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd46015b0b0 0x7fd4601462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:45.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd465fd5640 1 --2- 172.21.15.94:0/3500337826 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd4600cda50 0x7fd4600b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:45.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd4657d4640 1 -- 172.21.15.94:0/3500337826 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd46015b0b0 msgr2=0x7fd4601462b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:45.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd4657d4640 1 --2- 172.21.15.94:0/3500337826 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd46015b0b0 0x7fd4601462b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd4657d4640 1 -- 172.21.15.94:0/3500337826 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd4600cda50 msgr2=0x7fd4600b5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:45.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd4657d4640 1 --2- 172.21.15.94:0/3500337826 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd4600cda50 0x7fd4600b5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd4657d4640 1 -- 172.21.15.94:0/3500337826 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd460147990 con 0x7fd460155350 2024-04-25T12:25:45.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd465fd5640 1 --2- 172.21.15.94:0/3500337826 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd4600cda50 0x7fd4600b5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:25:45.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd4657d4640 1 --2- 172.21.15.94:0/3500337826 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd460155350 0x7fd460152f90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd450009ed0 tx=0x7fd45000c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:45.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd4567fc640 1 -- 172.21.15.94:0/3500337826 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd450019070 con 0x7fd460155350 2024-04-25T12:25:45.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd4567fc640 1 -- 172.21.15.94:0/3500337826 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd450007a30 con 0x7fd460155350 2024-04-25T12:25:45.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd468239640 1 -- 172.21.15.94:0/3500337826 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd460150490 con 0x7fd460155350 2024-04-25T12:25:45.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd4567fc640 1 -- 172.21.15.94:0/3500337826 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd450007e00 con 0x7fd460155350 2024-04-25T12:25:45.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.174+0000 7fd468239640 1 -- 172.21.15.94:0/3500337826 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd460151240 con 0x7fd460155350 2024-04-25T12:25:45.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.178+0000 7fd468239640 1 -- 172.21.15.94:0/3500337826 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd460075df0 con 0x7fd460155350 2024-04-25T12:25:45.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.178+0000 7fd4567fc640 1 -- 172.21.15.94:0/3500337826 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd45001c070 con 0x7fd460155350 2024-04-25T12:25:45.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.178+0000 7fd4567fc640 1 --2- 172.21.15.94:0/3500337826 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd444068380 0x7fd44406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:45.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.178+0000 7fd4567fc640 1 -- 172.21.15.94:0/3500337826 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7fd450088d30 con 0x7fd460155350 2024-04-25T12:25:45.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.178+0000 7fd465fd5640 1 --2- 172.21.15.94:0/3500337826 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd444068380 0x7fd44406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:45.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.178+0000 7fd465fd5640 1 --2- 172.21.15.94:0/3500337826 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd444068380 0x7fd44406a840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd45c0ae000 tx=0x7fd45c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:45.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.182+0000 7fd4567fc640 1 -- 172.21.15.94:0/3500337826 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd460147990 con 0x7fd460155350 2024-04-25T12:25:45.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.378+0000 7fd468239640 1 -- 172.21.15.94:0/3500337826 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4600cde50 con 0x7fd460155350 2024-04-25T12:25:45.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.378+0000 7fd4567fc640 1 -- 172.21.15.94:0/3500337826 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6921 (secure 0 0 0) 0x7fd450058dd0 con 0x7fd460155350 2024-04-25T12:25:45.385 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:25:45.385 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6838/1468945344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6835","nonce":1468945344},{"type":"v1","addr":"172.21.15.94:6838","nonce":1468945344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T12:21:53.517464+0000","modified":"2024-04-25T12:24:43.925388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4285,"mds_1":4276,"mds_2":4254,"mds_3":4229,"mds_4":4223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4223":{"gid":4223,"name":"e","rank":4,"incarnation":18,"state":"up:active","state_seq":46,"addr":"172.21.15.94:6839/3773379365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":3773379365},{"type":"v1","addr":"172.21.15.94:6839","nonce":3773379365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4229":{"gid":4229,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":44,"addr":"172.21.15.111:6835/3463503555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3463503555},{"type":"v1","addr":"172.21.15.111:6835","nonce":3463503555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4254":{"gid":4254,"name":"a","rank":2,"incarnation":14,"state":"up:active","state_seq":43,"addr":"172.21.15.94:6837/1182495659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1182495659},{"type":"v1","addr":"172.21.15.94:6837","nonce":1182495659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":41,"addr":"172.21.15.111:6833/2332499082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":2332499082},{"type":"v1","addr":"172.21.15.111:6833","nonce":2332499082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.111:6837/3560813143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":3560813143},{"type":"v1","addr":"172.21.15.111:6837","nonce":3560813143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4223,4229,4254,4276,4285]},"id":1}]} 2024-04-25T12:25:45.385 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 19 2024-04-25T12:25:45.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.382+0000 7fd468239640 1 -- 172.21.15.94:0/3500337826 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd444068380 msgr2=0x7fd44406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:45.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.382+0000 7fd468239640 1 --2- 172.21.15.94:0/3500337826 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd444068380 0x7fd44406a840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd45c0ae000 tx=0x7fd45c0a7000 comp rx=0 tx=0).stop 2024-04-25T12:25:45.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.382+0000 7fd468239640 1 -- 172.21.15.94:0/3500337826 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd460155350 msgr2=0x7fd460152f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:45.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.382+0000 7fd468239640 1 --2- 172.21.15.94:0/3500337826 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd460155350 0x7fd460152f90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd450009ed0 tx=0x7fd45000c430 comp rx=0 tx=0).stop 2024-04-25T12:25:45.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.382+0000 7fd468239640 1 -- 172.21.15.94:0/3500337826 shutdown_connections 2024-04-25T12:25:45.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.382+0000 7fd468239640 1 --2- 172.21.15.94:0/3500337826 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fd444068380 0x7fd44406a840 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.382+0000 7fd468239640 1 --2- 172.21.15.94:0/3500337826 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd46015b0b0 0x7fd4601462b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.382+0000 7fd468239640 1 --2- 172.21.15.94:0/3500337826 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd460155350 0x7fd460152f90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.382+0000 7fd468239640 1 --2- 172.21.15.94:0/3500337826 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd4600cda50 0x7fd4600b5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.382+0000 7fd468239640 1 -- 172.21.15.94:0/3500337826 >> 172.21.15.94:0/3500337826 conn(0x7fd46006cc30 msgr2=0x7fd4600cb540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:45.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.382+0000 7fd468239640 1 -- 172.21.15.94:0/3500337826 shutdown_connections 2024-04-25T12:25:45.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.382+0000 7fd468239640 1 -- 172.21.15.94:0/3500337826 wait complete. 2024-04-25T12:25:45.403 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:25:45.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.506+0000 7f6abed93640 1 Processor -- start 2024-04-25T12:25:45.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.506+0000 7f6abed93640 1 -- start start 2024-04-25T12:25:45.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.506+0000 7f6abed93640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6ab8155300 0x7f6ab80c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:45.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.506+0000 7f6abed93640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6ab806f700 0x7f6ab815e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:45.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.506+0000 7f6abed93640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ab80c4e80 con 0x7f6ab815ec50 2024-04-25T12:25:45.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.506+0000 7f6abed93640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f6ab80c4230 con 0x7f6ab8155300 2024-04-25T12:25:45.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.506+0000 7f6abed93640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f6ab80c5770 con 0x7f6ab806f700 2024-04-25T12:25:45.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.506+0000 7f6abcb2f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6ab8155300 0x7f6ab80c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:45.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.506+0000 7f6abcb2f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6ab8155300 0x7f6ab80c3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:49668/0 (socket says 172.21.15.94:49668) 2024-04-25T12:25:45.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.506+0000 7f6abcb2f640 1 -- 172.21.15.94:0/3388760932 learned_addr learned my addr 172.21.15.94:0/3388760932 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:45.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.506+0000 7f6ab7fff640 1 --2- 172.21.15.94:0/3388760932 >> v2:172.21.15.111:3300/0 conn(0x7f6ab806f700 0x7f6ab815e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:45.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.506+0000 7f6abcb2f640 1 -- 172.21.15.94:0/3388760932 >> v2:172.21.15.111:3300/0 conn(0x7f6ab806f700 msgr2=0x7f6ab815e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:45.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.506+0000 7f6abcb2f640 1 --2- 172.21.15.94:0/3388760932 >> v2:172.21.15.111:3300/0 conn(0x7f6ab806f700 0x7f6ab815e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.506+0000 7f6abcb2f640 1 -- 172.21.15.94:0/3388760932 >> v1:172.21.15.111:6789/0 conn(0x7f6ab815ec50 legacy=0x7f6ab80c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:45.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.506+0000 7f6abcb2f640 1 -- 172.21.15.94:0/3388760932 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab815f080 con 0x7f6ab8155300 2024-04-25T12:25:45.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.506+0000 7f6ab7fff640 1 --2- 172.21.15.94:0/3388760932 >> v2:172.21.15.111:3300/0 conn(0x7f6ab806f700 0x7f6ab815e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:25:45.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.510+0000 7f6abcb2f640 1 --2- 172.21.15.94:0/3388760932 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ab8155300 0x7f6ab80c3cf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6ab80c38b0 tx=0x7f6aac01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c74216106c1849 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:45.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.510+0000 7f6ab77fe640 1 -- 172.21.15.94:0/3388760932 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac0b0070 con 0x7f6ab8155300 2024-04-25T12:25:45.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.510+0000 7f6ab77fe640 1 -- 172.21.15.94:0/3388760932 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6aac0ab600 con 0x7f6ab8155300 2024-04-25T12:25:45.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.510+0000 7f6ab77fe640 1 -- 172.21.15.94:0/3388760932 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac0ab9f0 con 0x7f6ab8155300 2024-04-25T12:25:45.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.510+0000 7f6abed93640 1 -- 172.21.15.94:0/3388760932 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ab8155300 msgr2=0x7f6ab80c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:45.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.510+0000 7f6abed93640 1 --2- 172.21.15.94:0/3388760932 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ab8155300 0x7f6ab80c3cf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6ab80c38b0 tx=0x7f6aac01c4e0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.510+0000 7f6abed93640 1 -- 172.21.15.94:0/3388760932 shutdown_connections 2024-04-25T12:25:45.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.510+0000 7f6abed93640 1 --2- 172.21.15.94:0/3388760932 >> v2:172.21.15.111:3300/0 conn(0x7f6ab806f700 0x7f6ab815e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.510+0000 7f6abed93640 1 --2- 172.21.15.94:0/3388760932 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ab8155300 0x7f6ab80c3cf0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.510+0000 7f6abed93640 1 -- 172.21.15.94:0/3388760932 >> 172.21.15.94:0/3388760932 conn(0x7f6ab806b9d0 msgr2=0x7f6ab806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:45.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.510+0000 7f6abed93640 1 -- 172.21.15.94:0/3388760932 shutdown_connections 2024-04-25T12:25:45.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.510+0000 7f6abed93640 1 -- 172.21.15.94:0/3388760932 wait complete. 2024-04-25T12:25:45.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.510+0000 7f6abed93640 1 Processor -- start 2024-04-25T12:25:45.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.510+0000 7f6abed93640 1 -- start start 2024-04-25T12:25:45.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.510+0000 7f6abed93640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6ab806f700 0x7f6ab80ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:45.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.510+0000 7f6abed93640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ab8155300 0x7f6ab815db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:45.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.510+0000 7f6abed93640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ab815ec50 0x7f6ab80cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:45.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.510+0000 7f6abed93640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab80681d0 con 0x7f6ab815ec50 2024-04-25T12:25:45.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.510+0000 7f6abed93640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab815f600 con 0x7f6ab8155300 2024-04-25T12:25:45.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.510+0000 7f6abed93640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6ab8068350 con 0x7f6ab806f700 2024-04-25T12:25:45.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.514+0000 7f6abd330640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ab815ec50 0x7f6ab80cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:45.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.514+0000 7f6abd330640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ab815ec50 0x7f6ab80cb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:49670/0 (socket says 172.21.15.94:49670) 2024-04-25T12:25:45.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.514+0000 7f6abd330640 1 -- 172.21.15.94:0/1762994984 learned_addr learned my addr 172.21.15.94:0/1762994984 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:45.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.514+0000 7f6ab7fff640 1 --2- 172.21.15.94:0/1762994984 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ab8155300 0x7f6ab815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:45.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.514+0000 7f6abcb2f640 1 --2- 172.21.15.94:0/1762994984 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6ab806f700 0x7f6ab80ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:45.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.514+0000 7f6abd330640 1 -- 172.21.15.94:0/1762994984 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6ab806f700 msgr2=0x7f6ab80ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:45.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.514+0000 7f6abd330640 1 --2- 172.21.15.94:0/1762994984 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6ab806f700 0x7f6ab80ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.514+0000 7f6abd330640 1 -- 172.21.15.94:0/1762994984 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ab8155300 msgr2=0x7f6ab815db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:45.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.514+0000 7f6abd330640 1 --2- 172.21.15.94:0/1762994984 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ab8155300 0x7f6ab815db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.514+0000 7f6abd330640 1 -- 172.21.15.94:0/1762994984 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab815d0c0 con 0x7f6ab815ec50 2024-04-25T12:25:45.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.514+0000 7f6abd330640 1 --2- 172.21.15.94:0/1762994984 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ab815ec50 0x7f6ab80cb230 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6ab000b9a0 tx=0x7f6ab000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:45.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.514+0000 7f6ab57fa640 1 -- 172.21.15.94:0/1762994984 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0019070 con 0x7f6ab815ec50 2024-04-25T12:25:45.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.514+0000 7f6ab57fa640 1 -- 172.21.15.94:0/1762994984 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6ab000cba0 con 0x7f6ab815ec50 2024-04-25T12:25:45.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.514+0000 7f6abed93640 1 -- 172.21.15.94:0/1762994984 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab815e070 con 0x7f6ab815ec50 2024-04-25T12:25:45.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.514+0000 7f6ab57fa640 1 -- 172.21.15.94:0/1762994984 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0014440 con 0x7f6ab815ec50 2024-04-25T12:25:45.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.514+0000 7f6abed93640 1 -- 172.21.15.94:0/1762994984 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ab80cbde0 con 0x7f6ab815ec50 2024-04-25T12:25:45.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.514+0000 7f6abed93640 1 -- 172.21.15.94:0/1762994984 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ab8075df0 con 0x7f6ab815ec50 2024-04-25T12:25:45.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.514+0000 7f6ab57fa640 1 -- 172.21.15.94:0/1762994984 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6ab001c070 con 0x7f6ab815ec50 2024-04-25T12:25:45.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.514+0000 7f6ab57fa640 1 --2- 172.21.15.94:0/1762994984 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6aa40683b0 0x7f6aa406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:45.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.514+0000 7f6ab57fa640 1 -- 172.21.15.94:0/1762994984 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f6ab0086990 con 0x7f6ab815ec50 2024-04-25T12:25:45.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.514+0000 7f6abcb2f640 1 --2- 172.21.15.94:0/1762994984 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6aa40683b0 0x7f6aa406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:45.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.514+0000 7f6abcb2f640 1 --2- 172.21.15.94:0/1762994984 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6aa40683b0 0x7f6aa406a870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0ad000 tx=0x7f6aac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:45.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.518+0000 7f6ab57fa640 1 -- 172.21.15.94:0/1762994984 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6ab0056b60 con 0x7f6ab815ec50 2024-04-25T12:25:45.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.698+0000 7f6abed93640 1 -- 172.21.15.94:0/1762994984 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ab806c4f0 con 0x7f6ab815ec50 2024-04-25T12:25:45.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.698+0000 7f6ab57fa640 1 -- 172.21.15.94:0/1762994984 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6921 (secure 0 0 0) 0x7f6ab0056460 con 0x7f6ab815ec50 2024-04-25T12:25:45.705 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:25:45.705 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6838/1468945344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6835","nonce":1468945344},{"type":"v1","addr":"172.21.15.94:6838","nonce":1468945344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T12:21:53.517464+0000","modified":"2024-04-25T12:24:43.925388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4285,"mds_1":4276,"mds_2":4254,"mds_3":4229,"mds_4":4223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4223":{"gid":4223,"name":"e","rank":4,"incarnation":18,"state":"up:active","state_seq":46,"addr":"172.21.15.94:6839/3773379365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":3773379365},{"type":"v1","addr":"172.21.15.94:6839","nonce":3773379365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4229":{"gid":4229,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":44,"addr":"172.21.15.111:6835/3463503555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3463503555},{"type":"v1","addr":"172.21.15.111:6835","nonce":3463503555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4254":{"gid":4254,"name":"a","rank":2,"incarnation":14,"state":"up:active","state_seq":43,"addr":"172.21.15.94:6837/1182495659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":1182495659},{"type":"v1","addr":"172.21.15.94:6837","nonce":1182495659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":41,"addr":"172.21.15.111:6833/2332499082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":2332499082},{"type":"v1","addr":"172.21.15.111:6833","nonce":2332499082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.111:6837/3560813143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":3560813143},{"type":"v1","addr":"172.21.15.111:6837","nonce":3560813143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4223,4229,4254,4276,4285]},"id":1}]} 2024-04-25T12:25:45.706 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 19 2024-04-25T12:25:45.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.702+0000 7f6abed93640 1 -- 172.21.15.94:0/1762994984 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6aa40683b0 msgr2=0x7f6aa406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:45.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.702+0000 7f6abed93640 1 --2- 172.21.15.94:0/1762994984 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6aa40683b0 0x7f6aa406a870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0ad000 tx=0x7f6aac008040 comp rx=0 tx=0).stop 2024-04-25T12:25:45.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.702+0000 7f6abed93640 1 -- 172.21.15.94:0/1762994984 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ab815ec50 msgr2=0x7f6ab80cb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:45.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.702+0000 7f6abed93640 1 --2- 172.21.15.94:0/1762994984 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ab815ec50 0x7f6ab80cb230 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6ab000b9a0 tx=0x7f6ab000be60 comp rx=0 tx=0).stop 2024-04-25T12:25:45.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.702+0000 7f6abed93640 1 -- 172.21.15.94:0/1762994984 shutdown_connections 2024-04-25T12:25:45.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.702+0000 7f6abed93640 1 --2- 172.21.15.94:0/1762994984 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f6aa40683b0 0x7f6aa406a870 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.702+0000 7f6abed93640 1 --2- 172.21.15.94:0/1762994984 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ab815ec50 0x7f6ab80cb230 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.702+0000 7f6abed93640 1 --2- 172.21.15.94:0/1762994984 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ab8155300 0x7f6ab815db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.702+0000 7f6abed93640 1 --2- 172.21.15.94:0/1762994984 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6ab806f700 0x7f6ab80ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.702+0000 7f6abed93640 1 -- 172.21.15.94:0/1762994984 >> 172.21.15.94:0/1762994984 conn(0x7f6ab806b9d0 msgr2=0x7f6ab806bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:45.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.702+0000 7f6abed93640 1 -- 172.21.15.94:0/1762994984 shutdown_connections 2024-04-25T12:25:45.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.702+0000 7f6abed93640 1 -- 172.21.15.94:0/1762994984 wait complete. 2024-04-25T12:25:45.723 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:25:45.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.826+0000 7ff50514b640 1 Processor -- start 2024-04-25T12:25:45.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.826+0000 7ff50514b640 1 -- start start 2024-04-25T12:25:45.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff50514b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff5000c8640 0x7ff500158950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:45.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff50514b640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff5000c6030 0x7ff5000c6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:45.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff50514b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff500152620 con 0x7ff500152240 2024-04-25T12:25:45.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff50514b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7ff500158e90 con 0x7ff5000c8640 2024-04-25T12:25:45.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff50514b640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff5000c8ae0 con 0x7ff5000c6030 2024-04-25T12:25:45.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff4f7fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff5000c8640 0x7ff500158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:45.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff4f7fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff5000c8640 0x7ff500158950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:49672/0 (socket says 172.21.15.94:49672) 2024-04-25T12:25:45.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff4f7fff640 1 -- 172.21.15.94:0/2033643524 learned_addr learned my addr 172.21.15.94:0/2033643524 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:45.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff4fed9d640 1 --1- 172.21.15.94:0/2033643524 >> v1:172.21.15.94:6789/0 conn(0x7ff500152240 0x7ff5000cd640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60578/0 (socket says 172.21.15.94:60578) 2024-04-25T12:25:45.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff4ff59e640 1 --2- 172.21.15.94:0/2033643524 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff5000c6030 0x7ff5000c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:45.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff4f7fff640 1 -- 172.21.15.94:0/2033643524 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff5000c6030 msgr2=0x7ff5000c6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:45.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff4f7fff640 1 --2- 172.21.15.94:0/2033643524 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff5000c6030 0x7ff5000c6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff4f7fff640 1 -- 172.21.15.94:0/2033643524 >> v1:172.21.15.94:6789/0 conn(0x7ff500152240 legacy=0x7ff5000cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:45.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff4f7fff640 1 -- 172.21.15.94:0/2033643524 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5000c69a0 con 0x7ff5000c8640 2024-04-25T12:25:45.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff4fe59c640 1 -- 172.21.15.94:0/2033643524 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3267030132 0 0) 0x7ff500152620 con 0x7ff500152240 2024-04-25T12:25:45.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff4f7fff640 1 --2- 172.21.15.94:0/2033643524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5000c8640 0x7ff500158950 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800bb10 tx=0x7ff4e8021420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed6bf616e04f737 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:45.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff4fe59c640 1 -- 172.21.15.94:0/2033643524 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e80b6070 con 0x7ff5000c8640 2024-04-25T12:25:45.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff4fe59c640 1 -- 172.21.15.94:0/2033643524 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff4e80b1600 con 0x7ff5000c8640 2024-04-25T12:25:45.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff4fe59c640 1 -- 172.21.15.94:0/2033643524 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e80b19f0 con 0x7ff5000c8640 2024-04-25T12:25:45.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff50514b640 1 -- 172.21.15.94:0/2033643524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5000c8640 msgr2=0x7ff500158950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:45.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff50514b640 1 --2- 172.21.15.94:0/2033643524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5000c8640 0x7ff500158950 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800bb10 tx=0x7ff4e8021420 comp rx=0 tx=0).stop 2024-04-25T12:25:45.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff50514b640 1 -- 172.21.15.94:0/2033643524 shutdown_connections 2024-04-25T12:25:45.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff50514b640 1 --2- 172.21.15.94:0/2033643524 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff5000c6030 0x7ff5000c6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff50514b640 1 --2- 172.21.15.94:0/2033643524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5000c8640 0x7ff500158950 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff50514b640 1 -- 172.21.15.94:0/2033643524 >> 172.21.15.94:0/2033643524 conn(0x7ff50006fca0 msgr2=0x7ff5000700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:45.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff50514b640 1 -- 172.21.15.94:0/2033643524 shutdown_connections 2024-04-25T12:25:45.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.830+0000 7ff50514b640 1 -- 172.21.15.94:0/2033643524 wait complete. 2024-04-25T12:25:45.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff50514b640 1 Processor -- start 2024-04-25T12:25:45.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff50514b640 1 -- start start 2024-04-25T12:25:45.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff50514b640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff5000c6030 0x7ff50014d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:45.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff50514b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff5000c8640 0x7ff5001ecca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:45.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff50514b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff500152240 0x7ff5000cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:45.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff50514b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff50015ba40 con 0x7ff500152240 2024-04-25T12:25:45.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff50514b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff50015b760 con 0x7ff5000c8640 2024-04-25T12:25:45.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff50514b640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff50015bd20 con 0x7ff5000c6030 2024-04-25T12:25:45.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff4ff59e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff500152240 0x7ff5000cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:45.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff4ff59e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff500152240 0x7ff5000cc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:49684/0 (socket says 172.21.15.94:49684) 2024-04-25T12:25:45.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff4ff59e640 1 -- 172.21.15.94:0/2355991383 learned_addr learned my addr 172.21.15.94:0/2355991383 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:45.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff4fed9d640 1 --2- 172.21.15.94:0/2355991383 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff5000c6030 0x7ff50014d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:45.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff4f7fff640 1 --2- 172.21.15.94:0/2355991383 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff5000c8640 0x7ff5001ecca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:45.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff4ff59e640 1 -- 172.21.15.94:0/2355991383 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff5000c6030 msgr2=0x7ff50014d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:45.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff4ff59e640 1 --2- 172.21.15.94:0/2355991383 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff5000c6030 0x7ff50014d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff4ff59e640 1 -- 172.21.15.94:0/2355991383 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff5000c8640 msgr2=0x7ff5001ecca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:45.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff4ff59e640 1 --2- 172.21.15.94:0/2355991383 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff5000c8640 0x7ff5001ecca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:45.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff4ff59e640 1 -- 172.21.15.94:0/2355991383 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50014c5a0 con 0x7ff500152240 2024-04-25T12:25:45.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff4f7fff640 1 --2- 172.21.15.94:0/2355991383 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff5000c8640 0x7ff5001ecca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:25:45.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff4ff59e640 1 --2- 172.21.15.94:0/2355991383 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff500152240 0x7ff5000cc990 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8007e40 tx=0x7ff4f800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:45.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff4f77fe640 1 -- 172.21.15.94:0/2355991383 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8014620 con 0x7ff500152240 2024-04-25T12:25:45.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff4f77fe640 1 -- 172.21.15.94:0/2355991383 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff4f8019070 con 0x7ff500152240 2024-04-25T12:25:45.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff50514b640 1 -- 172.21.15.94:0/2355991383 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff50014c880 con 0x7ff500152240 2024-04-25T12:25:45.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff4f77fe640 1 -- 172.21.15.94:0/2355991383 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8014a40 con 0x7ff500152240 2024-04-25T12:25:45.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff50514b640 1 -- 172.21.15.94:0/2355991383 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5001f0620 con 0x7ff500152240 2024-04-25T12:25:45.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff50514b640 1 -- 172.21.15.94:0/2355991383 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff500075df0 con 0x7ff500152240 2024-04-25T12:25:45.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff4f77fe640 1 -- 172.21.15.94:0/2355991383 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff4f8014be0 con 0x7ff500152240 2024-04-25T12:25:45.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.834+0000 7ff4f77fe640 1 --2- 172.21.15.94:0/2355991383 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff4e0068380 0x7ff4e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:45.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.838+0000 7ff4fed9d640 1 --2- 172.21.15.94:0/2355991383 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff4e0068380 0x7ff4e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:45.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.838+0000 7ff4f77fe640 1 -- 172.21.15.94:0/2355991383 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7ff4f80876d0 con 0x7ff500152240 2024-04-25T12:25:45.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.838+0000 7ff4fed9d640 1 --2- 172.21.15.94:0/2355991383 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff4e0068380 0x7ff4e006a840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0000f70 tx=0x7ff4f0007c10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:45.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:45.842+0000 7ff4f77fe640 1 -- 172.21.15.94:0/2355991383 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff4f80578a0 con 0x7ff500152240 2024-04-25T12:25:46.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.002+0000 7ff50514b640 1 -- 172.21.15.94:0/2355991383 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5000c91d0 con 0x7ff500152240 2024-04-25T12:25:46.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.002+0000 7ff4f77fe640 1 -- 172.21.15.94:0/2355991383 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18873 (secure 0 0 0) 0x7ff4f80571a0 con 0x7ff500152240 2024-04-25T12:25:46.010 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-25T12:25:46.010 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"7059a9e2-aec4-4b84-b942-caf531e15da3","created":"2024-04-25T12:21:29.118508+0000","modified":"2024-04-25T12:22:34.871807+0000","last_up_change":"2024-04-25T12:21:40.912605+0000","last_in_change":"2024-04-25T12:21:31.372905+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:21:39.781011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:21:51.465886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:21:52.470540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:21:56.209936+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"640a65ef-0734-468a-a8f5-9ed70cf75c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6809","nonce":2553247564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6811","nonce":2553247564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6815","nonce":2553247564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2553247564},{"type":"v1","addr":"172.21.15.94:6813","nonce":2553247564}]},"public_addr":"172.21.15.94:6809/2553247564","cluster_addr":"172.21.15.94:6811/2553247564","heartbeat_back_addr":"172.21.15.94:6815/2553247564","heartbeat_front_addr":"172.21.15.94:6813/2553247564","state":["exists","up"]},{"osd":1,"uuid":"d6e886e6-c8c1-4761-9a4c-abc6961c7c81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6818","nonce":2492806478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6822","nonce":2492806478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6830","nonce":2492806478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":2492806478},{"type":"v1","addr":"172.21.15.94:6826","nonce":2492806478}]},"public_addr":"172.21.15.94:6818/2492806478","cluster_addr":"172.21.15.94:6822/2492806478","heartbeat_back_addr":"172.21.15.94:6830/2492806478","heartbeat_front_addr":"172.21.15.94:6826/2492806478","state":["exists","up"]},{"osd":2,"uuid":"ba20f409-ed46-43b6-b16d-43dc4622c042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6801","nonce":1485061290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6803","nonce":1485061290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6807","nonce":1485061290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1485061290},{"type":"v1","addr":"172.21.15.94:6805","nonce":1485061290}]},"public_addr":"172.21.15.94:6801/1485061290","cluster_addr":"172.21.15.94:6803/1485061290","heartbeat_back_addr":"172.21.15.94:6807/1485061290","heartbeat_front_addr":"172.21.15.94:6805/1485061290","state":["exists","up"]},{"osd":3,"uuid":"85816a2b-3a3f-4ec8-8373-8230d948396f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6819","nonce":1548488434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6823","nonce":1548488434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6829","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6831","nonce":1548488434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6825","nonce":1548488434},{"type":"v1","addr":"172.21.15.94:6827","nonce":1548488434}]},"public_addr":"172.21.15.94:6819/1548488434","cluster_addr":"172.21.15.94:6823/1548488434","heartbeat_back_addr":"172.21.15.94:6831/1548488434","heartbeat_front_addr":"172.21.15.94:6827/1548488434","state":["exists","up"]},{"osd":4,"uuid":"b4a953b7-01d6-4623-9324-63135fdaf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6811","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6814","nonce":4070977083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6817","nonce":4070977083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6823","nonce":4070977083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6819","nonce":4070977083},{"type":"v1","addr":"172.21.15.111:6821","nonce":4070977083}]},"public_addr":"172.21.15.111:6814/4070977083","cluster_addr":"172.21.15.111:6817/4070977083","heartbeat_back_addr":"172.21.15.111:6823/4070977083","heartbeat_front_addr":"172.21.15.111:6821/4070977083","state":["exists","up"]},{"osd":5,"uuid":"c0acc514-427d-41bf-a965-b8463cebf045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6803","nonce":1054925605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6809","nonce":1054925605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6820","nonce":1054925605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1054925605},{"type":"v1","addr":"172.21.15.111:6815","nonce":1054925605}]},"public_addr":"172.21.15.111:6803/1054925605","cluster_addr":"172.21.15.111:6809/1054925605","heartbeat_back_addr":"172.21.15.111:6820/1054925605","heartbeat_front_addr":"172.21.15.111:6815/1054925605","state":["exists","up"]},{"osd":6,"uuid":"26ff742f-5a57-44a7-a095-f04d6e87f885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6825","nonce":3619235078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6827","nonce":3619235078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6831","nonce":3619235078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3619235078},{"type":"v1","addr":"172.21.15.111:6829","nonce":3619235078}]},"public_addr":"172.21.15.111:6825/3619235078","cluster_addr":"172.21.15.111:6827/3619235078","heartbeat_back_addr":"172.21.15.111:6831/3619235078","heartbeat_front_addr":"172.21.15.111:6829/3619235078","state":["exists","up"]},{"osd":7,"uuid":"9c214cba-693a-4b25-aad7-05a5b0006e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6801","nonce":558758517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6805","nonce":558758517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6813","nonce":558758517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6807","nonce":558758517},{"type":"v1","addr":"172.21.15.111:6808","nonce":558758517}]},"public_addr":"172.21.15.111:6801/558758517","cluster_addr":"172.21.15.111:6805/558758517","heartbeat_back_addr":"172.21.15.111:6813/558758517","heartbeat_front_addr":"172.21.15.111:6808/558758517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.664958+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.853375+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.654455+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:37.033852+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.968691+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.856013+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.913496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:21:36.848565+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:25:46.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.006+0000 7ff50514b640 1 -- 172.21.15.94:0/2355991383 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff4e0068380 msgr2=0x7ff4e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:46.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.006+0000 7ff50514b640 1 --2- 172.21.15.94:0/2355991383 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff4e0068380 0x7ff4e006a840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0000f70 tx=0x7ff4f0007c10 comp rx=0 tx=0).stop 2024-04-25T12:25:46.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.006+0000 7ff50514b640 1 -- 172.21.15.94:0/2355991383 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff500152240 msgr2=0x7ff5000cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:46.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.006+0000 7ff50514b640 1 --2- 172.21.15.94:0/2355991383 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff500152240 0x7ff5000cc990 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8007e40 tx=0x7ff4f800e4b0 comp rx=0 tx=0).stop 2024-04-25T12:25:46.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.006+0000 7ff50514b640 1 -- 172.21.15.94:0/2355991383 shutdown_connections 2024-04-25T12:25:46.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.006+0000 7ff50514b640 1 --2- 172.21.15.94:0/2355991383 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7ff4e0068380 0x7ff4e006a840 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:46.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.006+0000 7ff50514b640 1 --2- 172.21.15.94:0/2355991383 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff500152240 0x7ff5000cc990 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:46.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.006+0000 7ff50514b640 1 --2- 172.21.15.94:0/2355991383 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff5000c8640 0x7ff5001ecca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:46.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.006+0000 7ff50514b640 1 --2- 172.21.15.94:0/2355991383 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff5000c6030 0x7ff50014d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:46.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.006+0000 7ff50514b640 1 -- 172.21.15.94:0/2355991383 >> 172.21.15.94:0/2355991383 conn(0x7ff50006fca0 msgr2=0x7ff5001512b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:46.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.006+0000 7ff50514b640 1 -- 172.21.15.94:0/2355991383 shutdown_connections 2024-04-25T12:25:46.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.006+0000 7ff50514b640 1 -- 172.21.15.94:0/2355991383 wait complete. 2024-04-25T12:25:46.028 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T12:25:46.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.134+0000 7f7379d6d640 1 Processor -- start 2024-04-25T12:25:46.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.134+0000 7f7379d6d640 1 -- start start 2024-04-25T12:25:46.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.134+0000 7f7379d6d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f73740c8250 0x7f73740c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:46.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.134+0000 7f7379d6d640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f737415b740 con 0x7f73740c8630 2024-04-25T12:25:46.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.134+0000 7f7379d6d640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73740c58c0 con 0x7f73740c8a70 2024-04-25T12:25:46.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.134+0000 7f7379d6d640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f73740c6490 con 0x7f73740c8250 2024-04-25T12:25:46.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.134+0000 7f7372ffd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f73740c8630 0x7f7374151b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60590/0 (socket says 172.21.15.94:60590) 2024-04-25T12:25:46.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.134+0000 7f7372ffd640 1 -- 172.21.15.94:0/1215804165 learned_addr learned my addr 172.21.15.94:0/1215804165 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:25:46.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.134+0000 7f73737fe640 1 --2- 172.21.15.94:0/1215804165 >> v2:172.21.15.94:3300/0 conn(0x7f73740c8250 0x7f73740c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:46.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.134+0000 7f73727fc640 1 -- 172.21.15.94:0/1215804165 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1423995801 0 0) 0x7f737415b740 con 0x7f73740c8630 2024-04-25T12:25:46.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.134+0000 7f73727fc640 1 -- 172.21.15.94:0/1215804165 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f735c003530 con 0x7f73740c8630 2024-04-25T12:25:46.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.134+0000 7f73737fe640 1 -- 172.21.15.94:0/1215804165 >> v1:172.21.15.111:6789/0 conn(0x7f73740c8a70 legacy=0x7f7374162790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:46.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.134+0000 7f73737fe640 1 -- 172.21.15.94:0/1215804165 >> v1:172.21.15.94:6789/0 conn(0x7f73740c8630 legacy=0x7f7374151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:46.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.134+0000 7f73737fe640 1 -- 172.21.15.94:0/1215804165 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73740c5b60 con 0x7f73740c8250 2024-04-25T12:25:46.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.138+0000 7f73737fe640 1 --2- 172.21.15.94:0/1215804165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f73740c8250 0x7f73740c39e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7364009d90 tx=0x7f736401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8341767275efe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:46.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.138+0000 7f73727fc640 1 -- 172.21.15.94:0/1215804165 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73640b2070 con 0x7f73740c8250 2024-04-25T12:25:46.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.138+0000 7f73727fc640 1 -- 172.21.15.94:0/1215804165 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f73640a57a0 con 0x7f73740c8250 2024-04-25T12:25:46.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.138+0000 7f73727fc640 1 -- 172.21.15.94:0/1215804165 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73640a5b50 con 0x7f73740c8250 2024-04-25T12:25:46.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.138+0000 7f7379d6d640 1 -- 172.21.15.94:0/1215804165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f73740c8250 msgr2=0x7f73740c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:46.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.138+0000 7f7379d6d640 1 --2- 172.21.15.94:0/1215804165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f73740c8250 0x7f73740c39e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7364009d90 tx=0x7f736401c8e0 comp rx=0 tx=0).stop 2024-04-25T12:25:46.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.138+0000 7f7379d6d640 1 -- 172.21.15.94:0/1215804165 shutdown_connections 2024-04-25T12:25:46.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.138+0000 7f7379d6d640 1 --2- 172.21.15.94:0/1215804165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f73740c8250 0x7f73740c39e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:46.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.138+0000 7f7379d6d640 1 -- 172.21.15.94:0/1215804165 >> 172.21.15.94:0/1215804165 conn(0x7f737406b9d0 msgr2=0x7f737406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:46.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.138+0000 7f7379d6d640 1 -- 172.21.15.94:0/1215804165 shutdown_connections 2024-04-25T12:25:46.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.138+0000 7f7379d6d640 1 -- 172.21.15.94:0/1215804165 wait complete. 2024-04-25T12:25:46.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f7379d6d640 1 Processor -- start 2024-04-25T12:25:46.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f7379d6d640 1 -- start start 2024-04-25T12:25:46.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f7379d6d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73740c8630 0x7f737415a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:46.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f7379d6d640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f73740c8a70 0x7f7374153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:46.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f7379d6d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7374153b40 0x7f7374154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:46.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f7379d6d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f73740c6920 con 0x7f7374153b40 2024-04-25T12:25:46.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f7379d6d640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f737415b400 con 0x7f73740c8630 2024-04-25T12:25:46.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f7379d6d640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f73740681d0 con 0x7f73740c8a70 2024-04-25T12:25:46.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f7373fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7374153b40 0x7f7374154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:46.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f7373fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7374153b40 0x7f7374154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:49704/0 (socket says 172.21.15.94:49704) 2024-04-25T12:25:46.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f7373fff640 1 -- 172.21.15.94:0/3192896966 learned_addr learned my addr 172.21.15.94:0/3192896966 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:46.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f73737fe640 1 --2- 172.21.15.94:0/3192896966 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73740c8630 0x7f737415a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:46.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f7373fff640 1 -- 172.21.15.94:0/3192896966 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f73740c8a70 msgr2=0x7f7374153600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:46.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f7373fff640 1 --2- 172.21.15.94:0/3192896966 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f73740c8a70 0x7f7374153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:46.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f7373fff640 1 -- 172.21.15.94:0/3192896966 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73740c8630 msgr2=0x7f737415a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:46.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f7373fff640 1 --2- 172.21.15.94:0/3192896966 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73740c8630 0x7f737415a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:46.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f7373fff640 1 -- 172.21.15.94:0/3192896966 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73740ca390 con 0x7f7374153b40 2024-04-25T12:25:46.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f7373fff640 1 --2- 172.21.15.94:0/3192896966 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7374153b40 0x7f7374154530 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f736c00c3f0 tx=0x7f736c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:46.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f735bfff640 1 -- 172.21.15.94:0/3192896966 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736c017070 con 0x7f7374153b40 2024-04-25T12:25:46.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f735bfff640 1 -- 172.21.15.94:0/3192896966 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f736c0052d0 con 0x7f7374153b40 2024-04-25T12:25:46.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f735bfff640 1 -- 172.21.15.94:0/3192896966 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736c003880 con 0x7f7374153b40 2024-04-25T12:25:46.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f7379d6d640 1 -- 172.21.15.94:0/3192896966 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73741f8490 con 0x7f7374153b40 2024-04-25T12:25:46.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f7379d6d640 1 -- 172.21.15.94:0/3192896966 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7374152840 con 0x7f7374153b40 2024-04-25T12:25:46.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f7379d6d640 1 -- 172.21.15.94:0/3192896966 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7374075df0 con 0x7f7374153b40 2024-04-25T12:25:46.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f735bfff640 1 -- 172.21.15.94:0/3192896966 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f736c01a070 con 0x7f7374153b40 2024-04-25T12:25:46.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f735bfff640 1 --2- 172.21.15.94:0/3192896966 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7360068380 0x7f736006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:46.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f73737fe640 1 --2- 172.21.15.94:0/3192896966 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7360068380 0x7f736006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:46.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.142+0000 7f735bfff640 1 -- 172.21.15.94:0/3192896966 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6714+0+0 (secure 0 0 0) 0x7f736c0861b0 con 0x7f7374153b40 2024-04-25T12:25:46.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.146+0000 7f73737fe640 1 --2- 172.21.15.94:0/3192896966 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7360068380 0x7f736006a840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f73640af000 tx=0x7f73640a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:46.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.150+0000 7f735bfff640 1 -- 172.21.15.94:0/3192896966 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f736c005480 con 0x7f7374153b40 2024-04-25T12:25:46.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.350+0000 7f7379d6d640 1 -- 172.21.15.94:0/3192896966 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7374071e50 con 0x7f7374153b40 2024-04-25T12:25:46.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.350+0000 7f735bfff640 1 -- 172.21.15.94:0/3192896966 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) ==== 161+0+0 (secure 0 0 0) 0x7f736c0562f0 con 0x7f7374153b40 2024-04-25T12:25:46.357 INFO:teuthology.orchestra.run.smithi094.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T12:25:46.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.354+0000 7f7379d6d640 1 -- 172.21.15.94:0/3192896966 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7360068380 msgr2=0x7f736006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:46.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.354+0000 7f7379d6d640 1 --2- 172.21.15.94:0/3192896966 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7360068380 0x7f736006a840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f73640af000 tx=0x7f73640a7070 comp rx=0 tx=0).stop 2024-04-25T12:25:46.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.354+0000 7f7379d6d640 1 -- 172.21.15.94:0/3192896966 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7374153b40 msgr2=0x7f7374154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:46.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.354+0000 7f7379d6d640 1 --2- 172.21.15.94:0/3192896966 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7374153b40 0x7f7374154530 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f736c00c3f0 tx=0x7f736c00c8b0 comp rx=0 tx=0).stop 2024-04-25T12:25:46.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.358+0000 7f7379d6d640 1 -- 172.21.15.94:0/3192896966 shutdown_connections 2024-04-25T12:25:46.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.358+0000 7f7379d6d640 1 --2- 172.21.15.94:0/3192896966 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f7360068380 0x7f736006a840 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:46.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.358+0000 7f7379d6d640 1 --2- 172.21.15.94:0/3192896966 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f73740c8a70 0x7f7374153600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:46.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.358+0000 7f7379d6d640 1 --2- 172.21.15.94:0/3192896966 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7374153b40 0x7f7374154530 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:46.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.358+0000 7f7379d6d640 1 --2- 172.21.15.94:0/3192896966 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73740c8630 0x7f737415a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:46.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.358+0000 7f7379d6d640 1 -- 172.21.15.94:0/3192896966 >> 172.21.15.94:0/3192896966 conn(0x7f737406b9d0 msgr2=0x7f737414d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:46.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.358+0000 7f7379d6d640 1 -- 172.21.15.94:0/3192896966 shutdown_connections 2024-04-25T12:25:46.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.358+0000 7f7379d6d640 1 -- 172.21.15.94:0/3192896966 wait complete. 2024-04-25T12:25:46.376 INFO:tasks.ceph.mds.b.smithi111.stderr: -9220> 2024-04-25T12:22:08.043+0000 7fc186a0f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T12:25:46.384 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T12:25:46.388 INFO:tasks.ceph.mds.b.smithi111.stderr: -3774> 2024-04-25T12:24:28.056+0000 7fc186a0f640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-25T12:25:46.388 INFO:tasks.ceph.mds.b.smithi111.stderr: -3499> 2024-04-25T12:24:33.056+0000 7fc186a0f640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-25T12:25:46.393 INFO:tasks.ceph.mds.e.smithi094.stdout:starting mds.e at 2024-04-25T12:25:46.408 INFO:tasks.ceph.mds.a.smithi094.stdout:starting mds.a at 2024-04-25T12:25:46.420 INFO:tasks.ceph.mds.f.smithi111.stdout:starting mds.f at 2024-04-25T12:25:46.422 INFO:tasks.ceph.mds.b.smithi111.stdout:starting mds.b at 2024-04-25T12:25:46.427 INFO:tasks.ceph.mds.d.smithi111.stdout:starting mds.d at 2024-04-25T12:25:46.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.486+0000 7fa1ef7b2640 1 Processor -- start 2024-04-25T12:25:46.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.486+0000 7fa1ef7b2640 1 -- start start 2024-04-25T12:25:46.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.486+0000 7fa1ef7b2640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa1e814fbc0 0x7fa1e806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:46.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.486+0000 7fa1ef7b2640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa1e814ffa0 0x7fa1e80c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:46.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.486+0000 7fa1ef7b2640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1e80c5d70 con 0x7fa1e8074100 2024-04-25T12:25:46.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.486+0000 7fa1ef7b2640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fa1e80c6050 con 0x7fa1e814ffa0 2024-04-25T12:25:46.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.486+0000 7fa1ef7b2640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e80c6330 con 0x7fa1e814fbc0 2024-04-25T12:25:46.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.486+0000 7fa1ecd4d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa1e814ffa0 0x7fa1e80c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:46.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.486+0000 7fa1edd4f640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fa1e8074100 0x7fa1e80c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60610/0 (socket says 172.21.15.94:60610) 2024-04-25T12:25:46.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.486+0000 7fa1edd4f640 1 -- 172.21.15.94:0/1427898360 learned_addr learned my addr 172.21.15.94:0/1427898360 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:25:46.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.486+0000 7fa1ed54e640 1 --2- 172.21.15.94:0/1427898360 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa1e814fbc0 0x7fa1e806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:46.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.486+0000 7fa1ecd4d640 1 -- 172.21.15.94:0/1427898360 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa1e814fbc0 msgr2=0x7fa1e806f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:46.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.486+0000 7fa1ecd4d640 1 --2- 172.21.15.94:0/1427898360 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa1e814fbc0 0x7fa1e806f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:46.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.486+0000 7fa1dffff640 1 -- 172.21.15.94:0/1427898360 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1246517097 0 0) 0x7fa1e80c5d70 con 0x7fa1e8074100 2024-04-25T12:25:46.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.486+0000 7fa1ecd4d640 1 -- 172.21.15.94:0/1427898360 >> v1:172.21.15.94:6789/0 conn(0x7fa1e8074100 legacy=0x7fa1e80c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:46.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.486+0000 7fa1ecd4d640 1 -- 172.21.15.94:0/1427898360 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e80c6610 con 0x7fa1e814ffa0 2024-04-25T12:25:46.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.490+0000 7fa1ecd4d640 1 --2- 172.21.15.94:0/1427898360 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1e814ffa0 0x7fa1e80c8220 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80097c0 tx=0x7fa1d801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd5a345c8508110 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:46.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.490+0000 7fa1dffff640 1 -- 172.21.15.94:0/1427898360 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d80aa620 con 0x7fa1e814ffa0 2024-04-25T12:25:46.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.490+0000 7fa1dffff640 1 -- 172.21.15.94:0/1427898360 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa1d80af070 con 0x7fa1e814ffa0 2024-04-25T12:25:46.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.490+0000 7fa1dffff640 1 -- 172.21.15.94:0/1427898360 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d80aaa00 con 0x7fa1e814ffa0 2024-04-25T12:25:46.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.490+0000 7fa1ef7b2640 1 -- 172.21.15.94:0/1427898360 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1e814ffa0 msgr2=0x7fa1e80c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:46.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.490+0000 7fa1ef7b2640 1 --2- 172.21.15.94:0/1427898360 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1e814ffa0 0x7fa1e80c8220 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80097c0 tx=0x7fa1d801c4a0 comp rx=0 tx=0).stop 2024-04-25T12:25:46.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.490+0000 7fa1ef7b2640 1 -- 172.21.15.94:0/1427898360 shutdown_connections 2024-04-25T12:25:46.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.490+0000 7fa1ef7b2640 1 --2- 172.21.15.94:0/1427898360 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1e814ffa0 0x7fa1e80c8220 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:46.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.490+0000 7fa1ef7b2640 1 --2- 172.21.15.94:0/1427898360 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa1e814fbc0 0x7fa1e806f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:46.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.490+0000 7fa1ef7b2640 1 -- 172.21.15.94:0/1427898360 >> 172.21.15.94:0/1427898360 conn(0x7fa1e806b9d0 msgr2=0x7fa1e806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:46.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.490+0000 7fa1ef7b2640 1 -- 172.21.15.94:0/1427898360 shutdown_connections 2024-04-25T12:25:46.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.490+0000 7fa1ef7b2640 1 -- 172.21.15.94:0/1427898360 wait complete. 2024-04-25T12:25:46.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.490+0000 7fa1ef7b2640 1 Processor -- start 2024-04-25T12:25:46.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.490+0000 7fa1ef7b2640 1 -- start start 2024-04-25T12:25:46.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ef7b2640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa1e8074100 0x7fa1e815ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:46.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ef7b2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1e814fbc0 0x7fa1e80cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:46.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ef7b2640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1e814ffa0 0x7fa1e81421b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:46.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ef7b2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e8166420 con 0x7fa1e814fbc0 2024-04-25T12:25:46.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ef7b2640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e81662a0 con 0x7fa1e814ffa0 2024-04-25T12:25:46.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ef7b2640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e81665a0 con 0x7fa1e8074100 2024-04-25T12:25:46.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ecd4d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1e814fbc0 0x7fa1e80cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:46.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ecd4d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1e814fbc0 0x7fa1e80cb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:49766/0 (socket says 172.21.15.94:49766) 2024-04-25T12:25:46.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ecd4d640 1 -- 172.21.15.94:0/785900962 learned_addr learned my addr 172.21.15.94:0/785900962 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:46.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ed54e640 1 --2- 172.21.15.94:0/785900962 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa1e8074100 0x7fa1e815ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:46.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1edd4f640 1 --2- 172.21.15.94:0/785900962 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1e814ffa0 0x7fa1e81421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:46.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ecd4d640 1 -- 172.21.15.94:0/785900962 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa1e8074100 msgr2=0x7fa1e815ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:46.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ecd4d640 1 --2- 172.21.15.94:0/785900962 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa1e8074100 0x7fa1e815ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:46.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ecd4d640 1 -- 172.21.15.94:0/785900962 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1e814ffa0 msgr2=0x7fa1e81421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:46.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ecd4d640 1 --2- 172.21.15.94:0/785900962 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1e814ffa0 0x7fa1e81421b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:46.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ecd4d640 1 -- 172.21.15.94:0/785900962 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e81631f0 con 0x7fa1e814fbc0 2024-04-25T12:25:46.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1edd4f640 1 --2- 172.21.15.94:0/785900962 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1e814ffa0 0x7fa1e81421b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:25:46.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ecd4d640 1 --2- 172.21.15.94:0/785900962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1e814fbc0 0x7fa1e80cb690 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80ac040 tx=0x7fa1d801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:46.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ddffb640 1 -- 172.21.15.94:0/785900962 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d80aadb0 con 0x7fa1e814fbc0 2024-04-25T12:25:46.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ddffb640 1 -- 172.21.15.94:0/785900962 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa1d80be410 con 0x7fa1e814fbc0 2024-04-25T12:25:46.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ef7b2640 1 -- 172.21.15.94:0/785900962 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1e81634d0 con 0x7fa1e814fbc0 2024-04-25T12:25:46.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ddffb640 1 -- 172.21.15.94:0/785900962 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d80be820 con 0x7fa1e814fbc0 2024-04-25T12:25:46.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ef7b2640 1 -- 172.21.15.94:0/785900962 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1e815a5e0 con 0x7fa1e814fbc0 2024-04-25T12:25:46.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ef7b2640 1 -- 172.21.15.94:0/785900962 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1e8075df0 con 0x7fa1e814fbc0 2024-04-25T12:25:46.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ddffb640 1 -- 172.21.15.94:0/785900962 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa1d80bc020 con 0x7fa1e814fbc0 2024-04-25T12:25:46.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ddffb640 1 --2- 172.21.15.94:0/785900962 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa1cc0683b0 0x7fa1cc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:46.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ddffb640 1 -- 172.21.15.94:0/785900962 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 7144+0+0 (secure 0 0 0) 0x7fa1d8121220 con 0x7fa1e814fbc0 2024-04-25T12:25:46.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ed54e640 1 --2- 172.21.15.94:0/785900962 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa1cc0683b0 0x7fa1cc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:46.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.494+0000 7fa1ed54e640 1 --2- 172.21.15.94:0/785900962 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa1cc0683b0 0x7fa1cc06a870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4009790 tx=0x7fa1e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:46.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.498+0000 7fa1ddffb640 1 -- 172.21.15.94:0/785900962 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa1d8016090 con 0x7fa1e814fbc0 2024-04-25T12:25:46.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:46.686+0000 7fa1ef7b2640 1 -- 172.21.15.94:0/785900962 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa1e8072b60 con 0x7fa1e814fbc0 2024-04-25T12:25:47.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.354+0000 7fa1ddffb640 1 -- 172.21.15.94:0/785900962 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7fa1d80f1350 con 0x7fa1e814fbc0 2024-04-25T12:25:47.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.358+0000 7fa1ef7b2640 1 -- 172.21.15.94:0/785900962 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa1cc0683b0 msgr2=0x7fa1cc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:47.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.358+0000 7fa1ef7b2640 1 --2- 172.21.15.94:0/785900962 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa1cc0683b0 0x7fa1cc06a870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4009790 tx=0x7fa1e4008040 comp rx=0 tx=0).stop 2024-04-25T12:25:47.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.358+0000 7fa1ef7b2640 1 -- 172.21.15.94:0/785900962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1e814fbc0 msgr2=0x7fa1e80cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:47.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.358+0000 7fa1ef7b2640 1 --2- 172.21.15.94:0/785900962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1e814fbc0 0x7fa1e80cb690 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80ac040 tx=0x7fa1d801ace0 comp rx=0 tx=0).stop 2024-04-25T12:25:47.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.358+0000 7fa1ef7b2640 1 -- 172.21.15.94:0/785900962 shutdown_connections 2024-04-25T12:25:47.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.358+0000 7fa1ef7b2640 1 --2- 172.21.15.94:0/785900962 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fa1cc0683b0 0x7fa1cc06a870 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:47.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.358+0000 7fa1ef7b2640 1 --2- 172.21.15.94:0/785900962 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1e814ffa0 0x7fa1e81421b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:47.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.358+0000 7fa1ef7b2640 1 --2- 172.21.15.94:0/785900962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1e814fbc0 0x7fa1e80cb690 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:47.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.358+0000 7fa1ef7b2640 1 --2- 172.21.15.94:0/785900962 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa1e8074100 0x7fa1e815ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:47.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.358+0000 7fa1ef7b2640 1 -- 172.21.15.94:0/785900962 >> 172.21.15.94:0/785900962 conn(0x7fa1e806b9d0 msgr2=0x7fa1e814e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:47.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.358+0000 7fa1ef7b2640 1 -- 172.21.15.94:0/785900962 shutdown_connections 2024-04-25T12:25:47.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.358+0000 7fa1ef7b2640 1 -- 172.21.15.94:0/785900962 wait complete. 2024-04-25T12:25:47.386 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T12:25:47.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.554+0000 7fc595e02640 1 Processor -- start 2024-04-25T12:25:47.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.554+0000 7fc595e02640 1 -- start start 2024-04-25T12:25:47.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.558+0000 7fc595e02640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc590155350 0x7fc5900cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:47.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.558+0000 7fc595e02640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc5900cceb0 0x7fc59006d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:47.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.558+0000 7fc595e02640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc590155730 con 0x7fc5900cc950 2024-04-25T12:25:47.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.558+0000 7fc595e02640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc59015e670 con 0x7fc590155350 2024-04-25T12:25:47.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.558+0000 7fc595e02640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fc59015e950 con 0x7fc5900cceb0 2024-04-25T12:25:47.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.558+0000 7fc58f7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc590155350 0x7fc5900cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:47.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.558+0000 7fc58f7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc590155350 0x7fc5900cc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:49782/0 (socket says 172.21.15.94:49782) 2024-04-25T12:25:47.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.558+0000 7fc58f7fe640 1 -- 172.21.15.94:0/2680148799 learned_addr learned my addr 172.21.15.94:0/2680148799 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:47.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.558+0000 7fc58ffff640 1 --2- 172.21.15.94:0/2680148799 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc5900cceb0 0x7fc59006d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:47.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.558+0000 7fc58f7fe640 1 -- 172.21.15.94:0/2680148799 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc5900cceb0 msgr2=0x7fc59006d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:47.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.558+0000 7fc58f7fe640 1 --2- 172.21.15.94:0/2680148799 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc5900cceb0 0x7fc59006d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:47.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.558+0000 7fc58f7fe640 1 -- 172.21.15.94:0/2680148799 >> v1:172.21.15.111:6789/0 conn(0x7fc5900cc950 legacy=0x7fc5900cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:47.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.558+0000 7fc58f7fe640 1 -- 172.21.15.94:0/2680148799 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc59015ec30 con 0x7fc590155350 2024-04-25T12:25:47.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.562+0000 7fc58f7fe640 1 --2- 172.21.15.94:0/2680148799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc590155350 0x7fc5900cc370 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc580009870 tx=0x7fc58001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2cb361c4bad522 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:47.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.562+0000 7fc58e7fc640 1 -- 172.21.15.94:0/2680148799 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5800a7070 con 0x7fc590155350 2024-04-25T12:25:47.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.562+0000 7fc58e7fc640 1 -- 172.21.15.94:0/2680148799 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc5800b0070 con 0x7fc590155350 2024-04-25T12:25:47.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.562+0000 7fc58e7fc640 1 -- 172.21.15.94:0/2680148799 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5800ab8b0 con 0x7fc590155350 2024-04-25T12:25:47.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.562+0000 7fc595e02640 1 -- 172.21.15.94:0/2680148799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc590155350 msgr2=0x7fc5900cc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:47.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.562+0000 7fc595e02640 1 --2- 172.21.15.94:0/2680148799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc590155350 0x7fc5900cc370 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc580009870 tx=0x7fc58001c560 comp rx=0 tx=0).stop 2024-04-25T12:25:47.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.562+0000 7fc595e02640 1 -- 172.21.15.94:0/2680148799 shutdown_connections 2024-04-25T12:25:47.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.562+0000 7fc595e02640 1 --2- 172.21.15.94:0/2680148799 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc5900cceb0 0x7fc59006d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:47.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.562+0000 7fc595e02640 1 --2- 172.21.15.94:0/2680148799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc590155350 0x7fc5900cc370 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:47.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.562+0000 7fc595e02640 1 -- 172.21.15.94:0/2680148799 >> 172.21.15.94:0/2680148799 conn(0x7fc59006bf00 msgr2=0x7fc590073100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:47.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.562+0000 7fc595e02640 1 -- 172.21.15.94:0/2680148799 shutdown_connections 2024-04-25T12:25:47.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.562+0000 7fc595e02640 1 -- 172.21.15.94:0/2680148799 wait complete. 2024-04-25T12:25:47.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.562+0000 7fc595e02640 1 Processor -- start 2024-04-25T12:25:47.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.562+0000 7fc595e02640 1 -- start start 2024-04-25T12:25:47.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.562+0000 7fc595e02640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5900cc950 0x7fc5900c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:47.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.562+0000 7fc595e02640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc5900cceb0 0x7fc590148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:47.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.562+0000 7fc595e02640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc590155350 0x7fc5901461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:47.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.562+0000 7fc595e02640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc5900cbe30 con 0x7fc5900cc950 2024-04-25T12:25:47.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.562+0000 7fc595e02640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc5900cbcb0 con 0x7fc590155350 2024-04-25T12:25:47.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.562+0000 7fc595e02640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fc590168180 con 0x7fc5900cceb0 2024-04-25T12:25:47.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.566+0000 7fc58f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5900cc950 0x7fc5900c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:47.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.566+0000 7fc58f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5900cc950 0x7fc5900c7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:49794/0 (socket says 172.21.15.94:49794) 2024-04-25T12:25:47.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.566+0000 7fc58f7fe640 1 -- 172.21.15.94:0/3242247394 learned_addr learned my addr 172.21.15.94:0/3242247394 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:47.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.566+0000 7fc58effd640 1 --2- 172.21.15.94:0/3242247394 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc5900cceb0 0x7fc590148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:47.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.566+0000 7fc58ffff640 1 --2- 172.21.15.94:0/3242247394 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc590155350 0x7fc5901461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:47.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.566+0000 7fc58f7fe640 1 -- 172.21.15.94:0/3242247394 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc5900cceb0 msgr2=0x7fc590148e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:47.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.566+0000 7fc58f7fe640 1 --2- 172.21.15.94:0/3242247394 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc5900cceb0 0x7fc590148e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:47.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.566+0000 7fc58f7fe640 1 -- 172.21.15.94:0/3242247394 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc590155350 msgr2=0x7fc5901461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:47.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.566+0000 7fc58f7fe640 1 --2- 172.21.15.94:0/3242247394 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc590155350 0x7fc5901461d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:47.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.566+0000 7fc58f7fe640 1 -- 172.21.15.94:0/3242247394 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5901493a0 con 0x7fc5900cc950 2024-04-25T12:25:47.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.566+0000 7fc58f7fe640 1 --2- 172.21.15.94:0/3242247394 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5900cc950 0x7fc5900c7f20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc58001a190 tx=0x7fc58001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:47.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.566+0000 7fc577fff640 1 -- 172.21.15.94:0/3242247394 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5800b4800 con 0x7fc5900cc950 2024-04-25T12:25:47.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.566+0000 7fc577fff640 1 -- 172.21.15.94:0/3242247394 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc5800b49c0 con 0x7fc5900cc950 2024-04-25T12:25:47.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.566+0000 7fc595e02640 1 -- 172.21.15.94:0/3242247394 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc590147550 con 0x7fc5900cc950 2024-04-25T12:25:47.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.566+0000 7fc577fff640 1 -- 172.21.15.94:0/3242247394 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5800b4dd0 con 0x7fc5900cc950 2024-04-25T12:25:47.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.566+0000 7fc595e02640 1 -- 172.21.15.94:0/3242247394 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5900ca970 con 0x7fc5900cc950 2024-04-25T12:25:47.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.566+0000 7fc595e02640 1 -- 172.21.15.94:0/3242247394 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc590069180 con 0x7fc5900cc950 2024-04-25T12:25:47.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.566+0000 7fc577fff640 1 -- 172.21.15.94:0/3242247394 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc5800b3380 con 0x7fc5900cc950 2024-04-25T12:25:47.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.566+0000 7fc577fff640 1 --2- 172.21.15.94:0/3242247394 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc57c068380 0x7fc57c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:47.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.566+0000 7fc577fff640 1 -- 172.21.15.94:0/3242247394 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 7144+0+0 (secure 0 0 0) 0x7fc580121210 con 0x7fc5900cc950 2024-04-25T12:25:47.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.566+0000 7fc58effd640 1 --2- 172.21.15.94:0/3242247394 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc57c068380 0x7fc57c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:47.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.566+0000 7fc58effd640 1 --2- 172.21.15.94:0/3242247394 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc57c068380 0x7fc57c06a840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc590147170 tx=0x7fc584009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:47.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.570+0000 7fc577fff640 1 -- 172.21.15.94:0/3242247394 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc590069180 con 0x7fc5900cc950 2024-04-25T12:25:47.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:47.734+0000 7fc595e02640 1 -- 172.21.15.94:0/3242247394 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc590075e60 con 0x7fc5900cc950 2024-04-25T12:25:48.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.362+0000 7fc577fff640 1 -- 172.21.15.94:0/3242247394 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) ==== 181+0+0 (secure 0 0 0) 0x7fc580016150 con 0x7fc5900cc950 2024-04-25T12:25:48.369 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_metadata' removed 2024-04-25T12:25:48.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.366+0000 7fc595e02640 1 -- 172.21.15.94:0/3242247394 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc57c068380 msgr2=0x7fc57c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:48.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.366+0000 7fc595e02640 1 --2- 172.21.15.94:0/3242247394 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc57c068380 0x7fc57c06a840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc590147170 tx=0x7fc584009040 comp rx=0 tx=0).stop 2024-04-25T12:25:48.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.366+0000 7fc595e02640 1 -- 172.21.15.94:0/3242247394 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5900cc950 msgr2=0x7fc5900c7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:48.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.366+0000 7fc595e02640 1 --2- 172.21.15.94:0/3242247394 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5900cc950 0x7fc5900c7f20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc58001a190 tx=0x7fc58001ada0 comp rx=0 tx=0).stop 2024-04-25T12:25:48.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.370+0000 7fc595e02640 1 -- 172.21.15.94:0/3242247394 shutdown_connections 2024-04-25T12:25:48.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.370+0000 7fc595e02640 1 --2- 172.21.15.94:0/3242247394 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7fc57c068380 0x7fc57c06a840 secure :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc590147170 tx=0x7fc584009040 comp rx=0 tx=0).stop 2024-04-25T12:25:48.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.370+0000 7fc595e02640 1 --2- 172.21.15.94:0/3242247394 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc5900cceb0 0x7fc590148e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:48.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.370+0000 7fc595e02640 1 --2- 172.21.15.94:0/3242247394 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc590155350 0x7fc5901461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:48.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.370+0000 7fc595e02640 1 --2- 172.21.15.94:0/3242247394 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5900cc950 0x7fc5900c7f20 secure :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc58001a190 tx=0x7fc58001ada0 comp rx=0 tx=0).stop 2024-04-25T12:25:48.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.370+0000 7fc595e02640 1 -- 172.21.15.94:0/3242247394 >> 172.21.15.94:0/3242247394 conn(0x7fc59006bf00 msgr2=0x7fc5900b5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:48.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.370+0000 7fc595e02640 1 -- 172.21.15.94:0/3242247394 shutdown_connections 2024-04-25T12:25:48.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.370+0000 7fc595e02640 1 -- 172.21.15.94:0/3242247394 wait complete. 2024-04-25T12:25:48.395 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T12:25:48.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.518+0000 7f3b61a8c640 1 Processor -- start 2024-04-25T12:25:48.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.518+0000 7f3b61a8c640 1 -- start start 2024-04-25T12:25:48.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.518+0000 7f3b61a8c640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f3b5c0c5fa0 0x7f3b5c15ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:48.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.518+0000 7f3b61a8c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3b5c15d340 0x7f3b5c152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:48.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.518+0000 7f3b61a8c640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b5c06ce60 con 0x7f3b5c0c6380 2024-04-25T12:25:48.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.518+0000 7f3b61a8c640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f3b5c0c8890 con 0x7f3b5c15d340 2024-04-25T12:25:48.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.518+0000 7f3b61a8c640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f3b5c15c970 con 0x7f3b5c0c5fa0 2024-04-25T12:25:48.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.518+0000 7f3b5affd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3b5c15d340 0x7f3b5c152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:48.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.518+0000 7f3b5bfff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f3b5c0c6380 0x7f3b5c06b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60626/0 (socket says 172.21.15.94:60626) 2024-04-25T12:25:48.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.518+0000 7f3b5bfff640 1 -- 172.21.15.94:0/975177432 learned_addr learned my addr 172.21.15.94:0/975177432 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-04-25T12:25:48.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.518+0000 7f3b5b7fe640 1 --2- 172.21.15.94:0/975177432 >> v2:172.21.15.111:3300/0 conn(0x7f3b5c0c5fa0 0x7f3b5c15ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:48.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.518+0000 7f3b5affd640 1 -- 172.21.15.94:0/975177432 >> v2:172.21.15.111:3300/0 conn(0x7f3b5c0c5fa0 msgr2=0x7f3b5c15ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:48.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.518+0000 7f3b5affd640 1 --2- 172.21.15.94:0/975177432 >> v2:172.21.15.111:3300/0 conn(0x7f3b5c0c5fa0 0x7f3b5c15ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:48.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.518+0000 7f3b5a7fc640 1 -- 172.21.15.94:0/975177432 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 402745656 0 0) 0x7f3b5c06ce60 con 0x7f3b5c0c6380 2024-04-25T12:25:48.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.518+0000 7f3b5affd640 1 -- 172.21.15.94:0/975177432 >> v1:172.21.15.94:6789/0 conn(0x7f3b5c0c6380 legacy=0x7f3b5c06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:48.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.518+0000 7f3b5affd640 1 -- 172.21.15.94:0/975177432 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5c0c8ae0 con 0x7f3b5c15d340 2024-04-25T12:25:48.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b5affd640 1 --2- 172.21.15.94:0/975177432 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b5c15d340 0x7f3b5c152cf0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c0c9d70 tx=0x7f3b4c01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb1538d070715c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:48.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b5a7fc640 1 -- 172.21.15.94:0/975177432 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0b0070 con 0x7f3b5c15d340 2024-04-25T12:25:48.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b5a7fc640 1 -- 172.21.15.94:0/975177432 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3b4c0ab600 con 0x7f3b5c15d340 2024-04-25T12:25:48.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b5a7fc640 1 -- 172.21.15.94:0/975177432 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0ab9f0 con 0x7f3b5c15d340 2024-04-25T12:25:48.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b61a8c640 1 -- 172.21.15.94:0/975177432 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b5c15d340 msgr2=0x7f3b5c152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:48.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b61a8c640 1 --2- 172.21.15.94:0/975177432 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b5c15d340 0x7f3b5c152cf0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c0c9d70 tx=0x7f3b4c01c330 comp rx=0 tx=0).stop 2024-04-25T12:25:48.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b61a8c640 1 -- 172.21.15.94:0/975177432 shutdown_connections 2024-04-25T12:25:48.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b61a8c640 1 --2- 172.21.15.94:0/975177432 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b5c15d340 0x7f3b5c152cf0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:48.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b61a8c640 1 --2- 172.21.15.94:0/975177432 >> v2:172.21.15.111:3300/0 conn(0x7f3b5c0c5fa0 0x7f3b5c15ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:48.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b61a8c640 1 -- 172.21.15.94:0/975177432 >> 172.21.15.94:0/975177432 conn(0x7f3b5c0c9130 msgr2=0x7f3b5c0c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:48.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b61a8c640 1 -- 172.21.15.94:0/975177432 shutdown_connections 2024-04-25T12:25:48.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b61a8c640 1 -- 172.21.15.94:0/975177432 wait complete. 2024-04-25T12:25:48.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b61a8c640 1 Processor -- start 2024-04-25T12:25:48.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b61a8c640 1 -- start start 2024-04-25T12:25:48.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b61a8c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b5c0c5fa0 0x7f3b5c073c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:48.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b61a8c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b5c0c6380 0x7f3b5c074160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:48.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b61a8c640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3b5c15d340 0x7f3b5c0c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:48.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b61a8c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c06cc10 con 0x7f3b5c0c6380 2024-04-25T12:25:48.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b61a8c640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c06ca90 con 0x7f3b5c0c5fa0 2024-04-25T12:25:48.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b61a8c640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f3b5c0c6fa0 con 0x7f3b5c15d340 2024-04-25T12:25:48.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b5affd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b5c0c6380 0x7f3b5c074160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:48.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b5affd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b5c0c6380 0x7f3b5c074160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:49820/0 (socket says 172.21.15.94:49820) 2024-04-25T12:25:48.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b5affd640 1 -- 172.21.15.94:0/3037503639 learned_addr learned my addr 172.21.15.94:0/3037503639 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:48.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b5b7fe640 1 --2- 172.21.15.94:0/3037503639 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b5c0c5fa0 0x7f3b5c073c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:48.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b5bfff640 1 --2- 172.21.15.94:0/3037503639 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3b5c15d340 0x7f3b5c0c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:48.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b5affd640 1 -- 172.21.15.94:0/3037503639 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3b5c15d340 msgr2=0x7f3b5c0c3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:48.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b5affd640 1 --2- 172.21.15.94:0/3037503639 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3b5c15d340 0x7f3b5c0c3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:48.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b5affd640 1 -- 172.21.15.94:0/3037503639 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b5c0c5fa0 msgr2=0x7f3b5c073c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:48.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b5affd640 1 --2- 172.21.15.94:0/3037503639 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b5c0c5fa0 0x7f3b5c073c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:48.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b5affd640 1 -- 172.21.15.94:0/3037503639 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5c1f7400 con 0x7f3b5c0c6380 2024-04-25T12:25:48.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b5b7fe640 1 --2- 172.21.15.94:0/3037503639 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b5c0c5fa0 0x7f3b5c073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:25:48.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b5bfff640 1 --2- 172.21.15.94:0/3037503639 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3b5c15d340 0x7f3b5c0c3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:25:48.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b5affd640 1 --2- 172.21.15.94:0/3037503639 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b5c0c6380 0x7f3b5c074160 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c019f60 tx=0x7f3b4c0190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:48.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b43fff640 1 -- 172.21.15.94:0/3037503639 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0ba070 con 0x7f3b5c0c6380 2024-04-25T12:25:48.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b43fff640 1 -- 172.21.15.94:0/3037503639 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3b4c0b5680 con 0x7f3b5c0c6380 2024-04-25T12:25:48.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b61a8c640 1 -- 172.21.15.94:0/3037503639 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b5c1f76e0 con 0x7f3b5c0c6380 2024-04-25T12:25:48.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b43fff640 1 -- 172.21.15.94:0/3037503639 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0b0040 con 0x7f3b5c0c6380 2024-04-25T12:25:48.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.522+0000 7f3b61a8c640 1 -- 172.21.15.94:0/3037503639 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b5c1f7ca0 con 0x7f3b5c0c6380 2024-04-25T12:25:48.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.526+0000 7f3b61a8c640 1 -- 172.21.15.94:0/3037503639 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b5c075e60 con 0x7f3b5c0c6380 2024-04-25T12:25:48.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.526+0000 7f3b43fff640 1 -- 172.21.15.94:0/3037503639 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3b4c0bd070 con 0x7f3b5c0c6380 2024-04-25T12:25:48.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.526+0000 7f3b43fff640 1 --2- 172.21.15.94:0/3037503639 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f3b480683b0 0x7f3b4806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:48.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.526+0000 7f3b43fff640 1 -- 172.21.15.94:0/3037503639 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6706+0+0 (secure 0 0 0) 0x7f3b4c121540 con 0x7f3b5c0c6380 2024-04-25T12:25:48.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.526+0000 7f3b5b7fe640 1 --2- 172.21.15.94:0/3037503639 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f3b480683b0 0x7f3b4806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:48.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.526+0000 7f3b5b7fe640 1 --2- 172.21.15.94:0/3037503639 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f3b480683b0 0x7f3b4806a870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3b50006fd0 tx=0x7f3b50008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:48.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.530+0000 7f3b43fff640 1 -- 172.21.15.94:0/3037503639 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3b4c016070 con 0x7f3b5c0c6380 2024-04-25T12:25:48.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:48.694+0000 7f3b61a8c640 1 -- 172.21.15.94:0/3037503639 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3b5c14fee0 con 0x7f3b5c0c6380 2024-04-25T12:25:49.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.366+0000 7f3b43fff640 1 -- 172.21.15.94:0/3037503639 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) ==== 169+0+0 (secure 0 0 0) 0x7f3b4c0f1680 con 0x7f3b5c0c6380 2024-04-25T12:25:49.372 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data' removed 2024-04-25T12:25:49.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.370+0000 7f3b61a8c640 1 -- 172.21.15.94:0/3037503639 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f3b480683b0 msgr2=0x7f3b4806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:49.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.370+0000 7f3b61a8c640 1 --2- 172.21.15.94:0/3037503639 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f3b480683b0 0x7f3b4806a870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3b50006fd0 tx=0x7f3b50008040 comp rx=0 tx=0).stop 2024-04-25T12:25:49.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.370+0000 7f3b61a8c640 1 -- 172.21.15.94:0/3037503639 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b5c0c6380 msgr2=0x7f3b5c074160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:49.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.370+0000 7f3b61a8c640 1 --2- 172.21.15.94:0/3037503639 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b5c0c6380 0x7f3b5c074160 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c019f60 tx=0x7f3b4c0190d0 comp rx=0 tx=0).stop 2024-04-25T12:25:49.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.370+0000 7f3b61a8c640 1 -- 172.21.15.94:0/3037503639 shutdown_connections 2024-04-25T12:25:49.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.370+0000 7f3b61a8c640 1 --2- 172.21.15.94:0/3037503639 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f3b480683b0 0x7f3b4806a870 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:49.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.370+0000 7f3b61a8c640 1 --2- 172.21.15.94:0/3037503639 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3b5c15d340 0x7f3b5c0c3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:49.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.370+0000 7f3b61a8c640 1 --2- 172.21.15.94:0/3037503639 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b5c0c6380 0x7f3b5c074160 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:49.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.370+0000 7f3b61a8c640 1 --2- 172.21.15.94:0/3037503639 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b5c0c5fa0 0x7f3b5c073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:49.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.370+0000 7f3b61a8c640 1 -- 172.21.15.94:0/3037503639 >> 172.21.15.94:0/3037503639 conn(0x7f3b5c0c9130 msgr2=0x7f3b5c0cb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:49.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.374+0000 7f3b61a8c640 1 -- 172.21.15.94:0/3037503639 shutdown_connections 2024-04-25T12:25:49.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.374+0000 7f3b61a8c640 1 -- 172.21.15.94:0/3037503639 wait complete. 2024-04-25T12:25:49.401 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-25T12:25:49.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.522+0000 7f9468772640 1 Processor -- start 2024-04-25T12:25:49.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.522+0000 7f9468772640 1 -- start start 2024-04-25T12:25:49.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.522+0000 7f9468772640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9460073e00 0x7f94600676a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:49.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.522+0000 7f9468772640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f94600741e0 0x7f946006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:49.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.522+0000 7f9468772640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f94600c8910 0x7f9460159110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:49.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.522+0000 7f9468772640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 -- 0x7f9460067cc0 con 0x7f94600c8910 2024-04-25T12:25:49.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.522+0000 7f9468772640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f94600c7fe0 con 0x7f94600741e0 2024-04-25T12:25:49.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.522+0000 7f9468772640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f94600c82c0 con 0x7f9460073e00 2024-04-25T12:25:49.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.522+0000 7f9466d0f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f94600c8910 0x7f9460159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:49.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.522+0000 7f9466d0f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f94600c8910 0x7f9460159110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:49826/0 (socket says 172.21.15.94:49826) 2024-04-25T12:25:49.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.522+0000 7f9466d0f640 1 -- 172.21.15.94:0/3549769667 learned_addr learned my addr 172.21.15.94:0/3549769667 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:49.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.522+0000 7f946650e640 1 --2- 172.21.15.94:0/3549769667 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9460073e00 0x7f94600676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:49.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.522+0000 7f9465d0d640 1 --2- 172.21.15.94:0/3549769667 >> v2:172.21.15.111:3300/0 conn(0x7f94600741e0 0x7f946006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:49.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.522+0000 7f9466d0f640 1 -- 172.21.15.94:0/3549769667 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9460073e00 msgr2=0x7f94600676a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:49.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.522+0000 7f9466d0f640 1 --2- 172.21.15.94:0/3549769667 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9460073e00 0x7f94600676a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:49.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.522+0000 7f9466d0f640 1 -- 172.21.15.94:0/3549769667 >> v2:172.21.15.111:3300/0 conn(0x7f94600741e0 msgr2=0x7f946006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:25:49.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.522+0000 7f9466d0f640 1 --2- 172.21.15.94:0/3549769667 >> v2:172.21.15.111:3300/0 conn(0x7f94600741e0 0x7f946006ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:49.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.522+0000 7f9466d0f640 1 -- 172.21.15.94:0/3549769667 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94600c85a0 con 0x7f94600c8910 2024-04-25T12:25:49.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.522+0000 7f9465d0d640 1 --2- 172.21.15.94:0/3549769667 >> v2:172.21.15.111:3300/0 conn(0x7f94600741e0 0x7f946006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:25:49.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.526+0000 7f9466d0f640 1 --2- 172.21.15.94:0/3549769667 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94600c8910 0x7f9460159110 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9450009870 tx=0x7f945001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab0d609d4a670ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:49.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.526+0000 7f946550c640 1 -- 172.21.15.94:0/3549769667 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94500b5070 con 0x7f94600c8910 2024-04-25T12:25:49.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.526+0000 7f946550c640 1 -- 172.21.15.94:0/3549769667 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f94500a89d0 con 0x7f94600c8910 2024-04-25T12:25:49.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.526+0000 7f946550c640 1 -- 172.21.15.94:0/3549769667 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94500a8dc0 con 0x7f94600c8910 2024-04-25T12:25:49.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.526+0000 7f9468772640 1 -- 172.21.15.94:0/3549769667 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94600c8910 msgr2=0x7f9460159110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:49.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.526+0000 7f9468772640 1 --2- 172.21.15.94:0/3549769667 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94600c8910 0x7f9460159110 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9450009870 tx=0x7f945001ed10 comp rx=0 tx=0).stop 2024-04-25T12:25:49.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.526+0000 7f9468772640 1 -- 172.21.15.94:0/3549769667 shutdown_connections 2024-04-25T12:25:49.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.526+0000 7f9468772640 1 --2- 172.21.15.94:0/3549769667 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94600c8910 0x7f9460159110 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:49.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.526+0000 7f9468772640 1 --2- 172.21.15.94:0/3549769667 >> v2:172.21.15.111:3300/0 conn(0x7f94600741e0 0x7f946006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:49.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.526+0000 7f9468772640 1 --2- 172.21.15.94:0/3549769667 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9460073e00 0x7f94600676a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:49.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.526+0000 7f9468772640 1 -- 172.21.15.94:0/3549769667 >> 172.21.15.94:0/3549769667 conn(0x7f946006f430 msgr2=0x7f946006f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:49.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.526+0000 7f9468772640 1 -- 172.21.15.94:0/3549769667 shutdown_connections 2024-04-25T12:25:49.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.526+0000 7f9468772640 1 -- 172.21.15.94:0/3549769667 wait complete. 2024-04-25T12:25:49.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.526+0000 7f9468772640 1 Processor -- start 2024-04-25T12:25:49.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.526+0000 7f9468772640 1 -- start start 2024-04-25T12:25:49.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.526+0000 7f9468772640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9460073e00 0x7f9460152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:49.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.526+0000 7f9468772640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f94600741e0 0x7f946015cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:49.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.526+0000 7f9468772640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f94600c8910 0x7f94601f4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:49.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.530+0000 7f9468772640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9460159650 con 0x7f9460073e00 2024-04-25T12:25:49.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.530+0000 7f9468772640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f94600c9400 con 0x7f94600741e0 2024-04-25T12:25:49.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.530+0000 7f9468772640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f94601597d0 con 0x7f94600c8910 2024-04-25T12:25:49.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.530+0000 7f946650e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9460073e00 0x7f9460152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:49.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.530+0000 7f946650e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9460073e00 0x7f9460152190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:49840/0 (socket says 172.21.15.94:49840) 2024-04-25T12:25:49.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.530+0000 7f946650e640 1 -- 172.21.15.94:0/4094925396 learned_addr learned my addr 172.21.15.94:0/4094925396 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-04-25T12:25:49.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.530+0000 7f9465d0d640 1 --2- 172.21.15.94:0/4094925396 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f94600741e0 0x7f946015cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:49.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.530+0000 7f9466d0f640 1 --2- 172.21.15.94:0/4094925396 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f94600c8910 0x7f94601f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:49.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.530+0000 7f946650e640 1 -- 172.21.15.94:0/4094925396 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f94600c8910 msgr2=0x7f94601f4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:49.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.530+0000 7f946650e640 1 --2- 172.21.15.94:0/4094925396 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f94600c8910 0x7f94601f4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:49.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.530+0000 7f946650e640 1 -- 172.21.15.94:0/4094925396 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f94600741e0 msgr2=0x7f946015cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:49.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.530+0000 7f946650e640 1 --2- 172.21.15.94:0/4094925396 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f94600741e0 0x7f946015cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:49.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.530+0000 7f946650e640 1 -- 172.21.15.94:0/4094925396 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94600b17d0 con 0x7f9460073e00 2024-04-25T12:25:49.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.530+0000 7f9466d0f640 1 --2- 172.21.15.94:0/4094925396 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f94600c8910 0x7f94601f4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:25:49.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.530+0000 7f946650e640 1 --2- 172.21.15.94:0/4094925396 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9460073e00 0x7f9460152190 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9458007e60 tx=0x7f945800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:49.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.530+0000 7f945effd640 1 -- 172.21.15.94:0/4094925396 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9458014620 con 0x7f9460073e00 2024-04-25T12:25:49.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.530+0000 7f945effd640 1 -- 172.21.15.94:0/4094925396 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9458019070 con 0x7f9460073e00 2024-04-25T12:25:49.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.530+0000 7f9468772640 1 -- 172.21.15.94:0/4094925396 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94600b1ab0 con 0x7f9460073e00 2024-04-25T12:25:49.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.530+0000 7f945effd640 1 -- 172.21.15.94:0/4094925396 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9458014a20 con 0x7f9460073e00 2024-04-25T12:25:49.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.530+0000 7f9468772640 1 -- 172.21.15.94:0/4094925396 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94600b2070 con 0x7f9460073e00 2024-04-25T12:25:49.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.530+0000 7f9468772640 1 -- 172.21.15.94:0/4094925396 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9460075e60 con 0x7f9460073e00 2024-04-25T12:25:49.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.530+0000 7f945effd640 1 -- 172.21.15.94:0/4094925396 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9458014bc0 con 0x7f9460073e00 2024-04-25T12:25:49.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.530+0000 7f945effd640 1 --2- 172.21.15.94:0/4094925396 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f944c068380 0x7f944c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:25:49.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.530+0000 7f9465d0d640 1 --2- 172.21.15.94:0/4094925396 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f944c068380 0x7f944c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:25:49.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.530+0000 7f945effd640 1 -- 172.21.15.94:0/4094925396 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6197+0+0 (secure 0 0 0) 0x7f94580874f0 con 0x7f9460073e00 2024-04-25T12:25:49.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.530+0000 7f9465d0d640 1 --2- 172.21.15.94:0/4094925396 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f944c068380 0x7f944c06a840 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f94601559a0 tx=0x7f9454008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:25:49.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.534+0000 7f945effd640 1 -- 172.21.15.94:0/4094925396 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9458057830 con 0x7f9460073e00 2024-04-25T12:25:49.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:49.702+0000 7f9468772640 1 -- 172.21.15.94:0/4094925396 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f946006c9e0 con 0x7f9460073e00 2024-04-25T12:25:50.324 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:25:50.327 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:25:50.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:50.386+0000 7f945effd640 1 -- 172.21.15.94:0/4094925396 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) ==== 178+0+0 (secure 0 0 0) 0x7f9458057130 con 0x7f9460073e00 2024-04-25T12:25:50.393 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data_ec' removed 2024-04-25T12:25:50.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:50.390+0000 7f9468772640 1 -- 172.21.15.94:0/4094925396 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f944c068380 msgr2=0x7f944c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:50.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:50.390+0000 7f9468772640 1 --2- 172.21.15.94:0/4094925396 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f944c068380 0x7f944c06a840 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f94601559a0 tx=0x7f9454008040 comp rx=0 tx=0).stop 2024-04-25T12:25:50.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:50.390+0000 7f9468772640 1 -- 172.21.15.94:0/4094925396 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9460073e00 msgr2=0x7f9460152190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:25:50.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:50.390+0000 7f9468772640 1 --2- 172.21.15.94:0/4094925396 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9460073e00 0x7f9460152190 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9458007e60 tx=0x7f945800e4b0 comp rx=0 tx=0).stop 2024-04-25T12:25:50.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:50.394+0000 7f9468772640 1 -- 172.21.15.94:0/4094925396 shutdown_connections 2024-04-25T12:25:50.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:50.394+0000 7f9468772640 1 --2- 172.21.15.94:0/4094925396 >> [v2:172.21.15.94:6832/549402167,v1:172.21.15.94:6833/549402167] conn(0x7f944c068380 0x7f944c06a840 secure :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f94601559a0 tx=0x7f9454008040 comp rx=0 tx=0).stop 2024-04-25T12:25:50.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:50.394+0000 7f9468772640 1 --2- 172.21.15.94:0/4094925396 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f94600c8910 0x7f94601f4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:50.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:50.394+0000 7f9468772640 1 --2- 172.21.15.94:0/4094925396 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f94600741e0 0x7f946015cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:50.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:50.394+0000 7f9468772640 1 --2- 172.21.15.94:0/4094925396 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9460073e00 0x7f9460152190 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:25:50.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:50.394+0000 7f9468772640 1 -- 172.21.15.94:0/4094925396 >> 172.21.15.94:0/4094925396 conn(0x7f946006f430 msgr2=0x7f946006b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:25:50.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:50.394+0000 7f9468772640 1 -- 172.21.15.94:0/4094925396 shutdown_connections 2024-04-25T12:25:50.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-25T12:25:50.394+0000 7f9468772640 1 -- 172.21.15.94:0/4094925396 wait complete. 2024-04-25T12:25:50.419 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T12:25:50.419 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T12:25:50.419 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:25:50.473 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T12:25:50.473 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T12:25:50.473 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:25:50.533 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T12:25:50.533 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-25T12:25:50.533 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:25:50.594 INFO:tasks.ceph.mds.e:Stopped 2024-04-25T12:25:50.594 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T12:25:50.594 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:25:50.613 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T12:25:50.613 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T12:25:50.613 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:25:50.676 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T12:25:50.676 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-25T12:25:50.676 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:25:50.731 INFO:tasks.ceph.mds.f:Stopped 2024-04-25T12:25:50.731 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T12:25:50.731 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T12:25:50.732 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:25:50.821 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T12:25:50.821 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T12:25:50.821 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:25:50.919 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T12:25:50.919 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T12:25:50.919 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:25:51.004 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T12:25:51.004 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T12:25:51.004 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:25:51.085 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T12:25:51.085 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T12:25:51.085 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:25:51.186 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T12:25:51.186 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T12:25:51.186 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:25:51.284 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T12:25:51.284 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T12:25:51.284 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:25:51.361 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T12:25:51.362 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T12:25:51.362 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:25:51.437 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T12:25:51.437 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T12:25:51.438 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T12:25:51.438 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:25:51.467 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T12:25:51.467 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T12:25:51.467 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:25:51.495 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T12:25:51.495 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T12:25:51.496 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T12:25:51.496 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:25:51.524 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T12:25:51.525 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T12:25:51.525 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:25:51.555 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T12:25:51.555 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T12:25:51.555 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:25:51.618 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T12:25:51.618 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T12:25:51.619 DEBUG:teuthology.orchestra.run.smithi094:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-25T12:25:51.641 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi094.front.sepia.ceph.com 2024-04-25T12:25:51.641 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T12:25:52.186 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi094.front.sepia.ceph.com 2024-04-25T12:25:52.186 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T12:25:52.414 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi094.front.sepia.ceph.com 2024-04-25T12:25:52.415 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T12:25:52.614 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi094.front.sepia.ceph.com 2024-04-25T12:25:52.614 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T12:25:52.813 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-25T12:25:52.814 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T12:25:53.156 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-25T12:25:53.156 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T12:25:53.368 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-25T12:25:53.369 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T12:25:53.533 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-25T12:25:53.534 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T12:25:53.703 INFO:tasks.ceph:Archiving mon data... 2024-04-25T12:25:53.704 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673355/data/mon.a.tgz 2024-04-25T12:25:53.704 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2024-04-25T12:25:53.710 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.fPfSx3Dbi1 2024-04-25T12:25:53.710 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.fPfSx3Dbi1 2024-04-25T12:25:53.829 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.fPfSx3Dbi1 2024-04-25T12:25:53.890 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.fPfSx3Dbi1 is 315KB 2024-04-25T12:25:53.955 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.fPfSx3Dbi1 2024-04-25T12:25:53.960 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673355/data/mon.b.tgz 2024-04-25T12:25:53.960 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2024-04-25T12:25:53.967 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.bemXF0ZCgC 2024-04-25T12:25:53.967 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.bemXF0ZCgC 2024-04-25T12:25:54.119 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.bemXF0ZCgC 2024-04-25T12:25:54.183 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.bemXF0ZCgC is 422KB 2024-04-25T12:25:54.285 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.bemXF0ZCgC 2024-04-25T12:25:54.291 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673355/data/mon.c.tgz 2024-04-25T12:25:54.291 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2024-04-25T12:25:54.340 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.0bHc5pBxsc 2024-04-25T12:25:54.340 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.0bHc5pBxsc 2024-04-25T12:25:54.483 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.0bHc5pBxsc 2024-04-25T12:25:54.547 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.0bHc5pBxsc is 422KB 2024-04-25T12:25:54.609 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.0bHc5pBxsc 2024-04-25T12:25:54.614 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T12:25:54.615 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T12:25:54.617 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T12:25:54.678 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T12:25:54.720 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T12:25:54.720 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T12:25:54.722 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673355/remote/smithi094/crash 2024-04-25T12:25:54.722 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T12:25:54.735 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673355/remote/smithi111/crash 2024-04-25T12:25:54.736 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T12:25:54.775 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T12:25:54.776 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:25:54.787 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:25:54.865 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T12:25:54.876 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T12:25:54.888 INFO:tasks.ceph:Compressing logs... 2024-04-25T12:25:54.888 DEBUG:teuthology.orchestra.run.smithi094:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T12:25:54.919 DEBUG:teuthology.orchestra.run.smithi111:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T12:25:54.948 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35536.log 2024-04-25T12:25:54.949 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32008.log 2024-04-25T12:25:54.949 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35339.log 2024-04-25T12:25:54.949 INFO:teuthology.orchestra.run.smithi094.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35536.log.gz 2024-04-25T12:25:54.949 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35432.log 2024-04-25T12:25:54.952 INFO:teuthology.orchestra.run.smithi094.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32008.log.gz 2024-04-25T12:25:54.952 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T12:25:54.952 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35339.log: /var/log/ceph/ceph-client.admin.35432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32356.log 2024-04-25T12:25:54.952 INFO:teuthology.orchestra.run.smithi094.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35432.log.gz 2024-04-25T12:25:54.952 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33258.log 2024-04-25T12:25:54.953 INFO:teuthology.orchestra.run.smithi094.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35339.log.gz 2024-04-25T12:25:54.953 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34150.log 2024-04-25T12:25:54.953 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33258.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32356.log.gz 2024-04-25T12:25:54.953 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32090.log 2024-04-25T12:25:54.953 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33258.log.gz 2024-04-25T12:25:54.953 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34072.log 2024-04-25T12:25:54.953 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34150.log: /var/log/ceph/ceph-client.admin.32090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35208.log 2024-04-25T12:25:54.953 INFO:teuthology.orchestra.run.smithi094.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34150.log.gz 2024-04-25T12:25:54.954 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34072.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32090.log.gz 2024-04-25T12:25:54.954 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34397.log 2024-04-25T12:25:54.992 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27847.log 2024-04-25T12:25:54.993 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27679.log 2024-04-25T12:25:54.993 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27775.log 2024-04-25T12:25:54.993 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.27847.log: /var/log/ceph/ceph-client.admin.27679.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T12:25:54.993 INFO:teuthology.orchestra.run.smithi111.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27679.log.gz 2024-04-25T12:25:54.993 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.27775.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T12:25:54.993 INFO:teuthology.orchestra.run.smithi111.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27847.log.gz 2024-04-25T12:25:54.993 INFO:teuthology.orchestra.run.smithi111.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.27775.log.gz 2024-04-25T12:25:54.993 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T12:25:54.994 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27751.log 2024-04-25T12:25:54.994 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27799.log 2024-04-25T12:25:54.994 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.27751.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T12:25:54.994 INFO:teuthology.orchestra.run.smithi111.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.27751.log.gz 2024-04-25T12:25:54.994 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-25T12:25:54.994 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.27799.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T12:25:54.994 INFO:teuthology.orchestra.run.smithi111.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27799.log.gz 2024-04-25T12:25:54.994 INFO:teuthology.orchestra.run.smithi111.stderr:gzip/var/log/ceph/ceph-mds.f.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.27727.log 2024-04-25T12:25:54.995 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T12:25:54.995 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.27727.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T12:25:54.995 INFO:teuthology.orchestra.run.smithi111.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27727.log.gz 2024-04-25T12:25:54.995 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T12:25:54.995 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph.audit.log: 92.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T12:25:54.995 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T12:25:54.996 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-mds.d.log: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T12:25:54.996 INFO:teuthology.orchestra.run.smithi111.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T12:25:54.996 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T12:25:54.996 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T12:25:54.996 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27703.log 2024-04-25T12:25:54.996 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-osd.4.log: 90.8% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-25T12:25:54.996 INFO:teuthology.orchestra.run.smithi111.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T12:25:54.996 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27823.log 2024-04-25T12:25:54.997 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.27703.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27703.log.gz 2024-04-25T12:25:54.997 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.27823.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.27823.log.gz 2024-04-25T12:25:55.020 INFO:teuthology.orchestra.run.smithi111.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T12:25:55.043 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34072.log.gz 2024-04-25T12:25:55.044 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35208.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T12:25:55.044 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7%/var/log/ceph/ceph-client.admin.34397.log: -- replaced with /var/log/ceph/ceph-client.admin.35208.log.gz 2024-04-25T12:25:55.044 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34785.log 2024-04-25T12:25:55.044 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36151.log 2024-04-25T12:25:55.044 INFO:teuthology.orchestra.run.smithi094.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34397.log.gz 2024-04-25T12:25:55.044 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32064.log 2024-04-25T12:25:55.044 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36037.log 2024-04-25T12:25:55.044 INFO:teuthology.orchestra.run.smithi094.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.34785.log.gz 2024-04-25T12:25:55.044 INFO:teuthology.orchestra.run.smithi094.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36151.log.gz 2024-04-25T12:25:55.045 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34476.log 2024-04-25T12:25:55.045 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36037.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32064.log.gz 2024-04-25T12:25:55.045 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33461.log 2024-04-25T12:25:55.045 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36037.log.gz 2024-04-25T12:25:55.045 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34318.log 2024-04-25T12:25:55.045 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34476.log.gz 2024-04-25T12:25:55.045 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35484.log 2024-04-25T12:25:55.045 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33461.log: /var/log/ceph/ceph-client.admin.34318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35747.log 2024-04-25T12:25:55.046 INFO:teuthology.orchestra.run.smithi094.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33461.log.gz 2024-04-25T12:25:55.046 INFO:teuthology.orchestra.run.smithi094.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34318.log.gz 2024-04-25T12:25:55.046 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32912.log 2024-04-25T12:25:55.046 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34685.log 2024-04-25T12:25:55.046 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35484.log.gz 2024-04-25T12:25:55.046 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35747.log: /var/log/ceph/ceph-client.admin.32912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33884.log 2024-04-25T12:25:55.046 INFO:teuthology.orchestra.run.smithi094.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35747.log.gz 2024-04-25T12:25:55.046 INFO:teuthology.orchestra.run.smithi094.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32912.log.gz 2024-04-25T12:25:55.047 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36063.log 2024-04-25T12:25:55.047 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36089.log 2024-04-25T12:25:55.047 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36063.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.34685.log.gz 2024-04-25T12:25:55.047 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33884.log.gz 2024-04-25T12:25:55.047 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35458.log 2024-04-25T12:25:55.047 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36063.log.gz 2024-04-25T12:25:55.047 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33043.log 2024-04-25T12:25:55.047 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35458.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36089.log.gz 2024-04-25T12:25:55.047 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32224.log 2024-04-25T12:25:55.048 INFO:teuthology.orchestra.run.smithi094.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35458.log.gz 2024-04-25T12:25:55.048 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35825.log 2024-04-25T12:25:55.048 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32224.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33043.log.gz 2024-04-25T12:25:55.048 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34423.log 2024-04-25T12:25:55.048 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35825.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32224.log.gz 2024-04-25T12:25:55.048 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35182.log 2024-04-25T12:25:55.048 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34423.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35825.log.gz 2024-04-25T12:25:55.048 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32545.log 2024-04-25T12:25:55.048 INFO:teuthology.orchestra.run.smithi094.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34423.log.gz 2024-04-25T12:25:55.049 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33414.log 2024-04-25T12:25:55.049 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T12:25:55.049 INFO:teuthology.orchestra.run.smithi094.stderr: 88.0%/var/log/ceph/ceph-client.admin.32545.log: -- replaced with /var/log/ceph/ceph-client.admin.35182.log.gz 2024-04-25T12:25:55.049 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32278.log 2024-04-25T12:25:55.049 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33414.log.gz 2024-04-25T12:25:55.049 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36011.log 2024-04-25T12:25:55.049 INFO:teuthology.orchestra.run.smithi094.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.32545.log.gz 2024-04-25T12:25:55.049 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35156.log 2024-04-25T12:25:55.050 INFO:teuthology.orchestra.run.smithi094.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32278.log.gz 2024-04-25T12:25:55.050 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31862.log 2024-04-25T12:25:55.050 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35156.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36011.log.gz 2024-04-25T12:25:55.050 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32304.log 2024-04-25T12:25:55.050 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35156.log.gz 2024-04-25T12:25:55.051 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.31862.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T12:25:55.051 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35588.log 2024-04-25T12:25:55.051 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32304.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31862.log.gz 2024-04-25T12:25:55.051 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35692.log 2024-04-25T12:25:55.051 INFO:teuthology.orchestra.run.smithi094.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32304.log.gz 2024-04-25T12:25:55.051 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32782.log 2024-04-25T12:25:55.051 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35588.log.gz 2024-04-25T12:25:55.051 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35799.log 2024-04-25T12:25:55.052 INFO:teuthology.orchestra.run.smithi094.stderr:gzip/var/log/ceph/ceph-client.admin.32782.log: -5 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35692.log.gz 2024-04-25T12:25:55.052 INFO:teuthology.orchestra.run.smithi094.stderr: --verbose -- /var/log/ceph/ceph-client.admin.34098.log 2024-04-25T12:25:55.052 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35799.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32782.log.gz 2024-04-25T12:25:55.052 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35313.log 2024-04-25T12:25:55.052 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35799.log.gz 2024-04-25T12:25:55.052 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34502.log 2024-04-25T12:25:55.052 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35313.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34098.log.gz 2024-04-25T12:25:55.052 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33468.log 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35313.log.gz 2024-04-25T12:25:55.053 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-04-25T12:25:55.053 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33675.log 2024-04-25T12:25:55.053 INFO:teuthology.orchestra.run.smithi094.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34502.log.gz 2024-04-25T12:25:55.053 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32038.log 2024-04-25T12:25:55.053 INFO:teuthology.orchestra.run.smithi094.stderr:gzip/var/log/ceph/ceph-client.admin.33675.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33468.log.gz 2024-04-25T12:25:55.053 INFO:teuthology.orchestra.run.smithi094.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.33672.log 2024-04-25T12:25:55.053 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32038.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33675.log.gz 2024-04-25T12:25:55.053 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34896.log 2024-04-25T12:25:55.053 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32038.log.gz 2024-04-25T12:25:55.054 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33459.log 2024-04-25T12:25:55.054 INFO:teuthology.orchestra.run.smithi094.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33672.log.gz 2024-04-25T12:25:55.054 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36257.log 2024-04-25T12:25:55.054 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33362.log 2024-04-25T12:25:55.054 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34896.log.gz 2024-04-25T12:25:55.054 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35773.log 2024-04-25T12:25:55.054 INFO:teuthology.orchestra.run.smithi094.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33459.log.gz 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36257.log.gz 2024-04-25T12:25:55.055 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-04-25T12:25:55.055 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34371.log 2024-04-25T12:25:55.055 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35562.log 2024-04-25T12:25:55.055 INFO:teuthology.orchestra.run.smithi094.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33362.log.gz 2024-04-25T12:25:55.055 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34371.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35078.log 2024-04-25T12:25:55.055 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35773.log.gz 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34371.log.gz 2024-04-25T12:25:55.055 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-04-25T12:25:55.055 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34632.log 2024-04-25T12:25:55.055 INFO:teuthology.orchestra.run.smithi094.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35562.log.gz 2024-04-25T12:25:55.056 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35851.log 2024-04-25T12:25:55.056 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35666.log 89.1% 2024-04-25T12:25:55.056 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35078.log.gz 2024-04-25T12:25:55.056 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34632.log: /var/log/ceph/ceph-client.admin.35851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35365.log 2024-04-25T12:25:55.056 INFO:teuthology.orchestra.run.smithi094.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.34632.log.gz 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35851.log.gz 2024-04-25T12:25:55.056 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35666.log: 2024-04-25T12:25:55.056 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T12:25:55.056 INFO:teuthology.orchestra.run.smithi094.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35666.log.gz 2024-04-25T12:25:55.056 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34580.log 2024-04-25T12:25:55.057 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35365.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35406.log 2024-04-25T12:25:55.057 INFO:teuthology.orchestra.run.smithi094.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35365.log.gz 2024-04-25T12:25:55.057 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33665.log 2024-04-25T12:25:55.057 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34580.log.gz 2024-04-25T12:25:55.057 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33674.log 2024-04-25T12:25:55.057 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35406.log: /var/log/ceph/ceph-client.admin.33665.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33665.log.gz 2024-04-25T12:25:55.057 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35406.log.gz 2024-04-25T12:25:55.058 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35640.log 2024-04-25T12:25:55.058 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33864.log 2024-04-25T12:25:55.058 INFO:teuthology.orchestra.run.smithi094.stderr: 87.5%/var/log/ceph/ceph-client.admin.35640.log: -- replaced with /var/log/ceph/ceph-client.admin.33674.log.gz 2024-04-25T12:25:55.058 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32250.log 2024-04-25T12:25:55.058 INFO:teuthology.orchestra.run.smithi094.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35640.log.gz 2024-04-25T12:25:55.058 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33864.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33864.log.gz 2024-04-25T12:25:55.058 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33462.log 2024-04-25T12:25:55.058 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27563.log 2024-04-25T12:25:55.059 INFO:teuthology.orchestra.run.smithi094.stderr: 88.0%/var/log/ceph/ceph-client.admin.33462.log: -- replaced with /var/log/ceph/ceph-client.admin.32250.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33465.log 2024-04-25T12:25:55.059 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-04-25T12:25:55.059 INFO:teuthology.orchestra.run.smithi094.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33462.log.gz 2024-04-25T12:25:55.059 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.27563.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.27563.log.gz 2024-04-25T12:25:55.059 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T12:25:55.059 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27707.log 2024-04-25T12:25:55.059 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33465.log: gzip/var/log/ceph/ceph-osd.1.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33892.log 2024-04-25T12:25:55.059 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.27707.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33465.log.gz 2024-04-25T12:25:55.059 INFO:teuthology.orchestra.run.smithi094.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27707.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36231.log 2024-04-25T12:25:55.060 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-04-25T12:25:55.060 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33892.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33892.log.gz 2024-04-25T12:25:55.060 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32116.log 2024-04-25T12:25:55.060 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33888.log 2024-04-25T12:25:55.060 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36231.log: /var/log/ceph/ceph-client.admin.32116.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36231.log.gz 2024-04-25T12:25:55.060 INFO:teuthology.orchestra.run.smithi094.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32116.log.gz 2024-04-25T12:25:55.060 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34835.log 2024-04-25T12:25:55.060 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34177.log 2024-04-25T12:25:55.060 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33888.log: /var/log/ceph/ceph-client.admin.34835.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33888.log.gz 2024-04-25T12:25:55.061 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27786.log 2024-04-25T12:25:55.061 INFO:teuthology.orchestra.run.smithi094.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.34835.log.gz 2024-04-25T12:25:55.061 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34177.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34177.log.gz 2024-04-25T12:25:55.061 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33882.log 2024-04-25T12:25:55.061 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32460.log 2024-04-25T12:25:55.061 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.27786.log: /var/log/ceph/ceph-client.admin.33882.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.27786.log.gz 2024-04-25T12:25:55.061 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33882.log.gz 2024-04-25T12:25:55.061 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32965.log 2024-04-25T12:25:55.061 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33676.log 2024-04-25T12:25:55.062 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32460.log: /var/log/ceph/ceph-client.admin.32965.log: 89.3% 91.1% -- replaced with /var/log/ceph/ceph-client.admin.32460.log.gz 2024-04-25T12:25:55.062 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32965.log.gz 2024-04-25T12:25:55.062 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33152.log 2024-04-25T12:25:55.062 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32519.log 2024-04-25T12:25:55.062 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33676.log: /var/log/ceph/ceph-client.admin.33152.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33676.log.gz 2024-04-25T12:25:55.062 INFO:teuthology.orchestra.run.smithi094.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33152.log.gz 2024-04-25T12:25:55.062 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35130.log 2024-04-25T12:25:55.062 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34240.log 2024-04-25T12:25:55.063 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32519.log: /var/log/ceph/ceph-client.admin.35130.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32519.log.gz 2024-04-25T12:25:55.063 INFO:teuthology.orchestra.run.smithi094.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35130.log.gz 2024-04-25T12:25:55.063 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33885.log 2024-04-25T12:25:55.063 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33467.log 2024-04-25T12:25:55.063 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34240.log: /var/log/ceph/ceph-client.admin.33885.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34240.log.gz 2024-04-25T12:25:55.063 INFO:teuthology.orchestra.run.smithi094.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33885.log.gz 2024-04-25T12:25:55.063 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35987.log 2024-04-25T12:25:55.063 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T12:25:55.063 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33467.log: /var/log/ceph/ceph-client.admin.35987.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33467.log.gz 2024-04-25T12:25:55.064 INFO:teuthology.orchestra.run.smithi094.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35987.log.gz 2024-04-25T12:25:55.064 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35903.log 2024-04-25T12:25:55.064 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34266.log 2024-04-25T12:25:55.064 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.35903.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35903.log.gz 2024-04-25T12:25:55.064 INFO:teuthology.orchestra.run.smithi094.stderr: 86.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T12:25:55.064 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33100.log 2024-04-25T12:25:55.064 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33310.log 2024-04-25T12:25:55.065 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34266.log: /var/log/ceph/ceph-client.admin.33100.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34266.log.gz 2024-04-25T12:25:55.065 INFO:teuthology.orchestra.run.smithi094.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33100.log.gz 2024-04-25T12:25:55.065 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33126.log 2024-04-25T12:25:55.065 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31794.log 2024-04-25T12:25:55.065 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33310.log: /var/log/ceph/ceph-client.admin.33126.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33310.log.gz 2024-04-25T12:25:55.065 INFO:teuthology.orchestra.run.smithi094.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33126.log.gz 2024-04-25T12:25:55.065 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35235.log 2024-04-25T12:25:55.065 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32198.log 2024-04-25T12:25:55.066 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.31794.log: /var/log/ceph/ceph-client.admin.35235.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31794.log.gz 2024-04-25T12:25:55.066 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35235.log.gz 2024-04-25T12:25:55.066 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32434.log 2024-04-25T12:25:55.066 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32198.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32198.log.gz 2024-04-25T12:25:55.066 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34124.log 2024-04-25T12:25:55.066 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34606.log 2024-04-25T12:25:55.066 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32434.log: /var/log/ceph/ceph-client.admin.34124.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32434.log.gz 2024-04-25T12:25:55.066 INFO:teuthology.orchestra.run.smithi094.stderr: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35104.log 2024-04-25T12:25:55.067 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34124.log.gz 2024-04-25T12:25:55.067 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34606.log: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T12:25:55.067 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34606.log.gz 2024-04-25T12:25:55.067 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36115.log 2024-04-25T12:25:55.067 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35877.log 2024-04-25T12:25:55.067 INFO:teuthology.orchestra.run.smithi094.stderr: 87.5%/var/log/ceph/ceph-client.admin.36115.log: -- replaced with /var/log/ceph/ceph-client.admin.35104.log.gz 2024-04-25T12:25:55.068 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33655.log 2024-04-25T12:25:55.068 INFO:teuthology.orchestra.run.smithi094.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36115.log.gz 2024-04-25T12:25:55.068 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35877.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35877.log.gz 2024-04-25T12:25:55.068 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22757.log 2024-04-25T12:25:55.068 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33668.log 2024-04-25T12:25:55.068 INFO:teuthology.orchestra.run.smithi094.stderr: 87.8%/var/log/ceph/ceph.tmp-client.admin.22757.log: -- replaced with /var/log/ceph/ceph-client.admin.33655.log.gzgzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T12:25:55.068 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22757.log.gz 2024-04-25T12:25:55.068 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-04-25T12:25:55.068 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33668.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33668.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33889.log 2024-04-25T12:25:55.069 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-04-25T12:25:55.069 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T12:25:55.069 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36205.log 2024-04-25T12:25:55.069 INFO:teuthology.orchestra.run.smithi094.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33889.log.gz 2024-04-25T12:25:55.069 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-mds.c.log: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T12:25:55.069 INFO:teuthology.orchestra.run.smithi094.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-25T12:25:55.069 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T12:25:55.069 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.36205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35261.log 2024-04-25T12:25:55.070 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7%/var/log/ceph/ceph-mds.a.log: -- replaced with /var/log/ceph/ceph-client.admin.36205.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31982.log 2024-04-25T12:25:55.070 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-04-25T12:25:55.070 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35261.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35261.log.gz 2024-04-25T12:25:55.070 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33336.log 2024-04-25T12:25:55.070 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.31982.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31982.log.gz 2024-04-25T12:25:55.070 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33457.log 2024-04-25T12:25:55.070 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32860.log 2024-04-25T12:25:55.070 INFO:teuthology.orchestra.run.smithi094.stderr: 88.5%/var/log/ceph/ceph-client.admin.33457.log: -- replaced with /var/log/ceph/ceph-client.admin.33336.log.gz 2024-04-25T12:25:55.071 INFO:teuthology.orchestra.run.smithi094.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33457.log.gz 2024-04-25T12:25:55.071 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35510.log 2024-04-25T12:25:55.071 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32808.log 2024-04-25T12:25:55.071 INFO:teuthology.orchestra.run.smithi094.stderr: 88.0%/var/log/ceph/ceph-client.admin.35510.log: -- replaced with /var/log/ceph/ceph-client.admin.32860.log.gz 2024-04-25T12:25:55.071 INFO:teuthology.orchestra.run.smithi094.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35510.log.gz 2024-04-25T12:25:55.071 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35960.log 2024-04-25T12:25:55.071 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33284.log 2024-04-25T12:25:55.071 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35960.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32808.log.gz 2024-04-25T12:25:55.071 INFO:teuthology.orchestra.run.smithi094.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35960.log.gz 2024-04-25T12:25:55.072 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33232.log 2024-04-25T12:25:55.072 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33206.log 2024-04-25T12:25:55.072 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33232.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33284.log.gz 2024-04-25T12:25:55.072 INFO:teuthology.orchestra.run.smithi094.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33232.log.gz 2024-04-25T12:25:55.072 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33178.log 2024-04-25T12:25:55.072 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34735.log 2024-04-25T12:25:55.072 INFO:teuthology.orchestra.run.smithi094.stderr: 88.4%/var/log/ceph/ceph-client.admin.33178.log: -- replaced with /var/log/ceph/ceph-client.admin.33206.log.gz 2024-04-25T12:25:55.072 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33178.log.gz 2024-04-25T12:25:55.072 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32939.log 2024-04-25T12:25:55.073 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32382.log 2024-04-25T12:25:55.073 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32939.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32939.log.gz 2024-04-25T12:25:55.073 INFO:teuthology.orchestra.run.smithi094.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.34735.log.gz 2024-04-25T12:25:55.073 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33673.log 2024-04-25T12:25:55.073 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32408.log 2024-04-25T12:25:55.073 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6%/var/log/ceph/ceph-client.admin.33673.log: -- replaced with /var/log/ceph/ceph-client.admin.32382.log.gz 2024-04-25T12:25:55.073 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33673.log.gz 2024-04-25T12:25:55.073 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33069.log 2024-04-25T12:25:55.074 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35929.log 2024-04-25T12:25:55.074 INFO:teuthology.orchestra.run.smithi094.stderr: 89.5%/var/log/ceph/ceph-client.admin.33069.log: -- replaced with /var/log/ceph/ceph-client.admin.32408.log.gz 2024-04-25T12:25:55.074 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33069.log.gz 2024-04-25T12:25:55.074 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34528.log 2024-04-25T12:25:55.074 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35023.log 2024-04-25T12:25:55.074 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6%/var/log/ceph/ceph-client.admin.34528.log: -- replaced with /var/log/ceph/ceph-client.admin.35929.log.gz 2024-04-25T12:25:55.074 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34528.log.gz 2024-04-25T12:25:55.075 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32886.log 2024-04-25T12:25:55.075 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.35023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33891.log 2024-04-25T12:25:55.075 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32886.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32886.log.gz 2024-04-25T12:25:55.075 INFO:teuthology.orchestra.run.smithi094.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T12:25:55.075 INFO:teuthology.orchestra.run.smithi094.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.0.35023.log.gz 2024-04-25T12:25:55.075 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34292.log 2024-04-25T12:25:55.075 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34449.log 2024-04-25T12:25:55.075 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32142.log 2024-04-25T12:25:55.076 INFO:teuthology.orchestra.run.smithi094.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33891.log.gz 2024-04-25T12:25:55.076 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34449.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34292.log.gz 2024-04-25T12:25:55.076 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34449.log.gz 2024-04-25T12:25:55.076 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34203.log 2024-04-25T12:25:55.076 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33456.log 2024-04-25T12:25:55.076 INFO:teuthology.orchestra.run.smithi094.stderr: 87.5%/var/log/ceph/ceph-client.admin.34203.log: -- replaced with /var/log/ceph/ceph-client.admin.32142.log.gz 2024-04-25T12:25:55.076 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32834.log 2024-04-25T12:25:55.077 INFO:teuthology.orchestra.run.smithi094.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34203.log.gz 2024-04-25T12:25:55.077 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33456.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33456.log.gz 2024-04-25T12:25:55.077 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35614.log 2024-04-25T12:25:55.077 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32330.log 2024-04-25T12:25:55.077 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33017.log 2024-04-25T12:25:55.077 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35614.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32834.log.gz 2024-04-25T12:25:55.077 INFO:teuthology.orchestra.run.smithi094.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35614.log.gz 2024-04-25T12:25:55.077 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32330.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32330.log.gz 2024-04-25T12:25:55.077 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-25T12:25:55.078 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35287.log 2024-04-25T12:25:55.078 INFO:teuthology.orchestra.run.smithi094.stderr: 87.6%/var/log/ceph/ceph-mds.e.log: -- replaced with /var/log/ceph/ceph-client.admin.33017.log.gz 2024-04-25T12:25:55.078 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32723.log 2024-04-25T12:25:55.078 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35287.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35287.log.gz 2024-04-25T12:25:55.078 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32170.log 2024-04-25T12:25:55.078 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31898.log 2024-04-25T12:25:55.078 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32170.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32170.log.gz 2024-04-25T12:25:55.079 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34345.log 2024-04-25T12:25:55.079 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.31898.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31898.log.gz 2024-04-25T12:25:55.079 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35718.log 2024-04-25T12:25:55.079 INFO:teuthology.orchestra.run.smithi094.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.32723.log.gz 2024-04-25T12:25:55.079 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34345.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34345.log.gz 2024-04-25T12:25:55.079 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32595.log 2024-04-25T12:25:55.080 INFO:teuthology.orchestra.run.smithi111.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T12:25:55.082 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.35718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33388.log 2024-04-25T12:25:55.082 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32595.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35718.log.gz 2024-04-25T12:25:55.082 INFO:teuthology.orchestra.run.smithi094.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32595.log.gz 2024-04-25T12:25:55.082 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32991.log 2024-04-25T12:25:55.082 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34554.log 2024-04-25T12:25:55.082 INFO:teuthology.orchestra.run.smithi094.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33388.log.gz 2024-04-25T12:25:55.082 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32991.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32991.log.gz 2024-04-25T12:25:55.083 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.34554.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34554.log.gz 2024-04-25T12:25:55.083 INFO:teuthology.orchestra.run.smithi094.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-25T12:25:55.084 INFO:teuthology.orchestra.run.smithi111.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T12:25:55.276 INFO:teuthology.orchestra.run.smithi094.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T12:25:55.640 INFO:teuthology.orchestra.run.smithi111.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T12:25:55.676 INFO:teuthology.orchestra.run.smithi111.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T12:25:55.687 INFO:teuthology.orchestra.run.smithi111.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T12:25:55.697 INFO:teuthology.orchestra.run.smithi094.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T12:25:55.714 INFO:teuthology.orchestra.run.smithi111.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T12:25:55.715 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-04-25T12:25:55.715 INFO:teuthology.orchestra.run.smithi111.stderr:real 0m0.781s 2024-04-25T12:25:55.715 INFO:teuthology.orchestra.run.smithi111.stderr:user 0m3.070s 2024-04-25T12:25:55.715 INFO:teuthology.orchestra.run.smithi111.stderr:sys 0m0.124s 2024-04-25T12:25:55.738 INFO:teuthology.orchestra.run.smithi094.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T12:25:55.750 INFO:teuthology.orchestra.run.smithi094.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T12:25:55.782 INFO:teuthology.orchestra.run.smithi094.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T12:25:55.784 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-04-25T12:25:55.784 INFO:teuthology.orchestra.run.smithi094.stderr:real 0m0.863s 2024-04-25T12:25:55.784 INFO:teuthology.orchestra.run.smithi094.stderr:user 0m3.556s 2024-04-25T12:25:55.784 INFO:teuthology.orchestra.run.smithi094.stderr:sys 0m0.158s 2024-04-25T12:25:55.785 INFO:tasks.ceph:Archiving logs... 2024-04-25T12:25:55.785 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673355/remote/smithi094/log 2024-04-25T12:25:55.786 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T12:25:56.352 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673355/remote/smithi111/log 2024-04-25T12:25:56.353 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T12:25:56.728 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T12:25:56.737 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T12:25:56.738 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T12:25:56.740 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T12:25:56.818 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T12:25:56.827 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T12:25:56.828 DEBUG:teuthology.orchestra.run.smithi094:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T12:25:56.830 DEBUG:teuthology.orchestra.run.smithi111:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T12:25:56.841 INFO:teuthology.orchestra.run.smithi094.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T12:25:56.841 INFO:teuthology.orchestra.run.smithi094.stdout:============================================================================== 2024-04-25T12:25:56.841 INFO:teuthology.orchestra.run.smithi094.stdout:+hv01.front.sepi 67.205.162.81 3 u 6 64 377 0.093 -0.825 0.824 2024-04-25T12:25:56.841 INFO:teuthology.orchestra.run.smithi094.stdout:*hv02.front.sepi 63.231.80.2 3 u 9 64 377 0.068 -0.090 0.675 2024-04-25T12:25:56.841 INFO:teuthology.orchestra.run.smithi094.stdout:+hv03.front.sepi 74.6.168.72 3 u 5 64 377 0.076 -0.039 0.849 2024-04-25T12:25:56.841 INFO:teuthology.orchestra.run.smithi094.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T12:25:56.843 INFO:teuthology.orchestra.run.smithi111.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T12:25:56.843 INFO:teuthology.orchestra.run.smithi111.stdout:============================================================================== 2024-04-25T12:25:56.843 INFO:teuthology.orchestra.run.smithi111.stdout:+hv01.front.sepi 67.205.162.81 3 u 7 64 377 0.108 -1.334 0.982 2024-04-25T12:25:56.844 INFO:teuthology.orchestra.run.smithi111.stdout:+hv02.front.sepi 63.231.80.2 3 u 7 64 377 0.196 +0.423 1.035 2024-04-25T12:25:56.844 INFO:teuthology.orchestra.run.smithi111.stdout:*hv03.front.sepi 74.6.168.72 3 u 13 64 377 0.089 -0.622 0.984 2024-04-25T12:25:56.844 INFO:teuthology.orchestra.run.smithi111.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T12:25:56.845 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T12:25:56.859 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T12:25:56.859 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T12:25:56.909 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T12:25:56.960 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T12:25:57.009 INFO:teuthology.task.internal:Duration was 901.223892 seconds 2024-04-25T12:25:57.010 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T12:25:57.060 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T12:25:57.060 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T12:25:57.063 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T12:25:57.100 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T12:25:57.101 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi094.front.sepia.ceph.com 2024-04-25T12:25:57.101 DEBUG:teuthology.orchestra.run.smithi094:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T12:25:57.151 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi111.front.sepia.ceph.com 2024-04-25T12:25:57.151 DEBUG:teuthology.orchestra.run.smithi111:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T12:25:57.161 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T12:25:57.161 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T12:25:57.194 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T12:25:57.228 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T12:25:57.229 DEBUG:teuthology.orchestra.run.smithi094:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T12:25:57.267 DEBUG:teuthology.orchestra.run.smithi111:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T12:25:57.325 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T12:25:57.335 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T12:25:57.335 DEBUG:teuthology.orchestra.run.smithi094:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T12:25:57.346 DEBUG:teuthology.orchestra.run.smithi111:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T12:25:57.359 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T12:25:57.410 DEBUG:teuthology.orchestra.run.smithi094:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T12:25:57.413 DEBUG:teuthology.orchestra.run.smithi111:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T12:25:57.421 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = core 2024-04-25T12:25:57.423 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = core 2024-04-25T12:25:57.532 DEBUG:teuthology.orchestra.run.smithi094:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T12:25:57.537 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:25:57.537 DEBUG:teuthology.orchestra.run.smithi111:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T12:25:57.579 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:25:57.579 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T12:25:57.591 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T12:25:57.592 DEBUG:teuthology.misc:Transferring archived files from smithi094:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673355/remote/smithi094 2024-04-25T12:25:57.592 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T12:25:57.614 DEBUG:teuthology.misc:Transferring archived files from smithi111:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673355/remote/smithi111 2024-04-25T12:25:57.615 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T12:25:57.643 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T12:25:57.643 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T12:25:57.659 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T12:25:57.688 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T12:25:57.698 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T12:25:57.699 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T12:25:57.719 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T12:25:57.719 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T12:25:57.722 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T12:25:57.725 INFO:teuthology.orchestra.run.smithi094.stdout: 658640 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 12:25 /home/ubuntu/cephtest 2024-04-25T12:25:57.736 INFO:teuthology.orchestra.run.smithi111.stdout: 658466 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 12:25 /home/ubuntu/cephtest 2024-04-25T12:25:57.737 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T12:25:57.751 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T12:25:57.821 INFO:teuthology.nuke:Checking targets against current locks 2024-04-25T12:25:57.847 DEBUG:teuthology.nuke:shortname: smithi094 2024-04-25T12:25:57.847 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T12:25:57.871 DEBUG:teuthology.nuke:shortname: smithi111 2024-04-25T12:25:57.872 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T12:25:57.875 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673355', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 12:01:37.009793', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJfTSv7vMzHvjQXYZUaACokviymJH9s74MyO3qsaugg1TGjlYs3nxEsrIQdStWPCYKUur12JmThsUYMd+n2RGoA='} 2024-04-25T12:25:57.895 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_11:13:36-fs-wip-lusov-quiescer-distro-default-smithi/7673355', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 12:01:37.008310', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLHwSyuUZgTTzFyWt6IuQv0TtKrF/6cj/pFgbB9JWdq+kIXngUeQPqUL31ZMTODhfqMLpYt7noj5lvtH6/PRnAQ='} 2024-04-25T12:25:57.932 INFO:teuthology.orchestra.console.smithi094:Power off 2024-04-25T12:25:57.933 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T12:25:57.961 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off 2024-04-25T12:25:57.961 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T12:25:57.980 INFO:teuthology.orchestra.console.smithi111:Power off 2024-04-25T12:25:57.980 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T12:25:57.990 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2024-04-25T12:25:58.003 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2024-04-25T12:25:58.003 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T12:25:58.029 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-04-25T12:26:01.991 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T12:26:02.030 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T12:26:02.104 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2024-04-25T12:26:02.140 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-04-25T12:26:06.106 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T12:26:06.141 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T12:26:06.217 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2024-04-25T12:26:06.251 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2024-04-25T12:26:06.352 INFO:teuthology.orchestra.console.smithi111:Power off completed 2024-04-25T12:26:10.220 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T12:26:10.332 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2024-04-25T12:26:10.432 INFO:teuthology.orchestra.console.smithi094:Power off completed 2024-04-25T12:26:10.538 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}} duration: 901.2238924503326 failure_reason: '''cluster''' flavor: default owner: scheduled_leonidus@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=c1dd077755d84951b23658a65e5caa2f status: fail success: false 2024-04-25T12:26:10.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T12:26:10.621 INFO:teuthology.run:FAIL